Do note that this system is liable to leave your computer vulnerable as it has no way to update itself from within the OS.
Yeah, as shadowtofu points out below, you're thinking of Tiny11 Core, which is the extra stripped down version that's not recommended for most users.
Tiny11 can update just fine, it just won't nag you to immediately update all the time like regular windows does.
I've been using Tiny11 as my secondary daily driver (my desktop main is stil running Windows 10) for a few months now, updating roughly once a month (with the option to do it more often if I want to) with absolutely no problems.