APC Symmetra LX 16kVa wired to a secondary panel. That panel feeds both the rack and computer receptacles in my office.
For extended outages I have a natural gas powered permanently installed backup generator. Generator start and transfer switch is fully automatic
As far as the rack and my office machines are concerned the power never goes out, even though my area experiences frequent brownouts and winter has a pretty good chance of seeing an extended blackout
If self hosting, I'd virtualize the workstations and utilize GPUs designed for virtualized engineering workstations, like a Nvidia A100
As for access, you could go through the trouble and expense of exposing something like VMware Horizon VDI to the internet through a reverse proxy if using virtualized workstations.
A better option would be to go with Cloudflare Zero Trust. You run a small agent on your side, and people outside needing access sign in through Cloudflare, and you can grant very specific access to what they need. It's kind of like a VPN but with much greater control over where someone can go while connected
You'll want to segment the workstations off into their own VLAN, and you should be using a good firewall on its own hardware to lock down access between outside and the workstation VLAN (ie only allow connection from Cloudflare service endpoint urls to IP range of your workstations)