You could just run everything as root or configure sudo without timeout.
exu
joined 1 year ago
You'll want to install a reverse proxy of your choice on the VPS. Have clients access it over ipv4 and configure it to proxy pass it to your ipv6 address. Nginx at least is capable of doing ipv4 & ipv6 -> ipv4, I think the inverse should also be possible.
You can use OpenCL instead of ROCm for GPU offloading. In my tests with llama.cpp that improved performance massively.
Definitely do benchmarks for how many layers you can offload to the GPU. You'll see when it's too many, as performance will crater.
By launching llama.cpp as a server you'll actually be able to continue to use openwebui as you currently have.
Firewalld had, at least last time I checked, way more capabilities than UFW. Both are fine at being basic firewalls, but I don't think you can build a router using just UFW.
Firewalld allows some pretty advanced rules. I use it to redirect a bunch of web requests going to a certain address over a local ssh tunnel.
It'll also ignore the default firewalld rules. IIRC it uses the internal zone instead
It would probably take someone to sue them, but they would have to implement it.
It's probably still more efficient to keep a 192k opus and a 320k mp3 around than one flac.
I remember a HackerNews comment by the lead XFCE dev about how KDE was actually better optimized, because they have so many more devs working on it.
Yes. I use a hacky script to copy them to the right place
I don't know how good it is, but for Turing and later GPUs there's a new official open source driver being developed. You'd likely have to use a more bleeding edge distro to get that.
VR works depending on your headset. Index is fine, Oculus doesn't work.
You could make a usb stick of your desired distro and test everything without permanent changes before commiting.
*for 20-series and later graphics cards
Big ass enter is way better than the small one.
You can't change my mind.