Just beware that like AMD, Intel GPUs suffer a performance hit when using LLMs because of the CUDA specific optimizations in frameworks like llama.cpp
tau
joined 1 year ago
I've heard good things about Instander, but it may not satisfy all the requirements of an alternative frontend.
+1 for quadlet. It's another file format to learn, but it's worth it, particularly if you want your containers to auto-update. Also check out podlet to help mitigate some of the compose to .container issues.
Why would we PUNish you?
Just worked for me! Lemmy is the best!
LibreTube suddenly was really laggy on all instances, but the instances on browser are fine. I'm using NewPipe/Clipious for the time being.
Do you have any tips (or examples) using quadlets? I tried using them but I couldn't wrap my head around them.