Dogeboja

joined 11 months ago

How can I eliminate generic AI responses? in c/localllama@poweruser.forum

[–] Dogeboja@alien.top 1 points 9 months ago

is this satire?

is there any other tools like vLLM or TensorRT that can be used to speed up LLM inference? in c/localllama@poweruser.forum

[–] Dogeboja@alien.top 1 points 10 months ago

I'm going insane with all of these options. Someone really needs to do a comparison of them.