overview for NachosforDachos

Please enlighten me, why are people building LLM Twitter bots? in c/localllama@poweruser.forum

[–] NachosforDachos@alien.top 1 points 9 months ago

Lazy promoting.

Quantizing 70b models to 4-bit, how much does performance degrade? in c/localllama@poweruser.forum

[–] NachosforDachos@alien.top 1 points 9 months ago

That was useful and interesting.

Speaking of hypothetical situations how much money do you think an individual would need to buy the computing power needed to provide themselves with a gpt 4 turbo like experience locally?

Should corporations and smaller businesses be training, refining, and running local LLMs to avoid the future cost of the new cloud services M$ and Amazon are rolling out? in c/localllama@poweruser.forum

[–] NachosforDachos@alien.top 1 points 9 months ago

Most small businesses don’t know hours to use easy (commercial) AI let alone something as refined as this.

A lot of them don’t believe in it either.

Fall behind they will.

Need a humane LLM to talk with. in c/localllama@poweruser.forum

[–] NachosforDachos@alien.top 1 points 10 months ago (1 children)

I can make you one but you would have to give me the material of what you want it to sound like.