Boring_Isopod2546

joined 10 months ago

Should corporations and smaller businesses be training, refining, and running local LLMs to avoid the future cost of the new cloud services M$ and Amazon are rolling out? in c/localllama@poweruser.forum

[–] Boring_Isopod2546@alien.top 1 points 9 months ago

What's the state of licensing anyway? Aren't pretty much all the open source models currently available to run locally supposed to be for non-commercial use?

permalink
fedilink
source

Buying a p40 for 70b-120b in c/localllama@poweruser.forum

[–] Boring_Isopod2546@alien.top 1 points 10 months ago (3 children)

I keep seeing these low numbers. Where are people finding 3090s that cheap? I was lucky to get a pair at about 900 each, but most places I see them listed, even refurbished ones are $800-1K.

permalink
fedilink
source
context