Masark

joined 1 year ago
sorted by: new top controversial old
Is there such a thing as the opposite of a data hoarder? in c/datahoarder@selfhosted.forum
It is time keep hoarding AI models as Chinese censorship hits NYC based Huggingface the biggest AI library in c/datahoarder@selfhosted.forum
[–] Masark@alien.top 2 points 11 months ago

  1. You simply download the file and keep it. We're talking about stuff you can run on your own computer, not services like chatgpt or such.

  2. Highly variable. Depends on model size and format. For LLMs, range would be from under 1GB up to a current maximum of ~240GB.

  3. It's a big file of numbers ("weights" or "parameters") either integers or floating point depending on format.

Note to self, don't adjust temperature too much in c/localllama@poweruser.forum
[–] Masark@alien.top 1 points 1 year ago

LLMs are just like humans. Turn up the temperature too much and they develop delirium.