Atharv_Jaju

joined 10 months ago

Fitting 70B models in a 4gb GPU, The whole model, no quants or distil or anything! in c/localllama@poweruser.forum

[–] Atharv_Jaju@alien.top 1 points 9 months ago

I feel the 70 B model itself won't fit my storage ( SSD ) since I have only 50 GB left.

When OpenAI takes neutering to the extreme... in c/localllama@poweruser.forum

[–] Atharv_Jaju@alien.top 1 points 10 months ago

NGL this is comedy for me 😆