TheHumanFixer

joined 11 months ago
sorted by: new top controversial old
1
Is there really no way you can run 70b models without having a very fast GPU or a lot of ram? (alien.top)
 

I feel there’s go to be away without having a mega fast computer. There’s a couple on Google Colab but I have privacy issues

1
Will Local LLM just won’t run on a computer with low ram or will it run but be incredibly slow? (alien.top)
 

I have a 4gb ram on my computer , so I’m going to assume it makes it impossible to run a fast model like that. But will it be slow to run or will it just not run completely?

Is it possible to run Llama on a 4gb ram? in c/localllama@poweruser.forum
[–] TheHumanFixer@alien.top 1 points 11 months ago

Nope regular ram

1
Is it possible to run Llama on a 4gb ram? (alien.top)
 

Yes. This has to be the worst ram you guys have ever seen but hear me out. Is it possible? I want to run the full 70gb model but that’s far out of question and I’m not even going to bother. Can I atleast run the 13gb or at least the 7gb?