theonewhoask11

joined 10 months ago
sorted by: new top controversial old
[D] Massive amount of RAM needed to run a model. in c/machinelearning@academy.garden
[–] theonewhoask11@alien.top 1 points 9 months ago

And thanks to you, it now works. I knew exactly what to do and what I needed to get it to work. Thanks, man!

[D] Massive amount of RAM needed to run a model. in c/machinelearning@academy.garden
[–] theonewhoask11@alien.top 1 points 9 months ago

Let's go, I'm saved!

1
[D] Is there a good Arabic model for open-domain dialogue? (alien.top)
 

I really need it for a project.

[D] Massive amount of RAM needed to run a model. in c/machinelearning@academy.garden
[–] theonewhoask11@alien.top 1 points 9 months ago (3 children)

That is exactly the reason, I'm literally looking at my options and from the comments, it definitely isn't looking good 😭

Let's say I want to work on Noon (https://huggingface.co/Naseej/noon-7b), how much would I actually need?

1
[D] Massive amount of RAM needed to run a model. (alien.top)
 

I have a good PC, but the problem is with my RAM. The model is LLM, which makes the memory requirement understandable, but I can't afford to get that much RAM right now so I'm looking for a roundabout. Any help?