this post was submitted on 30 Oct 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Is using WSL good enough for running LLM models locally? (alien.top)
submitted 1 year ago by derpgod123@alien.top to c/localllama@poweruser.forum
5 comments fedilink hide all child comments
 

Or should I dual boot ubuntu instead of using WSL

top 5 comments
sorted by: hot top controversial new old
[–] HADI_I_I@alien.top 1 points 1 year ago

WSL eats alot of RAM memory

[–] AnomalyNexus@alien.top 1 points 1 year ago

It's fine...you take a bit of a hit on the VRAM by virtue of well windows running though. Only really an issue if you're on 8gb though

[–] extopico@alien.top 1 points 1 year ago

With WSL2 you can even mount a native ext4 drive and have the whole environment run at an almost native Linux speed.

[–] iloveergs@alien.top 1 points 1 year ago

Wsl bad, wsl2 good.

[–] ageofwant@alien.top 1 points 1 year ago

Not really, just use Linux, and delete your windows partition why are bothering with that still ?