LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

System Configuration. (AMD / NVIDIA) (alien.top)

submitted 11 months ago by RelevantFoundation14@alien.top to c/localllama@poweruser.forum

2 comments fedilink hide all child comments

Hello everyone,

I am preparing my rig for diving into machine learning and am seeking some advice. After spending some time on this forum, it seems that if you're equipped with an AMD 7900XT, Windows might be a better choice over Ubuntu.

I am interested in firsthand information about the tools you use and the projects you are undertaking with your system's specifications.

At the moment, I am running Linux with a 5800X3D, 7900XT, and 32GB of RAM.I'm really just looking for some first hand information about the tools you are using and what you are doing with the system specifications you have.

top 2 comments

sorted by: hot top controversial new old

[–] Kevinswelt@alien.top 1 points 11 months ago

I am currently running windows with my AMD, but that is only because I prefer windows. Pretty much nothing, except Stable Diffusion at very slow speeds via direct ml and koboldcpp-rocm inference, works. I was able to use normal Stable Diffusion on Ubuntu after ~2h of trying to get it to work. Sadly, it randomly stopped working the next week. Never managed to get Ooba working, but I gave up rather quick after I found koboldcpp-rocm.

[–] a_beautiful_rhind@alien.top 1 points 11 months ago

Easier to compile things and free resources up on linux. Goes for AMD and intel.

You could also run WSL.