LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Are there people who have ran MI25s, MI60s, etc for LLMs? (alien.top)

submitted 11 months ago by Nix_The_Furry@alien.top to c/localllama@poweruser.forum

4 comments fedilink hide all child comments

I am looking to get a MI60 for both LLMs and other high compute tasks as some are going for $350 on ebay. It looks like a really good deal for my applications and with the 32GBs of RAM, but I was wondering what others have experienced with it for use with LLMs. I am curious on how compatibility was for OpenCL or ROCm, I mainly use Windows so am wondering if I can still use it with most of its speed through windows, and what kind of speeds people are getting using it with models.

Thank you!

you are viewing a single comment's thread
view the rest of the comments

[–] Amgadoz@alien.top 1 points 11 months ago

u/ehartford