LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

M3 Max (alien.top)

submitted 10 months ago by akashocx17@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

Seems like M3 Max is best suited for Large Language Model training. With 128 gb unified memory essential let us train models on billions of parameters! Pretty interesting.

you are viewing a single comment's thread
view the rest of the comments

[–] CodeGriot@alien.top 1 points 10 months ago

You probably need to wait for the Mac Studio refresh announcements for something more clearly relevant to LLM devs. Hopefully those will have 256GB or more unified memory configs, but likely something for 2024.

That said, it's handy to be able to run inference on a q8 70b model on your local dev box, so the 96GB & 128GBs are interesting for that.