LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

M3 Max (alien.top)

submitted 1 year ago by akashocx17@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

Seems like M3 Max is best suited for Large Language Model training. With 128 gb unified memory essential let us train models on billions of parameters! Pretty interesting.

you are viewing a single comment's thread
view the rest of the comments

[–] Infinite100p@alien.top 1 points 1 year ago

300GB/s memory bandwidth is the cheaper M3 Max with 14-core CPU and 30-core GPU.

The only CPU that can have 128GB RAM is M3 Max with 16-core CPU and 40-core GPU, and that one has 400GB/s memory bandwidth).

What are your thoughts for someone who needs a dev laptop anyway. For dev a $3200 version is enough. 128Gb one would cost me $5k.

Is almost $2k extra worth it?