Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

Macbook Pro M3 for LLMs and Pytorch? [D] (alien.top)

submitted 1 year ago by nizego@alien.top to c/machinelearning@academy.garden

7 comments fedilink hide all child comments

My current PC laptop is soon ready to retire, having worked for seven years. As a replacement I'm considering the new Macbook Pros. It is mainly the battery time which makes me consider Apple. These are my requirements for the laptop:

great battery time
16" since I'm old and my eyes are degraded
dual external monitors
software engineering including running some local docker images

Then I have two ML requirements which I don't know if I could fulfill using a laptop:

good performance for working with local LLMs (30B and maybe larger)
good performance for ML stuff like Pytorch, stable baselines and sklearn

In order to fulfill the MUST items I think the following variant would meet the requirements:

Apple M3 Pro chip with 12‑core CPU, 18‑core GPU, 16‑core Neural Engine
36 GB memory
512 GB SSD
Price: $2899

Question: Do you think I could fulfill the ML requirements using a Macbook Pro M3? Which config would be smart to buy in such case?

Thankful for advice!

you are viewing a single comment's thread
view the rest of the comments

[–] Mysterious_Can_2399@alien.top 1 points 11 months ago

I just got MacBook M3 max, and really psyched to start running some training workloads. I am scoping what acceleration libraries (such as DeepSpeed) I can use with PyTorch model code on M3. Would really appreciate if someone can suggest it.