this post was submitted on 21 Mar 2024
79 points (90.7% liked)
Technology
59472 readers
3380 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Weird that they act like the 1.7B model is too big for a laptop, in contrast to a...4060 with the same amount of memory as that laptop. A 1.7B model is well within range of what you can run on a MacBook Air.
I don't think a 170M model is even useful for the same class of applications. Could be good for real-time applications though.
Looking forward to testing these, if they are ever made publicly available.
They wrote "cheap m1 MacBook". That's 8gb ram in total. You can't reasonably compare a GPU with 8gb of dedicated RAM to 8gb of shared main memory.