vlodia

joined 1 year ago

This model is extremely good in c/localllama@poweruser.forum

[–] vlodia@alien.top 1 points 11 months ago

How many tokens is its limit? And how do you change its token parameters in python?

Macs with 32GB of memory can run 70B models with the GPU. in c/localllama@poweruser.forum

[–] vlodia@alien.top 1 points 11 months ago

how about for those mere mortals with an entry level Macbook Pro M1 Pro 2022? Share a link to a friend?