CPU speed ups... So... Mac's are back in the game for local LLM?
Delicious-View-8688
joined 1 year ago
[D] Skill Creep in ML/DL Roles - is the field getting not just more competitive, but more difficult?
I think it never really became a thing. People/Teams/Orgs treated them as SWEs with ML applications and that is more or less what it became. Most seem to just throw xgboost and random models from huggingface at everything and see what sticks.
Yes. There is an implementation that loads each layer as required - thereby reducing the VRAM requirements. Just Google it. LLaMa 70b with 4GB.