DaltonSC2

joined 10 months ago
sorted by: new top controversial old
What is the tiniest GPT model one can fine tune on home hardware? in c/localllama@poweruser.forum
[–] DaltonSC2@alien.top 1 points 10 months ago

Checkout NanoGPT, it's very educational. You can even load GPT2 weights and finetune them if you want: https://github.com/karpathy/nanoGPT (The accompanying YouTube video is also very nice)