this post was submitted on 24 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
 

What is the best way to learn LLM / generative AI topics in depth:

  • loss functions
  • finetuning (LoRA, QLoRA, etc)
  • creating good datasets
  • quantization, AWQ

etc. I know there is the Fast AI course, but more interested in these above topics. Seems like there are scattered guides, notebooks and a promising repo here: https://github.com/peremartra/Large-Language-Model-Notebooks-Course but nothing comprehensive.

you are viewing a single comment's thread
view the rest of the comments
[–] Educational-Net303@alien.top 1 points 10 months ago

Karpathys channel is awesome for intro, then you can just start reading the papers for more in depth learning