this post was submitted on 13 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 11 months ago
MODERATORS
 

Hello folks,

I have an interview call later this week which the work is regarding implementing generative AI within the companies workflow. Using LLMs with finetuning/in-context learning using system logs etc kind of stuff.

I have studied machine learning, worked for few years now as well. Have good understanding of those stuff but never tried fine tuning hands-on. I'm worked majority into computer-vision applications but think that I lagged a bit on the LLM side.

Any suggestions, recommeded papers, courses, videos I could go through?

Thanks!

you are viewing a single comment's thread
view the rest of the comments
[โ€“] RonLazer@alien.top 1 points 10 months ago (1 children)

Not an exhaustive list, but here's a few suggestions:

  1. Get really familiar with embedding/semantic-search/RAG.
  2. Fine-tune a LLaMA-2 7B model using QLoRA on an A10 EC2 instance (or whatever compute you have) to do something like document classification or sentiment analysis.
  3. Watch this video: https://www.youtube.com/watch?v=yj-wSRJwrrc
  4. Read this paper: https://arxiv.org/pdf/2311.04235.pdf
[โ€“] ade17_in@alien.top 1 points 10 months ago

Thanks alot. Surely helpful