Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 11 months ago

MODERATORS

communick@academy.garden

[D] Gen-AI/LLM - Interview prep (alien.top)

submitted 10 months ago by ade17_in@alien.top to c/machinelearning@academy.garden

9 comments fedilink hide all child comments

Hello folks,

I have an interview call later this week which the work is regarding implementing generative AI within the companies workflow. Using LLMs with finetuning/in-context learning using system logs etc kind of stuff.

I have studied machine learning, worked for few years now as well. Have good understanding of those stuff but never tried fine tuning hands-on. I'm worked majority into computer-vision applications but think that I lagged a bit on the LLM side.

Any suggestions, recommeded papers, courses, videos I could go through?

Thanks!

top 9 comments

sorted by: hot top controversial new old

[–] RonLazer@alien.top 1 points 10 months ago (1 children)

Not an exhaustive list, but here's a few suggestions:

Get really familiar with embedding/semantic-search/RAG.
Fine-tune a LLaMA-2 7B model using QLoRA on an A10 EC2 instance (or whatever compute you have) to do something like document classification or sentiment analysis.
Watch this video: https://www.youtube.com/watch?v=yj-wSRJwrrc
Read this paper: https://arxiv.org/pdf/2311.04235.pdf