Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

[P] I got a ML internship and have no idea what to do (alien.top)

submitted 1 year ago by danielwilu2525@alien.top to c/machinelearning@academy.garden

19 comments fedilink hide all child comments

I’ve got research background in ML but never actually developed any models as it was all theoretical work. I got lucky during the interview stage for this role as my research impressed them. My project involves fine-tuning a GPT-3 model for a specific task and host the model on a website. Does anyone have any tips on how to go about learning what I need to know to do this? Also what should I consider when curating my custom dataset when fine-tuning the model? I really want this to be a learning experience for me.

you are viewing a single comment's thread
view the rest of the comments

[–] JDubbleu@programming.dev 1 points 1 year ago* (last edited 1 year ago)

I don't have any resources as I'm a SWE, but I do have some advice.

Ask for help from your mentor/other engineers. Seriously, I'm a software engineer (non-ML, but ML teams operate similar to SWE teams) and we don't expect interns to know almost anything, and we understand they're gonna need quite a bit of hand holding. I know I did. It's okay! That's how we all learn, and being able to ask for help when you need it is one of the most vital skills to have in software. The absolute worst thing you could do is struggle the whole internship without getting the help you need.

All you gotta do is say, "Hey, I'm struggling with the fine-tuning of this model for my project. My research and academic experience have all been extremely theoretical, but I never got the chance to do much practical tuning. Do you have some suggestions given where I'm at?". Obviously provide a lot of extra context for where you're at/what you're struggling with, but you get the point. They're not gonna fire you so don't worry about that (literally every interns worst fear), and they want you to learn! Asking would reflect well on you too since you're showing 1) you know your short comings and 2) you are actively working to overcome them. If you can do both of those things you're already ahead of most people.

Good luck!