this post was submitted on 14 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 11 months ago
MODERATORS
 

I’ve got research background in ML but never actually developed any models as it was all theoretical work. I got lucky during the interview stage for this role as my research impressed them. My project involves fine-tuning a GPT-3 model for a specific task and host the model on a website. Does anyone have any tips on how to go about learning what I need to know to do this? Also what should I consider when curating my custom dataset when fine-tuning the model? I really want this to be a learning experience for me.

you are viewing a single comment's thread
view the rest of the comments
[–] glitch83@alien.top 1 points 10 months ago (4 children)

Sounds a little like you're overqualified. Fine tuning is something you could probably pick up from a udacity course if you'd like.

[–] Celsuss@alien.top 1 points 10 months ago

How can someone be overqualified when they don't know how to do their work tasks?

[–] mrfox321@alien.top 1 points 10 months ago

s/over/under/d

[–] pc_4_life@alien.top 1 points 10 months ago

Or a huggingface tutorial

[–] killver@alien.top 1 points 10 months ago

He obviously is not overqualified, otherwise he would know how to do it. Sure, calling some random code snippets to fine-tune is easy, but doing this properly takes quite some experience.