Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 11 months ago

MODERATORS

communick@academy.garden

[D] Classification problem giving me white hair (alien.top)

submitted 10 months ago by Critical_Ad_1205@alien.top to c/machinelearning@academy.garden

3 comments fedilink hide all child comments

So!

I am a ML newbie and was wondering if one of you pros can help me out on my learning journey (tool use = google colab).

I have a csv file containing loan data where each row is a customer that applied for a loan. One of the columns is called TARGET and it shows whether the customer's loan request was approved or not. All sorts of data points are captured e.g. age, gender, salary, employment details like industry, assets, etc.

I've done cross validation and found that GradientBasedClassifier and LGBM perform the best. Cross validation also tells me that their accuracy is between 68%-70%.

My problem is that I SUCK at hyper param optimisation. How do you go from 68 to +80%??? Or 90%?

For the curious ones, here is the dataset: https://drive.google.com/file/d/1IKNVstck6gnXvfGS-mVRMAE1RFrDNUgZ/view?usp=sharing

you are viewing a single comment's thread
view the rest of the comments

[–] sandalwoodking15@alien.top 1 points 10 months ago

As another comment stated using grid search, there’s a more optimised approach to this called Bayesian optimisation. There’s many algorithms you can implement for it. A personal favourite library of mine called optuna does it without the user having to think about the algorithm used for optimisation. (It employs a parzen estimator if y wanna get into the details you can look at that)