Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

Bill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N] (www.handelsblatt.com)

submitted 11 months ago by we_are_mammals@alien.top to c/machinelearning@academy.garden

130 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Appropriate_Ant_4629@alien.top 1 points 11 months ago (1 children)

We need a name for the fallacy where people call highly nonlinear algorithms with billions of parameters "just statistics"

Well, thanks to quantum mechanics; pretty much all of existence is probably "just statistics".

as if all they're doing is linear regression.

Well, practically all interesting statistics are NONlinear regressions. Including ML. And your brain. And physics.

[–] KoalaNumber3@alien.top 1 points 11 months ago (1 children)

What a lot of people don’t understand is that linear regression can still handle non-linear relationships.

For a statistician, linear regression just means the coefficients are linear, it doesn’t mean the relationship itself is a straight line.

That’s why linear models are still incredibly powerful and are used so widely across so many fields.

[–] Appropriate_Ant_4629@alien.top 1 points 11 months ago

Yet still limited compared to even not-very-deep NNs. If the user wants to fit a parabola with a linear regression, he pretty much has to manually add a quadratic term himself.

I think they're widely used primarily because they're widely taught in school.