Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

Bill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N] (www.handelsblatt.com)

submitted 11 months ago by we_are_mammals@alien.top to c/machinelearning@academy.garden

130 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] flintsmith@alien.top 1 points 11 months ago (1 children)

I liked this Q* review/speculation.

https://youtu.be/ARf0WyFau0A?si=9Y19DzMI2puKHWRA

According to this you can get a 30x improvement by (what seems to my ignorant self) careful prompting. Ask for stepwise logic, discard sus answers and combine best answers to get a glimpse of a much better trained model.

[–] liongalahad@alien.top 1 points 11 months ago (1 children)

Yes I watched the same exact video yesterday. I feel we are still at the feet of the mountain in terms of what's next in AI, plateau is still not in sight.

[–] flintsmith@alien.top 1 points 11 months ago

I hate to be a conspiracy-theory inventer, but with Microsoft trying to headhunt the entire staff of OpenAI, Bill Gates's pronouncements regarding plateaus should be discarded out of hand.