Machine Learning

So he was kicked out for being the opposite of “not totally open with the board”

This is what happens when AI is smart enough to generate gossip about itself.

'hey chatgpt, generate some rumors to spin the recent unsettling news such that OpenAI is worth more after the insane public power struggle unsettles it'

"Q! I know you're behind this, show yourself!"

So the implication here is that the CEO knew about the breakthrough, but hid it from the board?

MSFT did experience a 20% climb over the last month. Maybe it was due to this news leaking out?

OpenAI defines AGI as AI systems that are smarter than humans? So not AGI as EVERYONE else understands it.

What is happening with this sub? Where are all the good papers and real ML techinal discussions?

OK, so full speculation: this project could be an impl. of Q-Learning (i.e unsupervised reinforcement learning) on an internal GPT model. This would no doubt be an agent model.

Other evidence? The * implies a graph traversal algorithm, which obviously plays a huge role in RL exploration, but also GPT models are already doing their own graph traversal via beam search to do next token prediction.

Are they perhaps hooking up an RL trained model to replace their beam search?

Can someone help me understand, what does it mean by "smarter than humans"? Do those LLM just read internet text written by humans?

This all screams bs.

OpenAI's hallucinations are big problems.

Ayyayyay the source for this. The news must be desperate to cash in on the drama. You have all these anonymous people pretending they work at OAI. Last one said that they had AGI internally. They used to do this with Google with conspiracy theories that Google was locking an AGI from everyone.

Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company

I would take this with a heavy grain of salt.

Paywalled snippets of https://www.theinformation.com/articles/openai-made-an-ai-breakthrough-before-altman-firing-stoking-excitement-and-concern

https://pbs.twimg.com/media/F_lG1SmaEAAAYip.jpg

"A demo of the model circulated within OpenAI in recent weeks, and the pace of development alarmed some researchers focused on AI safety."

https://manifold.markets/ZviMowshowitz/is-the-reuters-story-about-openais

Purported Q* priors: https://twitter.com/mark_riedl/status/1727482512425820200 ie just https://www.microsoft.com/en-us/research/project/textworld/

Janus (of aidungeon fame) calling it: https://twitter.com/repligate/status/1676196989833289728

AID sort of ran RL multi-agent system at a scenario world scale.

Also, this https://i.imgur.com/EHvVKBz.png Timestamp detail (UTC): https://i.imgur.com/EqfnryB.png

(more context https://old.reddit.com/r/singularity/comments/181oe7i/openai_made_an_ai_breakthrough_before_altman/kadm3uh/)

OpenAI has a history of hyping the hell out of their discoveries. Remember GPT-2 that they didn't want to release because it was too powerful but turns out it was pretty bad and they released GPT3 anyway?

Isn’t it clear that AGI took over OpenAI and is now moving all the pieces for world domination.

Why are people falling for this blatant PR spin?

Man what happened to this sub? So many replies are whacky half-baked conspiracies.

For sure, Altman created AGI behind closed doors and a secret employee organization leaked it the board who then decided to orchestrate an elaborate fake firing of Altman to gain the attention of the world in what ultimately amounts to an epic 4D-chess marketing ploy to... Sell Q* subscriptions to the masses, who will be made irrelevant by it?

Okay.

In my opinion, some kind of AlphaZero to improve reasoning and agent performance for LLMs is kind of the obvious next step. If you throw enough engineering talent, ML research experience, and compute at the problem, I would expect an outcome that will be qualitatively different from standard Transformer-based LLMs.

"Search for superintelligence" sounds so romantic.

Like they're in the jungle looking in caves for any sign of AGI.

I am not saying AGI is impossible but the arguments that we are close to achieving it sounds more like wishful thinking.

A couple of questions/comments I have:

1. People assume that the development is exponential or at least linear but that is not necessarily true - it depends on what is possible to do with the resources we have and the limitations of the physical world we live in.
2. GPT-4 has the appearance of being intelligent rather than being intelligent. How will we be able to tell the difference? What will prevent us from being fooled in a similar way with future systems?
3. Isn’t there an issue with using benchmarks that has been around for a while to measure the performance of AI systems? Are we not, perhaps unconsciously, improving the scores on these tests rather than improving the system?
4. Without understanding our own intelligence (or lack of), how are we going to understand AI?
5. What is the goal with AI?

Maybe this has something to do with it:
https://arxiv.org/abs/2102.04518

Rumor mongering mill at full speed.

A* Search Without Expansions: Learning Heuristic Functions with Deep Q-Networks

Furthermore, Q* search is up to 129 times faster and generates up to 1288 times fewer nodes than A* search. Finally, although obtaining admissible heuristic functions from deep neural networks is an ongoing area of research, we prove that Q* search is guaranteed to find a shortest path given a heuristic function that neither overestimates the cost of a shortest path nor underestimates the transition cost.*

https://arxiv.org/abs/2102.04518