this post was submitted on 22 Dec 2024
521 points (95.9% liked)
Technology
60112 readers
2407 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm not entirely sure.
A non-probabilistic algorithm, probably. Something that didn't rely on the liklihood of association, and instead was capable of context and rationality.
Something that wouldn't have a system capable of saying "Put glue on your pizza" because it would know that's a silly thing to say to a human. A system that, when asked "Whats a good caustic detergent " wouldn't be able to respond "Any good caustic detergent is a good caustic detergent " because duh. Something that doesn't require thousands of hours of training to update and instead is capable of ingesting and rationalize new information on the fly.
You're probablistic, you just have an internal verifier, you think things that are silly, and then decide not to say them all the time. A human being often thinks things that they realize are silly before they say them... that's an entirely unfair goal in the first place from my perspective, why does it have to be non-probablistic?
Are you not a general intelligence because sometimes your brain thinks silly things?
o3 currently works precisely that way, by the way, it generates hundreds of possible things, and then uses something that checks if the steps actually work, before it outputs. In fact, they then reinforce it on these correct logical steps, so it becomes better at not outputting illogical answers like you said.
it's interesting that you said "not on the probability of the next word, but on context and rationality"
context IS pricesely that, you know what's likely to come next because of the context, that's you understanding context. YOU as a human being don't even always get this right, you must realize we are not perfect beings, we think of possibilities and choose the right one. I think we're much better at this right now, but i don't think that's a fundamental difference between us and o3.
Rationality is the internal verifier.
Being able to do this is... exactly what arc-agi was testing. Literally the entire point of the benchmark, it can do that.
I've done the test by the way, I solved it by brute forcing possible solutions in my head, then checking if they were true... did you just divine the answers instantly?