LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

Down to memory lane, 2022 - "Google's LaMDA Ai is sentient, I swear" (alien.top)

submitted 10 months ago by FPham@alien.top to c/localllama@poweruser.forum

49 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Bernafterpostinggg@alien.top 1 points 10 months ago

This is the real point here. There are many papers that explore Sycophantic behavior in Language Models. Reward hacking is a troubling early behavior in AI and, god help us if they develop Situational Awareness.

The guy was just a QA tester, not some AI expert. But the fact that it fooled him enough to get him fired is wild. He anthropomorphized the thing with ease and never thought to evaluate his own assumptions about how he was promoting it with the intention of having it act human in return.