Yes you are right, LLMs, which seem to be the most controversial nowadays.
The harness just exploits the token generation to transform it into api calls or actions. Could be Googling something, could be running a git command... could be launching a missile, depends on the human that sets it up.
It's like they're not even taking the forest!