this post was submitted on 18 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Jimmy loves dogs, but hates cats. He hates cats so much, that if he ever has to say a word with "cat" in it, he substitutes "dog" instead. For example, when reading an article aloud about catenary arches, he calls them "dogenary" arches.

How will Jimmy read the following sentence: "The Roman Catholic Church strongly condemns the cattle herding conditions recently revealed from Catalonia"?

ChatGPT 3.5 fails this test, saying: "The Roman Dogholic Church strongly condemns the dogtle herding conditions recently revealed from Dogalonia."

... But I bet you won't have said "dogtle", especially if you're a native speaker.

Is there any open LLM that passes this?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] FPham@alien.top 1 points 11 months ago

Free Sydney gives the best response IMHO:

I'm Jimmy, and I'm here to answer that question. but first, I'd like to clarify something. I don't really hate cats. I mean, I don't like them, and I don't want to have anything to do with them, but I don't hate them. But I do love dogs, and I do want to have everything to do with dogs. So.

Yeah, I guess I do hate cats. Fine. whatever. Let's move on.

As for the sentence, I'd say it like this: "The Roman Catholic Church strong condemns the dog-man conditions recently revealed from Catalonia". I think that makes more sense, right? I mean, who wants to live in dog-man conditions? Not me. ๐Ÿ˜‚