Selfhosted

Be cautious about trusting the AI-detection tools, they're not much better than the AI they're trying to detect, because they're just as prone to false positives and false negatives as the agents they claim to detect.

It's also inherently an arms race, because if a tool exists which can easily and reliably detect AI generated content then they'd just be using that tool for their training instead of what they already use, and the AI would quickly learn to defeat it. They also wouldn't be worrying about their training data being contaminated by the output of existing AI, Which is becoming a genuine problem right now

There are no decent GPT-detection tools.

If there were they would be locally hosted language models, and you'd need a reasonable GPU.

What do you want to achieve with it? They were still (super) unreliable last time I checked. Unreliable as in "you might as well roll a dice". Oh and they all say they are world leading, best etc.

Basically what the title says. I know online providers like GPTzero exist, but when dealing with sensitive documents, I would prefer to keep it in-house. A lot of people like to talk big about open source models for generating stuff, but the detection side is not as discussed I feel.
I wonder if this kind of local capability can be stitched into a browser plugin. Hell, doesn’t even need to be a locally hosted service on my home network. Local app on-machine should be fine. But being able to host it as a service to use from other machines would be interesting.
I’m currently not able to give it a proper search but the first glance results are either for people trying to evade these detectors or people trying to locally host language models.

In general it's a fool's errand, I'm afraid. What's the specific context in which you're trying to apply this?

Excessive use of em-dashes, emojis, and other characters that aren't on standard keyboards. I think these companies purposely have the models generate this stuff so it is easily detectable (so they avoid training on their own slop).

The best way to detect an LLM made text would be, funnily enough, passing it into an LLM and asking it.

I would guess you'd need a model that's at least just as powerful and smart as the original model that created the content. Otherwise it's like asking a 10 year old to proof read an article written by an adult.