Thoughts on building AI content detection browser extension?

[mateovert]

Found a research on GitHub about analyzing AI articles content on the BBC. Researchers checked thousands of articles for patterns that indicate AI usage.

I thought that it might me a good idea to build kind of a browser extension to flags potential AI content as you browse. Like you don't upload conttent to detector, but you open a page and a detector checks it in real time, without sending data to external servers.

But I'm not sure, pattern matching be sufficient or do you need ML models running locally? And probably false positive rates would be awful, right?

Has anyone tried building or using something like this? Is this even worth prototyping or if the accuracy would be too unreliable

Here's the GitHub, I mentioned: https://github.com/isfakeai/bbc-ai-content-analysis

They also published a detailed report breaking down their methodology and findings.

[Jason Reed]

Interesting idea, but I agree the false positives would be a big challenge with pure pattern matching. You’d almost certainly need an ML model running locally for anything reasonably accurate, and even then results would be probabilistic. I think it’s worth prototyping as an experiment, but relying on it as a “detector” for users might be tricky.

[Dani]

I think that before something like this would be useful, what the world really needs is an accurate way of detecting AI-generated content that doesn't have an overwhelming amount of false positives or false negatives.

For now, I wouldn't really mind uploading to a content AI detector, as long as the detector was accurate.

If it was me, and I found some way of cracking accuracy, then I would create an API and charge a micropayment per request. I'd make a killing! I'd also create a browser tool based off of the API, and perhaps find a paying sponsor for it.

The first step is AI contect detection that actually works. Have that, and you can make bank. :)

[Salem]

My default position is to think most of media is either outright AI pulp fiction, or at the very least tainted with "suggestions".

[TomKwon]

For this local machines learning models can help but they are limited without access to large database

[rproffitt]

This just in. Turns out you can turn off a lot of the AI search results with:

https://www.google.com/search?q=%s&udm=14

You can research this further to see if it helps move you to your goals.

[TomKwon]

A real-time AI content detector browser extension is worth prototyping but may struggle with accuracy due to false positives and negatives. Pattern matching alone likely won't be enough and local machine learning models have limitations.

[mandyDC]

If I were building this, I’d probably think about the user side first, not just detection accuracy. Like, even if it’s “mostly right,” what happens when it flags legit content? That could annoy people fast. I’d maybe frame it more as a “confidence signal” instead of a hard yes/no.