Full transcript
0:00Welcome to the first of a series of
0:02videos that I'm going to do where we
0:04review different AI detectors out there
0:07to see which one is the best one out
0:09there or at least the most likely to
0:11flag your work if it was labeled with AI
0:15or if you are someone who uses these
0:17tools to help with you know, maybe
0:19you're a teacher or something like that
0:21to understand which one is going to be
0:22the best. And today we're reviewing
0:24originality.ai
0:26which is one of the first ones that I
0:28ever saw and it's the one that I've used
0:30in the past to kind of check my work to
0:31see
0:33is it accurately finding the areas of my
0:35work that I did use AI for or didn't
0:38that sort of thing. We've known for a
0:40long time that AI detectors tend to be
0:43notoriously unreliable.
0:45But I want to just put that to the test
0:47and see just how true that is. So I've
0:49put together a series of documents that
0:51I am going to test with a whole bunch of
0:53different
0:54detectors starting today with
0:56originality.ai.
0:58And if we look at this document I have
1:00here, I have a couple of different
1:01options. We have one that was pure AI
1:04written
1:05with in this case this is a fiction
1:07option. This was in this case written
1:09with Gemini 3.
1:12And then we have pure AI for non-fiction
1:14which is written with a Claude model and
1:17it's just a
1:18website that it's actually an article I
1:21generated so I know it's fully AI. I
1:24might have tweaked it just a little bit
1:26here but it's like 90% AI for sure. And
1:29then we have a chapter of my own work
1:31that has been heavily edited. It was
1:34written with a AI originally but it's
1:36been heavily edited not just by me but
1:38also by a line editor and literally
1:41there's hardly a sentence of this
1:42chapter that hasn't been tweaked by one
1:45of the two of us. And so it's heavily
1:48edited and so I wanted to see what that
1:50does. I would expect it to be somewhere
1:53in the middle like 50/50 chance of being
1:56AI or something like that is what I
1:58would expect.
1:59Then we have a couple of human written
2:01things that I have modern
2:04work of fiction from that's human
2:06written. This is again some of my own
2:08work. We have some non-fiction here that
2:11I took from Kindlepreneur and I know
2:14that this was human written because I
2:16wrote it when I was working at
2:17Kindlepreneur. So I know that they're
2:20not using AI for this and I also know D.
2:22Chessum like he wouldn't write these
2:24things with AI. So yeah, so this is some
2:27non-fiction human written.
2:29And then I just for kicks I put in a
2:32chapter from The Hound of the
2:34Baskervilles and Sherlock Holmes does it
2:36to see how it looked at older human
2:39written things.
2:40And just for kicks I also threw in some
2:42passages from the King James Bible to
2:45round it out and then I'm assembling all
2:48of the results for this in the
2:49spreadsheet so we can compare with other
2:50models as we go along. So first of all,
2:54let's look at originality.ai.
2:57If we go to their main page, you can see
3:00that they pride themselves as being the
3:02most accurate AI detector. They even
3:05claim to have been in third-party
3:08studies having been identified as the
3:10most accurate AI detector. That remains
3:12to be seen from our our own little study
3:15that we're going to do here. But if
3:17that's true that there are third-party
3:19studies that have identified it as the
3:21most accurate AI detector, then you
3:23know, that's a good thing for them. One
3:25of the things I really like about
3:26originality.ai is that they have a
3:28pay-as-you-go option. You don't have to
3:30pay the monthly or annual fee. You do
3:34get credits for a little bit cheaper if
3:37you are on a subscription but I would
3:39say unless you are one of those people
3:41that uses this sort of thing regularly
3:43like as part of your daily workflow, I
3:45would not do the annual or monthly
3:47plans.
3:48I would just go with the pay-as-you-go
3:50plan which for this is $30 a month,
3:523,000 credits
3:54which gives you essentially that's about
3:57300,000 words that it will check with
4:01those $30 at least for AI detection,
4:05right? And it gives you a bunch of other
4:06stuff that it goes through here that I
4:08won't get into at the moment. But this
4:10is probably what I recommend for most
4:11people who want to use this just to
4:13check things on occasion. I put $30 into
4:16this a while ago. I've actually used
4:18this tool in the past. I put it in a
4:20while ago and I'm still using those $30
4:23like months later. So definitely even
4:26though you do get more credits per
4:28dollar here on this pro plan, for most
4:31people that won't be necessary. All
4:33right, so all right, let's go into this
4:37software here and take a look.
4:39So I ran all of my checks all all of
4:43those different chapters through this
4:45thing and let's take a look at what they
4:47look like. The first
4:49So what you do is you just essentially
4:51copy your text into this. In fact, let's
4:54go ahead and go to a new scan. You name
4:56your scan here whatever you want and
4:58then you copy your paste copy and paste
5:00your text into here. Quick pause. If
5:03you're tired of the one-line magic
5:04prompts, I've got you. Join the Story
5:07Hacker AI waitlist at the link below and
5:09I'll send you my real prompt pack. The
5:11multi-hundred word prompts that I use
5:13for full books. Click the link, drop
5:15your email, get the pack.
5:17There's also an import button here if
5:19you want that. And then on the side here
5:21you can have a bunch of different things
5:23that it checks for. And this is one of
5:24my favorite things
5:25about originality.ai
5:27is that it's not just about the AI
5:29detection. They also have a plagiarizer
5:31which as a lot of people know can be
5:33actually really expensive if you go
5:36through other other avenues and so I
5:38actually find like this is pretty cool
5:40that they have this included as well. It
5:42does increase the number of credits
5:43you're using but it's a great way to do
5:45plagiarism scores if you need that. It
5:48also does content optimization so you
5:50would enter a keyword here. This is for
5:52if you're writing an article and you
5:53want it to rank for certain phrase then
5:56you could put the keyword here and it
5:58would help to optimize your content
6:00which is pretty cool. As someone who has
6:02an SEO background, that's a really cool
6:04feature right there. It also has a
6:05readability score which is also really
6:08handy for whether you're doing fiction
6:09or non-fiction. It has a grammar and
6:11spelling score and this one's pretty
6:13fun. It has a fact-checking score. Well,
6:15it will actually go through and do its
6:17best. It's not going to be perfect but
6:19it's going to do its best to actually go
6:20through and check the facts on certain
6:23things. So if you're writing with AI and
6:25you want to check for hallucinations,
6:27this could be a good way to go about
6:29that.
6:30And as a result, I think just based on
6:32the things that they're checking here, I
6:33think the primary audience for
6:35originality.ai is probably online
6:38writers who are writing SEO articles and
6:40things like that and want to make sure
6:42that their ghostwriters or that their
6:44actual writers are not being flagged as
6:47heavily AI, that it's optimized for the
6:50right keywords, that all of the facts
6:51are straight, all of that stuff, you
6:53know, very useful tools if you are an
6:55online writer. So I could definitely see
6:57this being a valuable tool if that's
7:00kind of the industry that you're in.
7:02But anyway, let's go back to the history
7:04here. Let's look at this one that was
7:05pure AI and funny enough it was only 64%
7:09confident that this one was
7:11AI even though this is 100% AI written.
7:14I did not edit this at all.
7:16It could be because this was written
7:18with Gemini 3 which is a slightly newer
7:20model so maybe they're still working out
7:22the kinks there and trying to get it
7:23trained to detect that model because I
7:27did others that utilized the Claude
7:29models and those were very much flagged
7:32as AI. And that's actually a good segue
7:35now into actually going through the
7:38results of each of these tests. So the
7:42pure AI fiction like I said got 64%
7:45likely AI
7:47where I expected 100% because it was
7:49100% written. The non-fiction was
7:52identified as 100% AI which is also what
7:56I expected. I do think non-fiction is
7:59easier to detect the AI with because
8:02it's more commonly available to train
8:04on. And then the this is interesting to
8:07me. The heavily edited AI fiction which
8:10I would have expected to be around 50%
8:12or less because it was really edited by
8:15myself and the editor was 100%.
8:19And I found that really intriguing. I
8:21would say this is an error on its part
8:23because literally quite a bit of it was
8:25human written just kind of based off of
8:28a draft. But then the funny thing is so
8:30the
8:31the first fiction that was human written
8:33did get a zero which is what I would
8:35have expected. But the human written
8:38non-fiction which is an article that I
8:40wrote so I know for sure it was human
8:42written.
8:43This was written before AI.
8:45That one came back as 99% likely AI
8:48which is really funny. And this is why I
8:49think it's actually really hard to do
8:51this. It's easier to detect AI patterns
8:55in non-fiction because it's so much more
8:57prevalent online and a lot of what it's
8:59trained on is online content. So it's
9:02going to sound more like that online
9:04content.
9:05And that's the interesting thing here is
9:08because it's done that so well, now it's
9:10actually flagging real human-made
9:12content that was written online as
9:16AI content. So that was really
9:18interesting to me that it flagged what
9:21was 100% human written as 99% AI.
9:24Interesting to me. And then the for the
9:27Sherlock Holmes it came back with
9:301% possibility of being AI which of
9:33course it wasn't so that's about right.
9:35And the Bible also came back as 0% AI
9:37which is also correct. My final notes on
9:40this particular tool is that I do like
9:42the pay-as-you-go structure. I also like
9:44the other ways to score a document like
9:46the plagiarism, content optimization,
9:47readability, grammar and spelling and
9:49fact-checking. And I think this is best
9:51for online writers who are optimizing
9:53articles. So those are my total thoughts
9:56on originality.ai. Let me know in the
9:58comments if there's another AI detector
10:01that you want me to cover and I will be
10:02sure to get to that in a future video.
10:05And in the meantime, I will see you in
10:06the next one.