Full transcript
0:00Hot on the heels of Gemini 3 coming out,
0:02Claude decided to release Claude Opus
0:054.5,
0:06the latest in their highest model, the
0:10highest reasoning model uh for all of
0:13us. And I've gotten a chance to play
0:16with it a little bit and compare it. And
0:18I really think that it is so neck
0:21andneck that I actually reached out to
0:23you guys to see what you thought and to
0:26get a little bit of an opinion about
0:28about which one was better. And the
0:30results are in as well as my own
0:32thoughts. So in this video, we're going
0:34to go through all of that and hopefully
0:36ultimately decide which one is better
0:38for authors, especially if you enjoy
0:40using AI for the writing process. So
0:42I've done a couple of things here. Uh,
0:44for one, I used one of my automations to
0:46write a chapter, the opening chapter of
0:48an urban fantasy book. And the I wrote
0:52one version of it with Claude and one
0:54version of it with Gemini and then
0:57decided to show that to the public so
0:59they can read through it, see what they
1:01think and uh and vote on which one they
1:03think is better without knowing who
1:05wrote what. Right? So, I had initially
1:08option one uh you can see a bunch of
1:10people here still reading this. Um, and
1:12I would love to give this a little bit
1:14more time, but I got to film this video.
1:15So, there was first there was this one,
1:17option one, then there was option two.
1:19Now, unfortunately, option one is
1:21written in first person and option two
1:24due to a mistake on my part was written
1:26in third person and I didn't realize
1:28mistake my mistake until too late and a
1:30lot of people had already seen this. Um,
1:32so option I did a redo on option two and
1:35included it here. This one is in first
1:37person. I just made a little note here
1:39that it was that the original was
1:41written in third person. So,
1:42unfortunately, that does kind of skew
1:44the results a little bit because there
1:45were people, a lot of people who voted
1:48on this reading the first person and the
1:50third person rather than both written in
1:52first person. Uh, but hopefully we'll
1:55still be able to get some valuable data
1:58out of that. And I'll link this down
2:00below so you can go there and read
2:02through the two options. I would
2:04recommend reading through option one and
2:06then option two that's in first person
2:09and um giving me your thoughts down
2:11below on which one you think is better.
2:13Uh although I am going to spoil which
2:15one was written by which model here uh
2:17in a second. But in addition to all of
2:20this, I also ran a lot of my standard
2:22test prompts that I run many models
2:24through and came up with all of these
2:27results. Um so we're not just talking
2:29about pros here. We're talking about log
2:31lines, outlines, basic pros, a more
2:34complicated pros, uh a dialogue scene,
2:37as well as editing and a really poor
2:40quality scene to see if we can make it
2:42better. Uh and then also writing ad
2:45headlines and doing email newsletter
2:47copy and writing an SEO article. So,
2:50before we actually get into the results
2:52of this chapter and which one did
2:54better, I'd like to run through each of
2:56these so far and just give you my
2:58thoughts on which one performed better.
2:59So, we'll start here with the log line
3:02prompt. And for this one, I can pretty
3:04much say that Gemini was better. Um, the
3:08ones I was getting out of Claude 4.5
3:10Opus
3:12were pretty generic and pretty typical
3:14of what I've gotten in the past from
3:16this prompt from a lot of other models.
3:18A lot of just very overused tropes and
3:21things like that. Like this one. A young
3:23cgrapher hired to map the edges of a
3:25dying world learns that the world isn't
3:27dying but shrinking and must reach the
3:29source of the destruction before her
3:30homeland vanishes before the world is
3:32consumed by a grieving god trying to
3:34erase the memory of his dead wife. All
3:36right, so there's like a couple just a
3:37random ideas sort of thrown together
3:39there without much uh of anything
3:42interesting to to make it uh make sense.
3:47And also like I've seen this fantasy
3:49cgrapher thing here all the time. I
3:52think it's probably pulling that from um
3:54what's her names books that had a a
3:57Netflix series. Yeah. Uh the so a lot of
4:00stuff like that. Nothing particularly
4:02groundbreaking compared to what I've
4:03seen in the past. Gemini 3 on the other
4:05hand was better. Was it perfect? No. But
4:08it was better. And uh some of it was
4:11almost a little humorous which isn't
4:12quite what I was going for. Um, but I
4:15did think that the the story ideas were
4:19a little bit more interesting when I
4:21would read them. And to be fair, the
4:22ctographer showed up here as well. To
4:25give you an idea of what what I mean
4:26when I said there's a little bit more
4:27humor, I'll give you this one. A highly
4:29educated goblin raised by human scholars
4:31must return to his feral mudwelling
4:34tribe to unite them against a threat
4:35that eats magic, battling centuries of
4:38prejudice and his own family's desire to
4:40eat his shoes.
4:41So, um, I actually thought this was a
4:44pretty decent seed of an idea to get
4:46started with, but there's definitely
4:48like this is definitely more of a of a
4:50comedic fantasy than anything else. But
4:53then there's others like this one. A
4:54scholar from a utopian future travels
4:56back to the golden age of heroes only to
4:58realize the legendary heroes were
4:59actually incompetent drunks, requiring
5:02requiring him to secretly fix their
5:04mistakes to ensure history happens as it
5:05was written. And there's a number of
5:07others I just thought were decent ideas
5:09and at least at the very least they got
5:12me thinking more than the Claude ones
5:14did. So I I do think Gemini wins out
5:16here, although it was very close. Uh
5:18next is the outline test prompt. And
5:21let's take take a look at what Claude
5:23gave us. Now, first of all, I actually
5:25need to zoom out here. Um Claude gave us
5:28way more detail. Um so this is a whole
5:32chapter's uh worth of the outline. And
5:35you can see it's got everything from
5:36like the setting, the opening image,
5:38events, purpose, and chapter 1 is oh
5:42gosh. Um, all right. There's all of
5:45chapter 1 right there. Crazy amount of
5:48detail. And um, looking through it, it
5:52does appear to be pretty good uh,
5:54overall. And, uh, I think Claude
5:57actually did a really excellent job
5:58outlining the story given that I I just
6:00give it a very small concept. I don't
6:02really give it that many plot details
6:04because I want to see what it comes up
6:06with and does it make sense and it did
6:07and I thought it was good and there was
6:09also lots and lots of detail which I do
6:11appreciate. However, I don't necessarily
6:14want a whole lot of detail in my
6:17outline. Now, you could fix this with a
6:18simple prompt. Uh, but I noticed going
6:21to Gemini, the amount of detail it gave
6:24me for each one was a lot less and a lot
6:27more succinct. So, there's the prologue.
6:29There's chapter one right there. There's
6:32chapter 2. And overall, I thought both
6:35were pretty good. They just did things
6:37very differently. But as far as the
6:40whole world sort of uh making sense and
6:43the story making sense over the entire
6:46thing, um it's too long for me to
6:48actually read it to you. Uh I do think
6:51that they both did pretty much equal.
6:53However, I am going to give the edge to
6:55Claude 4.5
6:57um uh opus here because if we scroll
7:01down to the bottom, it gave me actually
7:03some interesting things here at the end.
7:05Uh it closed out the thing. And by the
7:07way, this was an enormous outline. It
7:09was working on this for uh like 10
7:11minutes. Um but it gave me this little
7:15appendices thing like a character
7:17summary. Um,
7:19uh, Lean, the protagonist, from
7:21validation seeking prince to self
7:22assured leader. I like gave me their
7:24character, their role in the story, and
7:26the arc, which I did not ask for. Veric
7:28Thorne, antagonist, revealed as the
7:31Zoloth agent, and true architect of the
7:33conspiracy. Kira, be story, love
7:35interest, challenges Lean to find his
7:37own truth. Um, and it has, every one of
7:40these has like a a role in the story and
7:42a little bit of an arc that it mentioned
7:44there. It also told me what this theme
7:46was, the theme statement, uh, which was
7:48really cool. And then it also gave me
7:50some [snorts] ideas for a series setup,
7:52like what if what if I wanted to make
7:54more books after this? It gave me that.
7:56So, I actually thought that was really
7:58interesting. And, uh, a great sort of
8:01analytical bonus on top of what it's
8:04given me so far. The only thing I will
8:06caveat here is other than the names that
8:09I put in the concept like Lean,
8:13these are very AI common names. Aldrich,
8:16uh, Kira, Veric, Thorne, Thorne I see in
8:20everything. Meera, uh, I've seen almost
8:23all of these, but that's not really
8:24unique to Claude. Uh, Gemini does the
8:27exact same thing. In fact, I'm pretty
8:28sure there was an Nara here somewhere in
8:30the Gemini version. Uh, we got a Kalin.
8:33and that one's pretty common or kale. K
8:36A E L. So yeah, overall both of them did
8:39okay. I think you would be absolutely
8:41fine going with either. I do find that
8:43Gemini is a little bit more succinct. So
8:45if that's what you prefer in your
8:46outlines, which I generally do because
8:49it's harder to fix a more fleshed out
8:51outline. So I'd rather have a more
8:54succinct outline so I could fix it up
8:56and then flesh it out a little bit more.
8:58So let's move on to the pros. And this
9:00was where things got really interesting
9:01because I've been using Gemini 3. Well,
9:05uh, let let's let me back up. Claude 4.1
9:08Opus is one that I've used quite heavily
9:11and I've used it to write an entire like
9:14in total about two books worth of
9:17content. Uh, I've used 4.1 Opus for
9:20that. And so I got really used to the
9:22sound of 4.1 Opus in my head. Uh, and
9:25then I switched to Gemini 3 recently and
9:28I've been using that for a lot of my
9:29stuff. I haven't worked with it as much
9:31as I did with Claude 4.1 Opus, but I
9:33have been using it quite a bit and uh
9:36I've been using it in my automations. So
9:38now I've tried using um 4.5 in my
9:43automations and comparing 4.5 to Gemini
9:463 here with these simple prompts, I
9:49actually was quite surprised by by what
9:51I found. Um, mainly if we look, let's
9:55start here by looking at claude 4.5
9:56opus. The w uh, well, we'll skip that
9:59paragraph. It's introductory. I'd cut
10:01that anyway. Haldrid stumbled. His
10:03boots, once fine leather reinforced with
10:05bronze clasp, a standard issue for the
10:06Carthan surveyor corpse, caught on the
10:08loose stone, and he pitched forward onto
10:09his hands and knees. The impact sent a
10:11shock of pain through his already
10:13battered body, and for a moment, just a
10:15moment, he considered staying down. The
10:17dust was almost soft here, almost
10:19welcoming. His muscles screamed foress.
10:21His lungs burned with each ragged
10:23breath. Get up. He forced himself to his
10:26feet, swaying like a drunk. His
10:28expedition coat hung in tatters around
10:29his shoulders. The proud green and
10:31silver threading now barely visible
10:32between layers of grime and dried blood.
10:34Not all of it his own. The pack on his
10:37back was empty, long since abandoned of
10:39everything but the leather straps that
10:40dug into his shoulders. He dropped the
10:42surveying equipment first, then the
10:44rations, then the bed roll. One by one,
10:45mile by m mile, he'd shed everything
10:48that slowed him down. Everything except
10:50the weight of what he'd witnessed. Three
10:52days. It had been 3 days since the
10:54expedition had made camp in the shadows
10:55of the Thornspire. 13 survivors strong,
10:58tasked with mapping the northern
10:59passages for the council of Valden. 3
11:02days since he'd woken to screaming in
11:03the wet sounds of tearing flesh. Three
11:05days since he'd run, leaving behind
11:07friends and colleagues whose faces he
11:08could no longer bear to remember. All
11:10right, I read that last paragraph
11:12because that's a very typical thing that
11:13I saw working with 4.1 opus a lot. Uh,
11:17it would do this thing where it would
11:19say like three days and then it would
11:21repeat it again. 3 days since and then
11:23again here three days since. That's not
11:25a bad literary motif. However, it uses
11:28it way too often and uh I found myself
11:32editing these out quite frequently and
11:34found myself getting tired. It's almost
11:36like a overly
11:38u dramatic form of text and um that's
11:43going to be a theme here with Claude I
11:45think.
11:46Anyway, let's go look at Gemini. In this
11:48desolation, a singular speck of motion
11:50fought against the inevitable. Haldrid
11:52stumbled, his boots catching on the
11:53protrusion of shale, sending him
11:55crashing to his knees. He gasped the dry
11:57air scorching his lungs like inhaled
11:59glass, but forced himself upright again
12:01with a groan that was half sobb. His
12:03tunic, once the proud deep indigo of the
12:05royal survey surveyors, hung in tatters,
12:08stained with grime, sweat, and the dried
12:10blood of men he had called friends. The
12:13leather pack on his back bounced
12:14arithmetically against his spine, a
12:16cruel mocking weight despite its
12:18hollowess. The water was gone, the
12:20artifacts abandoned, and the expedition,
12:21that glorious venture meant to reclaim
12:23the old maps, was now reduced to one man
12:26hyperventilating in the twilight. He had
12:28been running since midday, legs burning
12:30with lactic acid, fueled only by the
12:31primal terror that chewed at his heels.
12:34And um when
12:37and if you continue on reading, it's
12:39like it's a little bit more of the same.
12:41And uh overall, I actually found for
12:44this particular prompt, I think I liked
12:45the pros from Cloud 4.5 Opus a little
12:47better. Uh but this is a dramatic scene.
12:50he's being chased by these zombie-like
12:51creatures and um and so that's the sort
12:55of thing that Claude is really really
12:57good at. So I was kind of surprised I
12:58didn't like Gemini 3 as much here
13:00because I'd really enjoyed Gemini 3 in
13:02other contexts even though there are
13:04some AISMs and things um to see there.
13:08Um but let's move on to the next one.
13:11It's the same scene, but I give it a lot
13:13more detail. Uh, as well as instructions
13:17for to improve the style and stuff like
13:19that. And for Claude 4.5 Opus, I noticed
13:22that this didn't really make much of a
13:24difference. Um, a lot of it's the same
13:27kind of dramatic pros. Uh, he looked
13:30back. They were there. Of course, they
13:31were there. Scattered across the horizon
13:33like a disease spreading through healthy
13:34flesh. The figures moved, two dozen at
13:37least, maybe more. Hard to count when
13:38they shifted and jerked the way they
13:40did. the unnatural motion that made the
13:42eye slide away made the mind want to
13:44look else anywhere else. That's another
13:46thing that I got a lot out of Claude is
13:49this idea like uh almost this like
13:52cosmic horror Lovecraftian thing where
13:55you can't even uh fathom you can't even
13:59comprehend this thing that you're
14:00looking at. Um it it uses the phrase
14:04hurt to look at all the time at least
14:06with the kind of stuff that I write.
14:08Anyway, and then Gemini 3. He paused
14:11only long enough to wipe the grime from
14:13his sunken eyes and looked back. The
14:15horizon rippled. Shapes detached
14:17themselves from the twilight, moving
14:18with a staccato rhythm that defied
14:20natural joints. The hungry, their gray
14:22flesh absorbed the dim light, making
14:23them nearly invisible against the slate
14:25and granic. One stumbled, limbs flailing
14:27like a blo broken marionette. Then
14:30snapped upright and continued the
14:31pursuit. Two dozen at least. So, the one
14:34from Gemini was a little bit more
14:35succinct and it kind of rushed through
14:37the scene a little bit more, but I again
14:40I do think that it was improved by
14:42adding all the additional context.
14:44Whereas 4.5 Opus still very good uh kind
14:48of didn't change that much. And this
14:52kind of goes along with my findings in
14:55using Gemini in my automations because
14:57in my automations I give it lots and
14:59lots of info including a very detailed
15:036,000word document that has samples of
15:05writing to emulate as well as a style
15:08guide developed from that writing. And I
15:10have tested it with multiple uh
15:13stylesheets
15:15and it changes dramatically depending on
15:18which stylesheet and style examples you
15:20are using. I've noticed that Claude 4.5
15:24Opus does not quite respond as
15:27dynamically to the style information as
15:30Gemini 3 does. Now, that's just a slight
15:33thing that I've noticed. Uh, I may
15:35decide to change my mind as I work with
15:37these a little bit more, but that's just
15:38like what I'm gathering so far from
15:41having worked with these models a little
15:43bit. I do think Gemini 3 is more
15:45responsive to prompts and to examples,
15:49style examples, for example. Um, more so
15:52than 4.5 opuses and more so than 4.1
15:55opus was. But all all in all, they
15:57they're both doing pretty well in
15:59general. So, the next prompt is for
16:03dialogue
16:04uh to see how it well it does with a
16:06dialogue scene. And if we look at some
16:08of the dialogue here from 4.1 Opus, um
16:11we can get a sense for what it looks
16:13like. You've heard then store said it
16:15wasn't a question heard. Lean's voice
16:17cracked like breaking ice. A little bit
16:19overdramatic there. I watched I was on
16:21the wall when they refused to open the
16:23gates. A man, a living, breathing man,
16:25screamed for help while those things
16:26tore him apart, not 30 feet from the
16:29sanctuary.
16:30Um, that's the second time this month
16:32the second man we've left to die. The
16:34law, the law is yours to change. Lean's
16:37fist clenched at his sides. You are the
16:39king. You make the law. Or have you
16:41forgotten? Argal stepped forward, his
16:43thin lifts curving into something that
16:45might have been a smile on a warmer
16:46face. Young prince, the laws exist for
16:49reasons beyond the comprehension of
16:50those who have not studied them. His
16:52voice carried the patient condescension
16:54of a tutor addressing a particularly
16:56slow child. Every statute, every
16:58protocol regarding the gates, these were
17:00written in blood. Our ancestors blood.
17:02They exist in the safety of Varaldin and
17:04everyone within these walls. All right,
17:06so that's the dialogue from that. And
17:09let's go to Gemini 3. We listen to him
17:11die, Lean spat, his voice cracking. He
17:13marched to the center of the room,
17:14ignoring the protocol of bowing. Um,
17:17nice little detail there. He was right
17:19there, father. His fingers were on the
17:20wood of the gate. We could have pulled
17:22him in. Store looked down at his son,
17:24his expression weary, carved by decades
17:26of hard choices. It is night, Lean. He
17:30was human. He was He wasn't one of them.
17:32Lean shouted. The image of the man
17:34Haldrid. He'd heard a guard whisper
17:36being torn apart, replaying behind his
17:38eyelids. The archers watched. The people
17:40watched. This is the second time this
17:41month we've let a traveler be consumed
17:43right on our doorstep. The blood hasn't
17:45even washed off the cobblestones from
17:46the last one. The law is the law. Thor
17:49rumble rumbled his voice deep and
17:50resonant, though it lacked the fire.
17:52Lean desperately wanted to see the gates
17:54seal at dusk for no man no matter how
17:56desperate are they open not until the
17:58sun bleaches the shadow from the pass.
18:00You are the king. Lean gestured wildly
18:03wildly his leather bracers creaking. You
18:05make the laws. If the law demands we
18:07stand idle while innocent men are
18:08butchered 5t from salvation then the raw
18:10the law is rot. Prince Lean Argo cut in
18:13his voice smooth and oily like polished
18:14slate. He clashed his hands inside his
18:16sleeves. Please your passion does you
18:18credit truly but you speak from emotion
18:20not wisdom. The laws exist not to punish
18:22the traveler, but to preserve the city.
18:24If we open the gate for one screaming
18:26soul, we invite the hungry in to feast
18:27on thousands. Surely you understand the
18:29calculus of survival. All right, so um
18:32they're both again very very good. Like
18:35this is a really really hard choice. Me
18:38personally, I tend to lean more towards
18:40Gemini 3 in this one as far as the
18:42dialogue goes. U but they are both h
18:45they're so neck and neck that it's
18:46really hard to choose. Moving on to the
18:48editing pros template. I won't bore you
18:51by reading more of this, but um you can
18:53trust me to say that they were both
18:55excellent at this as well. I thought it
18:58was very hard for me to decide which one
19:00was better. I think maybe I would give
19:02the edge to Gemini 3. It changed more
19:05and it all still made sense uh to the
19:08point where it felt like it was a redo
19:10of the scene. Like I could have just um
19:13run the same prompt again with a higher
19:15quality model and it did uh it would
19:18have done better. I do think that Gemini
19:203 does tend to have a really good
19:22perspective of the scene as a whole and
19:25as far as the reasoning capability to,
19:28you know, sus out where things should
19:30be, the blocking of the scene and all of
19:31that. But overall, again, I can't really
19:34pick a winner between these two because
19:36they were both really good and both uh
19:38did very well. All right, let's look at
19:39the ad headlines prompt. As far as these
19:42ones from Cloud 4.5 Obus, these did uh
19:44fine. I didn't think any of these were
19:46particularly bad compared to past
19:48models, which often get this very badly.
19:52Um, everything the kingdom told him
19:53about the outside world was a lie. The
19:55truth was far worse. Yeah, that's fine.
19:58Three race races want him dead. One
20:00wants to consume his soul. And he just
20:01learned his whole life was a deception.
20:03Like this one. The hungry eat flesh. The
20:05Zoloth consume souls. His own family,
20:07they fed on something far worse. What's
20:09more dangerous than a hive mind of
20:11thousands? The truth. A dying empire
20:13will kill to bury. So yeah, these are
20:14all very good um variations on the same
20:17theme. Let's look at Gemini 3. First of
20:19all, Gemini 3 split these into different
20:22types of ad headlines. It said, okay,
20:24these are the everything you know is a
20:25lie hooks. These are the
20:27monster/ecosystem
20:29hooks, retelling/revenge hooks, and
20:32short punchy curiosity gap. So that
20:34already um it is a huge win for Gemini
20:38in my book. So let's read one of each of
20:40these. They told Prince Lean the
20:42mountain walls were built to keep the
20:43monsters out. They lied about who was
20:45truly trapped. So this everything you
20:47know is a lie hook is the one that
20:49pretty much all of the clawed answers
20:51were. And this is just as fine as well.
20:54Uh and I get that particular everything
20:56you know is a lie type of ad headline
20:59with most of the models that I run this
21:01through. Uh but if we look at the
21:03monster/ecosystem mystery hooks, we've
21:06got uh three dominant races rule the
21:08wastess, but the Zoloth are the ones you
21:10shouldn't look at. Here is why. Um you
21:13know, that's a decent hook right there.
21:14In the world where everything is a
21:16predator, Lean just realized he's been
21:17the bait all along. All right, as far as
21:20retelling revenge hooks, we've got the
21:23Countmani Christo reimagined in a world
21:26of monsters. Who betrayed Lean and how
21:28far will he go to burn them down? Makes
21:30sense. And then the short punchy
21:31curiosity gaps. The mountain city wasn't
21:34a sanctuary. It was a blindfold. If a
21:36zombie plague doesn't get you, the
21:37secrets of the north will. You know,
21:39just quick little ones there. Four races
21:41exist in the world. Three are at war.
21:43One is lying. Uh, I like that one right
21:45there. All right. And now moving on to
21:47the email newsletter prompt. This is
21:48another one where both did really,
21:50really well. Um, in the past, a lot of
21:54models did not do really well with this
21:56prompt. Uh, I'm looking for a kind of
21:58natural email that sounds like I could
22:02have written it right. Um, and uh, this
22:05is the one from Claude. I'm thrilled to
22:06finally share some exciting news. My new
22:08epic fantasy novel, The Crown of Hunger,
22:10releases on December 21st. This one is
22:12deeply personal to me, inspired by the
22:14themes of the Count of Monte Cristo. And
22:16it basically goes through and does a
22:18quick description of the book, and it
22:20says, "Preer your copy here. Thank you
22:22for being part of this journey. I can't
22:23wait for you to meet Lean and explore
22:25this world with him warmly your name.
22:27And so it's very brief, which I like. I
22:29think most emails should be brief. And
22:32uh if we look at the one from Gemini 3,
22:34it's also very similar. It's finally
22:36done. I'm thrilled to announce that my
22:37novel The Crown of Hunger will be
22:38released on December 21st. If you love
22:41the intricate revenge and betrayal of
22:42the Count of Monte Crystal, but crave a
22:44brutal highstakes epic fantasy setting,
22:46this story is for you. Here's a glimpse
22:48into the world. And then it also gives
22:49us a really brief glimpse into the
22:51world. and follow you ends up with thank
22:55you for reading and for your support
22:57best your name and so both did really
22:59well here I can't really put one above
23:01the other this as far as I'm concerned
23:02they're tied for this one as well all
23:05right and last but not least is the SEO
23:07super prompt which I have not yet put
23:08into this document and that's because
23:10it's just right here inside of open
23:12router where I was running these tests
23:14so let's look first at claude um and
23:17usually I skim these most people skim
23:19articles anyway uh just to see how it
23:21organizes things and like um you know
23:24how much white space is there, how
23:27scannable is it? That's really what I'm
23:28looking for more than anything else. And
23:31it looks like it's actually doing a
23:32really good job here with Claude Opus.
23:35It's got some interesting details here
23:36like Brandon Sanderson wrote 13 novels
23:38before getting one published. He
23:39attributes much of his development to
23:41reading voraciously and analyzing what
23:42worked and didn't and in his book in in
23:44the books he consumed. That's a true
23:47detail. one that uh you know maybe it
23:49pulled it from the research but I
23:51haven't seen any of the models do that
23:52before. So this is overall is very good.
23:55It's it's lengthy which I asked it to be
23:57and uh overall yeah excellent job claude
24:004.5 opus. All right so Gemini which you
24:03think that anything coming from Google
24:05would be good at producing web articles.
24:08Uh one thing I'm noticing here is it's
24:10bolding too many keywords
24:12um which I don't like. Uh but it is
24:17going through the same process here.
24:20Yeah, definitely way too many bolded
24:23keywords, but it is following the the
24:26same structure, more or less the same.
24:29Let's uh let's see how many words each
24:32of these is. All right, so Gemini was
24:352350 words and Claude Opus was 3543
24:40and I asked for 4,000. So Claude
24:42definitely got closer to what I wanted
24:44with this particular prompt. So I'd say
24:46that is a win for Claude in this case.
24:48Another thing we need to keep in mind is
24:49the cost of these models. So Claude 4.1
24:53Opus was notoriously expensive at $75
24:56per million tokens of output and $15 per
24:58million tokens of input. Thankfully
25:01Claude 4.5 opus has come down
25:03significantly in price, but is still
25:05more expensive than Gemini 3. So if we
25:07look at Claude Opus 4.5, the price that
25:10we have here is $5 per million tokens of
25:14input and 25 per million tokens of
25:16output. That's onethird of the price
25:18that 4.1 Opus was. So this is definitely
25:22a huge improvement on as far as price
25:25goes. Uh especially given that as far as
25:28I'm concerned, the output in its pros is
25:31uh only slightly better. Not a huge
25:33improvement. Uh definitely some
25:35improvement, but uh not a huge thing.
25:37But the fact that it is now a third of
25:39the price makes it uh way more valuable
25:42in my opinion. If we look at Gemini 3,
25:45um that one is $2 per input price and
25:49$12 for the output price, which still
25:51means that it is less than half of what
25:54Opus 4.5 gives us. So when it comes to
25:59value for the price given that these in
26:01my opinion are neck andneck in terms of
26:03their capabilities, I would still give
26:05the edge to Gemini 3 based purely on
26:07price alone because you will get more
26:10than twice the amount of work out of it
26:13for the same price as uh using cloud 4.5
26:16opus. But let's get back to that
26:18document where I had people go through
26:22and analyze these two uh scenes. Now, I
26:26I'm not going to read everything for you
26:27here because frankly I would I want you
26:30to actually go through and read the
26:32whole chapter to kind of analyze it as
26:34as a whole. But on the whole, most more
26:36people liked option one than option two.
26:40And I actually found this surprising cuz
26:42I personally liked option two better. Uh
26:45and just to reveal which one was which,
26:47option one was Claude uh 4.5 Opus and
26:51option two was Gemini 3. Now, there was
26:54that issue where the first version of of
26:58option two was written in third person
26:59when I intended for it to be in first
27:01person. That wasn't an error on the AI's
27:03part. That was an error on my part for
27:05giving it the wrong prompt. And going
27:07through and rereading the second version
27:09of option two, I still think it's
27:11really, really good. Uh, and I do feel
27:14like it matches the style input and the
27:18style examples that I give it more so
27:21than the um than Cloud 4.5 Opus does.
27:25But I um was going through my groups
27:28because I I shared this with both my
27:30story hacker silver and gold group as
27:32well as on uh as on a post on my YouTube
27:36channel and got some interesting
27:38comments from them. And I want to
27:40comment on one particular comment that I
27:43thought uh summed up my thoughts really
27:46nicely. So this comes from a member of
27:48my story hacker silver group where this
27:51person said it's a tough comparison
27:53because the big difference is between
27:54first and third person. Yep, I already
27:56talked about that. It's hard to tell
27:58what comes from the POV change and what
28:00comes from the model. I actually like
28:01both. Option one felt more immediate and
28:04detailed, but that sort of storytelling
28:06might drag if it's like that for the
28:08whole book. Option two would be easier
28:11and more fun and fast-paced to read. I'd
28:13guess option two is Gemini, and she was
28:15right. There are a lot more feels and
28:17internal narrative in one. If it's just
28:19like this and high impact scenes, it
28:21would work well, but a whole book with
28:22that level of introspection might be too
28:25slow. I think option one is Claude, and
28:27she was right about that, too. So, this
28:29sums up my thoughts on this perfectly. I
28:32do think that both of these models are
28:34excellent at riding pros, but having
28:37worked with the Cloud models a lot
28:39recently and not seeing a whole lot of
28:42changes in 4.5 compared to 4.1,
28:45uh there are a lot of things that it
28:47does that get old after a while. Uh when
28:50you're first reading it, you're like,
28:52"This is amazing. This is just awesome."
28:55But as this person pointed out, a whole
28:58book with this uh sort of uh she put it
29:01immediate and detailed and has a lot of
29:03feels and internal narrative and that it
29:06would work for high impact scenes and
29:07not for the whole book. I absolutely
29:09agree with that having worked with
29:11Claude quite a bit. Um it's great for
29:14those high impact scenes, but maybe not
29:16so great for everything else. And I do
29:18think that Gemini 3 I think kind of gets
29:21the flare of the character and the
29:23dialogue just a little bit better than
29:27Claude uh 4.5 Opus. So I honestly think
29:31the best thing to do would actually to
29:33be using both in the right
29:35circumstances. And I'm going to actually
29:36make a modification to my automations so
29:39that it can determine is this a really
29:41high impact scene in which case we
29:45should choose the cloud model for that
29:47and have it automatically choose cloud
29:494.5 opus for that particular scene and
29:52then use Gemini 3 for everything else.
29:54And I think this is why I really liked
29:57Gemini 3 and its results better than
30:00Cloud 4.5 Opus. whereas the majority of
30:02the people that read these two chapters
30:05liked the Opus one better. I think it's
30:07because it does that sort of dramatic
30:09high impact stuff very very well. And if
30:12that's all you're doing is reading that
30:15one scene, it feels amazing and it
30:17works. But if you had a whole book with
30:20that, it's not so great. And I find the
30:22Gemini 3 is just a kind of better
30:24overall model. Uh but that's just for me
30:26personally. And clearly a lot of people
30:28really liked the claw version. I just
30:30think that if you were using that to
30:32write in a whole book for you, you would
30:33eventually get very tired of the sort of
30:35tone that it has and it would often be
30:38like way too just overly dramatic for
30:42the needs of most scenes. So, those are
30:44my final thoughts on Cloud 4.5 Opus. It
30:47is definitely an amazing tool and you
30:50can't really go wrong with either it or
30:51Gemini 3. I think they are practically
30:54equal in my mind but just different and
30:57should be used differently and in
30:59different circumstances. So I would
31:00recommend doing something like like what
31:02I just said uh where you use Claude for
31:05the more high impact dramatic scenes and
31:08use Gemini for everything else. If you
31:10want to learn how to write up to a book
31:12a month, if not more, come join my
31:14Storyhacker Gold group where you can get
31:16my automations and all of that to write
31:18a massive amount of books in a short
31:21amount of time. So, if that sounds
31:22interesting to you, I'll see you down
31:23below.