Full transcript
0:00AI video is becoming one of those things
0:02that we do not want to sleep on. Even
0:05authors like us, I generally haven't
0:07talked about AI video on this channel
0:08because I focus mostly on the writing
0:10part of things, but we are entering an
0:12era now where AI video is getting good
0:14enough that a single person could create
0:16a pretty high-quality film using the
0:19tools that are out there. I still think
0:21there's a little bit of uncanny valley
0:23in the video side of things for like
0:25live-action stuff and different styles
0:26of animation. It is absolutely good
0:29enough right now that you could
0:31absolutely create a film on your own.
0:33And I think we are heading to an area
0:35where eventually people won't just be
0:38like writing books or making movies, but
0:40will be more like IP directors that can
0:43do all of those things and kind of just
0:46have this suite of story adaptations
0:49that people can pick and choose from
0:51depending on their preference for
0:52consuming that story. Now, it's not
0:54going to be quite that simple, I'm sure,
0:56but I do think we're heading into that
0:58area where anybody can make a movie,
1:00anybody can create a video game, etc.
1:03And at the very least, I know that AI is
1:05becoming extremely powerful for
1:08marketing books, doing things like
1:09short-form videos on TikTok and stuff
1:11like that. TikTok has always been a
1:14really valuable and useful marketing
1:16tool for authors. And AI, as I
1:18understand it from the people that are
1:20working with it right now, is actually
1:21an extremely powerful tool for TikTok
1:24creation. It's actually been very
1:26effective despite some of the negative
1:29attitudes that some people have for AI.
1:31The data is actually telling a different
1:33story there. So, I strongly recommend
1:35that authors start digging into AI video
1:38if only for the marketing side of
1:40things. Now, this is going to be the
1:41first of a series of videos all led by
1:43Akello, who you've seen in a couple of
1:45videos on this channel. This is the only
1:47one that I'm going to be introducing and
1:49I'm just going to let him take the lead
1:50on all of the others. So, go ahead and
1:53take it away, Akello, with the first
1:55video in this series.
1:56>> Hello, my name is Akello Heredia and boy
1:58am I happy to be a nerdy novelist. AI
2:00video went from being a party trick to
2:03basically a production tool in about 18
2:05months and a lot of authors have not
2:07even come close to understanding that
2:09that's happening, which means that
2:11you're either going to spend the next, I
2:12don't know, year ahead
2:15blazing the trails or you're going to
2:16spend the next year ahead watching a
2:18whole bunch of authors do anything that
2:20they want to, do things beyond
2:22possibility, do the amazing. This video
2:26is the map where we're going to cover
2:28the three tools that are leading the
2:30video generation space right now and
2:33we're going to talk about the tools that
2:34let you shape and edit AI video like a
2:38real producer, like a real director. How
2:40video actually fits into your publishing
2:43business. We're going to talk about that
2:44and actually we're also going to talk
2:46about how long this video and exactly
2:49what the series is going to be about.
2:51We're going to talk about that, too. All
2:52right, first off, let's actually talk
2:53about who's making the AI video tools
2:56because there are a lot of tools out
2:59there and most of them are noise and I
3:02mean really honestly a lot of them are,
3:04but these three, these three that I'm
3:06about to show you, they've been around a
3:08while or they're at the top of their
3:09game, so they are a lot less about the
3:12noise. These are the generators. We have
3:16Runway is the established leader in the
3:19West. It is it came out here first. It
3:21was a one of the first ones to have
3:23video. It's been around a long time and
3:26it's super reliable. It used to be an
3:28actual production professional.
3:30The a bunch of them used to be
3:31production professionals that work there
3:33and it produces genuinely high output.
3:36I'm not going to show you a video from
3:37there, but I actually maybe I will show
3:39you a video from there and I'll show you
3:41one from SeaDance, too. If you're going
3:43to be starting anywhere though, Runway
3:46is your huckleberry. And then there's
3:48SeaDance. It's built by a Chinese
3:51company and it's worth knowing because
3:53it has the best motion quality and it's
3:57super exceptional, especially when
3:59you're talking about fluid motion or
4:01fight scenes or character action or
4:03cinematic atmosphere. It may not be the
4:05first name that you like actually know,
4:07but it is the best. Now, let me show you
4:10some examples of both Runway and
4:13SeaDance. This is Runway. This is the
4:16quality of the video that I am showing
4:19you right now is amazing. This is
4:21curated by an actual filmmaker, a person
4:24who really understands how to make film.
4:26This right here is how good it can get
4:31under the hands of a master at
4:33filmmaking. And this
4:39is SeaDance.
4:41It is
4:42absolutely
4:44amazing.
4:46It is truly, truly wonderful.
4:50That's just one example and look at the
4:53quality.
4:54So, it's actually able to take a actual
4:57character sheet and create a full scene
5:00from that character, make it as
5:01consistent as it possibly can, look at
5:03all of the micro expressions that it is
5:07able to actually take nuanced, little,
5:10teeny, subtle things and make them
5:13really, really sing. Uh I'm going to do
5:16my best to uh keep these muted because
5:20some of them might have music in it and
5:22uh for some reason they think generated
5:23music should be struck, but whatever.
5:26Because I'm like, wait a minute, aren't
5:28we Anyway. So, we have this right now.
5:32SeaDance, the top of the food chain. And
5:35then last but not least, we have Kling.
5:38Kling from I think I Kling. It's also a
5:42Chinese company and it it punches above
5:44its weight, but it's particularly
5:45cinematic with its movements and stuff
5:48like that when you need it to like
5:51really be locked down. But they have
5:53been falling behind a bit. There are
5:54some people that are nipping at their
5:56heels. Reason why I'm not showing you
5:57their videos because they are almost
6:00they're just not quite there. Kind of
6:02like VEO is right now where it's really
6:04pretty good for certain things, but
6:06video, motion graphics, stuff like that,
6:09not solved yet. Thumbnails for YouTube
6:11videos, definitely solved, but not that.
6:13Again, this is a But the reason I'm
6:16showing you this is because it's
6:18literally at the top of the food chain.
6:19So, you don't need all three, but you do
6:22need to know that they exist, right?
6:24What they do, how they do them, which
6:27one might be better for you depending on
6:30what you're doing. I personally have
6:31given you a lot of examples here of why
6:34you could use these. We'll go through
6:36this deeper each one of them in the
6:39following episodes. Now, here's the
6:42thing that most people miss, okay?
6:44Generation is only the first step.
6:47Tools, they let you shape the output,
6:50edit things, do motion graphics. That is
6:53the next layer. You can make actually
6:56good-looking videos, and that's a whole
6:58separate layer, and that is where things
7:01start to really get interesting for
7:03authors. This is Buttercut. This
7:06gentleman taught Claude Code to edit
7:08movies. He did. And he took that thing,
7:12and that thing is called Buttercut,
7:15okay? Buttercut is a AI-powered This is
7:20Buttercut. Buttercut is basically this
7:24gentleman right here, Claude Code, how
7:25to edit movies. And because he taught
7:28Claude Code, he inadvertently taught
7:30Codex also. He doesn't know that, but he
7:33did. Uh you can pretty much point your
7:35AI at a GitHub repo, and then it will
7:38read it and know how to use it. So,
7:40that's what this is. It is an AI-powered
7:43rough cut editor. You give it your raw
7:47footage, your talking head video, your
7:50screen recording, or anything like that.
7:53And as you can see, he's in a terminal
7:56right now and he's going to actually be
7:58typing into the terminal. It's pretty
8:00intense, if you ask me. But, I have
8:03Claude, I have dictation software, I
8:05have my natural voice, I should be fine.
8:07You give it all of your raw footage. You
8:10give it your talking head, you give it
8:12your screen recordings, whatever. And it
8:15reads the transcript, understands the
8:18story you're telling, and makes
8:20editorial decisions conversationally.
8:22You talk to it like a director talking
8:24to an editor. It hands the finished
8:28rough cut to you as an XML file for
8:32DaVinci Resolve or any other program
8:34that you might want to edit in. I use
8:37DaVinci Resolve, he uses DaVinci Resolve
8:40because it's free. And so, that's why I
8:42like to use it, because you can go and
8:44get it for free. Not $300, cuz that's
8:46how much this studio version costs, but
8:48all right. And that is ButterCut.
8:52This is HyperFrames. HyperFrames is an
8:56HTML-native
8:58motion graphics engine, okay? Get what
9:00I'm saying? Since it's HTML-native,
9:04that means code. And guess what really
9:06is good at code? That's right, Claude or
9:10Chat GPT or Codex. It's designed to be
9:14operated by AI agents, which means that
9:16you can describe You can describe what
9:19you want. Animated titles, lower thirds,
9:22kinetic type, it builds it. No After
9:25Effects, no Motion, no
9:28nothing, just code. Look, right here.
9:31There's tons and tons of code right here
9:34that it reads and it builds stuff right
9:37here. Really, really intense stuff, but
9:40that's okay because the AI understands
9:43how to read it. So, there. That right
9:46there, hyperframes. Last but not least,
9:48absolutely not least, is Remotion. This
9:51is React's version
9:53kind of of hyperframes except it kind of
9:55is a little more technical and it goes
9:57way, way further. It's way more
9:59powerful. If you want to use ProRes
10:01transparent overlays, cinematic animated
10:04graphics, or full motion compositions,
10:08or full motion compositions dropped into
10:11your edit, Remotion is your tool. It's
10:14the one for you. At least I use it over
10:16here at my channel, which is YAI
10:19Matters, and I love using this. I have
10:22like started to actually change the way
10:26that the graphics look, change the fonts
10:27that it uses because it seems to
10:29automatically go straight for the same
10:30fonts with the same outlook and
10:32everything. I want it to do jagged,
10:34weird things with with asymmetrical
10:36shapes and stuff like that because I
10:38don't want it to look like everyone
10:39else. But, this let me run this sequence
10:42for you right here. This right here is a
10:45sequence that I Let me see, can I zoom
10:47in? Uh this sequence I built I would
10:50just talk about all of the stuff that
10:51happened in AI over the past, say, 45
10:54days since the beginning. Uh this was
10:56mostly about Claude was what I was going
10:58to do this for. And this is a basically
11:02ready for a video. All I'll have to do
11:03is pull them up. As you could see when I
11:05earlier when I was pulling up different
11:07motion graphics, that's what I was doing
11:08here. These three tools, ButterCut,
11:10Hyperframes, Remotion, they are your
11:13production layer. They're how your your
11:16raw AI actually finishes your video for
11:19you, okay? So, whatever video you're
11:21going to use, you're probably going to
11:23end up using one of these at the end.
11:25And actually make it look like your
11:27brand. Now, let's talk about your
11:29business. Okay. So, you understand what
11:33the tools can do. Now, where does your
11:36video actually live in a author's world?
11:40Because that's the part that usually is
11:43missing from these conversations. Your
11:45author website, that is probably place
11:49where you can use video the most.
11:51I'm talking about hero videos. I'm
11:53talking about book trailers, about, you
11:56know, about me reels. That's really a
11:59powerful thing. Videos on a website can
12:01change how you how a person like
12:04perceives that author, how long a person
12:07stays on the site, and how much money
12:10they spend in your presence, and how
12:14much they trust you. These are all
12:17really amazing sort of catalyst for, you
12:20know, you making money,
12:22>> [laughter]
12:23>> and also having a thriving thriving
12:26having a thriving publishing business.
12:29All right, what else? Social media,
12:31store clips, scene teasers, quote cards
12:35with motion, okay? You could make Magic
12:38the Gathering cards for all of your
12:40characters. You could do anything. 15,
12:4330-second clips, that would be enough,
12:45and it would change things for you. And
12:49then there's always your email. You
12:51could have a video thumbnail in a email
12:54drive clicks. They could literally click
12:57on it the the fun little prize at the
13:00end of the click. The way it doesn't,
13:02you know, plain text doesn't do this
13:04exact same thing. This would be
13:06electric. Ads, of course ads, for book
13:09launches, a 15-minute or 30-second
13:12AI-generated spot is now within reach
13:14for most independent authors. They could
13:18easily easily afford this. And then
13:20there's always bonus content. You know,
13:23that juicy little thing that makes your
13:26newsletter the popping thing every week
13:29that people want to open and then every
13:31once in a while you have a new book and
13:33then they just keep buying. Well,
13:35world-building walkthroughs,
13:37behind-the-scenes, something for
13:40everyone, for super fans, for patrons,
13:43for patreons, for everyone. You could
13:47easily easily get super fans, I would
13:50have to think at least twice as quickly
13:53as you would just by using video in the
13:56correct way in your publishing business.
13:58The point is that video is no longer
14:02something that only traditional
14:03published authors with marketing budgets
14:06can access. The tool exists, the
14:09workflows, they exist and by the end of
14:12the series, you'll have it. What is the
14:14series? Well, here's what what we're
14:17building in the series. Every episode is
14:20built around a real story, a real
14:22workflow and something that you can do
14:26with your own book. I mean, literally,
14:28you can make a comic book. We're going
14:29to actually do that. We're going to make
14:30a comic book which is a precursor to
14:32storyboards. You'll think to yourself,
14:34"No, why are we making comic books?"
14:36It's because we're going to be making
14:38storyboards which will be used for? You
14:40got it, your films. So,
14:43this is real things that we're going to
14:46do with your book. All right. So, we
14:48talked about the state of AI video. This
14:51is the one where it kind of gives you a
14:52little primer on some of the things and
14:54some of the ways that we're going to be
14:55thinking about artificial intelligence
14:57and making videos for your publishing
14:59business. That's right, the missing
15:01step, how to turn prose into production
15:05scripts. We're going to work through how
15:07you can make a production script which
15:10is very similar to making a film script
15:12which is a good primer for people who
15:14are doing that. Then three, we're going
15:16to turn a novel scene into an AI short
15:20film. We're going to use my jump box,
15:23which by the way, the pros into our
15:26production script, we're going to wedge
15:28another video in between there where the
15:30comic book happens so that we can use
15:32that for the short film. Or maybe even
15:36we'll put them all together. I trying to
15:38decide on how epic that episode should
15:40be. Then the fourth thing is the AI
15:43video battle. We're going to keeping
15:45your characters consistent across all of
15:48your clips. I have figured it out. I
15:50even built a tool. I don't know if I'm
15:52going to give away the tool, but I will
15:53give you all of the prompts probably so
15:55that you and your AI can build the tool.
15:58And then maybe right here is where we'll
16:02still do the comic book, okay? These
16:05visual paths are they will lead you down
16:08to the same thing. The visual paths will
16:10leave you to the same thing. But I am
16:12still thinking about putting the comic
16:14book ahead of that. So,
16:17wait and see.
16:18>> [laughter]
16:19>> And then two visual paths from the same
16:22material is going to happen because it's
16:25easy to see that comic books are panel
16:28that making a panel for a storyboard is
16:32basically the same thing except at the
16:34end one is moving, one's not, all right?
16:37And then six, we're going to make some
16:40book trailers. That's right. We're going
16:42to make book trailers. Really cool
16:45things. We're going to incorporate music
16:47into those book trailers. So, get your
16:49cinema on. And then those trailers are
16:52going to be really like exciting and
16:55bombastic. We're going to use Seed Dance
16:57because it'll be able to do multiple
16:59scenes. We'll be able to
17:00storyboard the whole thing out, give it
17:02to Seed Dance, and have it work those
17:05things out. You saw some of the examples
17:07earlier. All right. And then seven,
17:10we're going to make an AI video as a
17:13pre-visualization
17:15for maybe a bigger scene or something
17:18like that. So, that's going to be a
17:21really kind of tricky thing. But, one of
17:24the cool things about pre-visualizations
17:26is that they can be used before you
17:29actually shoot real stuff so that you
17:31know what angles you want, what visuals
17:33you want, and a pre-visualization can be
17:36a cheap way of figuring out what your AI
17:39video is going to look like before you
17:40make it.
17:42And then, eight, the ethical author's
17:46guide. What's safe, what's not, and
17:49we're going to give you a big old
17:50checklist on that. Subscribe if you
17:52don't want to miss any of it, and if you
17:54already have built something, you know,
17:56you own your own trailer, a scene demo,
17:58a character reel, something like that,
18:00drop it in the comments. We read them,
18:02and your project might become a future
18:05episode demo. You never know. I do love
18:08trolling, trolling, trolling. All right,
18:10have a good day. See you in the next
18:11video.