Full transcript
Introduction to the History of AI
0:00the year is 1939 and the world Teeters
0:02on the brink of technological Warfare as
0:05the Nazis deploy the Enigma an
0:07unbreakable encryption machine that
0:09coordinates their attacks with deadly
0:10precision and now the Allied Forces face
0:13A new challenge and so in the Race
0:15Against Time they turned to Alan Turing
0:17a Visionary mathematician but
0:19traditional cold breaking methods are
0:21obsolete against the Enigma prompting
0:23Turing to Envision a new machine his
0:25creation the first computer not just a
0:29cold breaker but the bear Rock for the
0:31modern Digital World thus beginning the
0:33era of computing and redefining not only
0:36Warfare but the future of all human
0:38civilization computers are supposed to
0:40make life easier about one in three
0:43American households has bought that
0:44theory and purchased at PC what really
0:47worries me today is what's going to
0:48happen to us if machines can think and
0:50what interests me specifically is can
0:53they I'm convinced that machines can and
0:55will think I don't mean that machines
0:57will behave like men I don't think for a
0:59very long time we going to have a
1:00difficult problem distinguishing a man
1:02from a robot and I don't think my
1:03daughter will ever marry a computer but
1:05I think the computers will be doing the
1:06things that men do when we say that
1:08thinking I'm convinced that machines can
1:10will think In Our
1:11[Music]
1:17Lifetime the year is
1:191946 and now every military in the world
1:21knows the power of computers and wants
1:23one of their own but the current
The Semiconductor Revolution
1:25technology used to power computers is
1:27inefficient they're used in vacuum tubes
1:29which works kind of like giant light
1:31bulbs because they require a lot of
1:32manual labor to maintain leaving some
1:35military computers to be the size of a
1:37warehouse and so this gets all of the
1:39top scientists in the world to thinking
1:41there has to be a better more efficient
1:43way to power the computers and so 1947 a
1:46brilliant physicist enters the picture
1:48his name is Bill shock and he imagined a
1:50new way to power computers using the
1:52element geranium to create something
1:54called a semiconductor and it turns out
1:56that the semiconductor is the perfect
1:58solution because in between materials
2:00like metals that conduct electricity and
2:02insulators like rubber and glass that
2:04block electricity a semiconductor can do
2:07both enabling it to act almost like an
2:09electrical switch this eventually
2:11becomes known as the transistor which
2:13will completely change technology
2:15forever but even though the applications
2:17for the transistor are still just
2:19theoretical it doesn't stop the smartest
2:21people in the world from seeing the
2:22future of computers because now the
2:24future of computing power has been
2:26shrunk down to the size of a fingertip
2:28it's a transistor no bigger than a
2:30kernel of corn which causes some of the
2:32most Brilliant Minds to start imagining
2:34a future with super powerful computers
2:37exhibiting artificial intelligence can
2:39machines really think even the
2:40scientists argue that one until I see a
2:43machine producing genuinely new things I
2:46will not agree that machines think I
2:49confidently expect that within a matter
2:50of 10 or 15 years something will emerge
2:52from the Laboratories which is not too
2:54far from the robot of science fiction
2:56fans so in 1950 Alan tur introduced us
2:59to the imitation game also known as the
3:02Turing test which is a test to determine
3:04if a machine can exhibit intelligent
3:06Behavior indistinguishable from that of
3:08a human fundamentally questioning the
3:10limits of artificial and human
3:12intelligence and now the power of AI is
3:15forever etched in the human psyche a
3:17world in which a new machine may be of
3:19even greater importance than the atomic
3:21bomb this new Fascination into computers
3:23forces top universities like Harvard MIT
3:26and Princeton to begin offering degrees
3:29in computer science and when you combine
3:30that with the fact that computer
3:32Engineers were becoming one of the
3:33highest paid forms of skilled labor all
3:35the world's smartest people began to
3:37flock to these programs one of these
3:39people is Marvin Minsky a 23-year-old
3:41PhD candidate at pron University
3:44inspired by Alan turing's paper on
3:45artificial intelligence Minsky would
3:47build the world's first working neuronet
3:49using wires and six vacuum tubes as the
3:52synapsis but even though the vacuum
3:54tubes would fail regularly the machine
3:55still worked and ultimately laid the
3:57foundation for the field of artificial
3:59intell
4:00and the bay Rock that's the neural
4:01network when I'm going to school in the
4:031950s there had been some theories of
4:06what neural networks could do fast
4:09forward a few years and now Bill
4:10shockley's invention of the transistor
4:12has led to the transistor radio and it
4:14quickly becomes the highest selling
4:16consumer electronic device of all time
4:18and now the world gets its first taste
4:20of the power of compact electronics and
4:23so everyone begins to imagine the
4:25possibilities of what the transistor can
4:26do one will be able to make a flat
4:28television tube for sample this leads
4:30Bill shley the transistor's inventor to
4:33leave his job at bail labs and start
4:35Shockley semiconductor a company geared
4:37tours manufacturing the transist but
4:39shakle can't do it alone so he began to
4:41rate PHD programs and electronic
4:43companies for Bright Young Minds people
4:45like Gordon Moore a chemist at John
4:47Hopkins and Robert no a PhD from MIT and
4:50an upand cominging rock star in the
4:52world of transist all in all shley
4:54enlist 12 other Geniuses to join shley
4:57semiconductor with them and so after
4:58being founded in 1954 shakley
5:01semiconductor becomes the Talk of the
5:02Town because shley is determined to
5:04place the company in his hometown of
5:06paloalto officially making it just the
5:08third Tech startup ever to be
5:10headquartered in Silicon Valley but it
5:12wouldn't last long cuz in 1956 just a
5:15few months after shakley will be given
5:17the Nobel Prize for the transistor eight
5:19of the 12 Men He personally recruited
5:21would defect from shakley semiconductor
5:23and create their own company Fairchild
5:26semiconductor a startup dedicated to
5:28manufacturing transition through Z scale
5:30and shock being the big mad hater that
5:32he is gives the man the notorious name
5:35the Traer is
5:37eight
5:39on and it was perfect timing because
5:41within months Fairchild semiconductor
5:43had already become profitable selling
5:45100 silicon based transistors to IBM to
5:48power the navigation system for the
5:49military's B70 bomber and this sale was
5:52a landmark moment in the world of
5:54computing because it proved that the
5:55Silicon based semiconductors were
5:57superior to the original geranium based
5:59one was created by Shak and the profit
6:01margin per transistor was 30 times
6:04larger than that of the geranium based
6:06ones and now the US military needed
6:08hundreds no thousands of transistors to
6:10power everything from computers to
6:12ballistic
6:15missiles but the transist current
6:17manufacturing process was inefficient
6:20half of the ones provided ballot
6:21military had to be recalled because all
6:23it would take as a simple knockup
6:24against the wall for the entire
6:25transistor to stop working and even
6:27though Fairchild was known for making
6:29the best transistors in the world this
6:31inefficient manufacturing process would
6:33pose a huge problem for the entire
6:35industry and so insert random genius
6:37number four John Erie a physicist at
6:40Fairchild that invented a new more
6:42efficient way to manufacture transistors
6:44called the planar process the process
6:46was about adding a layer of coating to
6:48the top of the transistor to increase
6:49the stability and durability of the
6:51semiconductor it was a brilliant and
6:53much needed improvement over the
6:54semiconductor manufacturing process that
6:56would change the world of computing
6:58forever
6:59Mone this all while making Fairchild
7:03semiconductor richer than ever due to
7:05the patent it held over the process
7:07because now if anybody wanted to make a
7:09transistor they had to use the planar
7:12process which means they had to pay
7:13Fairchild and so this patent alone leads
7:16Wall Street to become freakishly bullish
7:18on Fairchild leading to quarter after
7:20quarter of groundbreaking profits and
7:22all-time highs on stock price but with
7:24profit soaring fast Fairchild
7:26semiconductor and the entire industry
7:28was still facing a huge problem you see
7:30the current transistor was limited to
7:32scale because it could only do one thing
7:34at a time so if you wanted to do a
7:35million things you need a million
7:38transistors putting the entire industry
7:40at a stalemate because most computers
7:43were beginning to reach a plateau due to
7:44the diminishing limitations of the
7:46transistor this prompted Bob noise the
7:48brilliant leader of Fairchild to create
7:50the integrated circuit a way for
7:52transistors to operate together in
7:54unison like a network but if we're being
7:56honest Bob totally took the idea from a
7:58Texas insance employee named Jack Hilby
8:01who technically created it first but
8:03Jack's version wasn't nearly as good as
8:05Bob's and so to put things into
8:07perspective it kind of reminded me of
8:09when Tony Stark was able to build the
8:10arc reactor with next to nothing while
8:12every other scientist struggled to
8:14recreate it Tony Stark was able to build
8:17this in a cave with a box of scraps well
8:20I'm sorry I'm not Tony Stark so Bob
8:23noise's invention of the integrated
8:25circuit Creator the brand new industry
8:27because now there's a growing Global
8:29need for transistors a demand that
8:30Fairchild just couldn't fulfill on its
8:32own so this caused a mass Exodus of
8:34Fairchild semiconductor employees to
8:36leave and start their own semiconductor
8:39companies giving them the name Fair
8:41children companies like LSI logic AMD
8:44and Intel founded by Bob noise himself
8:46in fact still to this day over 92% of
8:49the world's computing power can be
8:51traced back to Fair children and you
8:52worked at LSI and AMD before starting a
8:55company how did that happen they gave me
8:57a job but by the me mid 1960s demand for
9:01the integrated circuit skyrocketed from
9:02the US's Space Race with Russia and from
9:05big businesses demanding their own
9:07custombuilt computers but up until this
9:09point the concept of artificial
9:10intelligence was still just a science
Neural Networks and Their Evolution
9:12fiction dream that is until 1966 when a
9:15computer scientist at MIT named Joseph
9:17weisen bomb decided to change that by
9:19building the world's first chatbot named
9:21Eliza using IBM 794 computer Eliza is a
9:26computer program that anyone can
9:27converse with via the keyboard and it'll
9:29reply on the screen directly inspired by
9:32Marvin Minsky's neural network from a
9:34decade earlier Eliza's simulated
9:36conversation by using pattern matching
9:38and substitution methodology that gave
9:40users the illusion of understanding but
9:42it didn't matter because several people
9:44who Ed Eliza still felt like they were
9:46really talking to a person well my
9:49boyfriend made me come here and so now
9:51the world was aware of the all inspiring
9:53power of artificial intelligence and the
9:55power of computers and so in 1971 Intel
9:58landed a contract with a Japanese
10:00company named busicom to build a series
10:02of integrated circuit transistors for
10:04busac com's new Advanced forecast and
10:06calculator but the requirements for the
10:08customized integrated circuit were just
10:10too complicated to build it using the
10:12current technology and so Intel realized
10:14that no form of the integrated circuit
10:15could solve the problem and so they
10:17needed to think outside of the box and
10:19so a young engineer at Intel named tan
10:21hler realized that the only way to make
10:23the requirements simpler was to build a
10:25tiny computer itself that could process
10:27all the requests independent L and
10:30efficiently he called it a
10:31microprocessor a computer that's the
10:33size of your fingertips this was a
10:36series of small steps in trying to
10:39improve the busycal design that finally
10:42led to what ultimately became the 40004
10:46the first
10:48microprocessor so Intel's invention of
10:51the microprocessor uses in a new wave of
10:53thinking towards computers because For
10:55the First Time computers can now get
10:57small enough and cheap enough to on the
10:59desk but unfortunately there's very few
11:02companies focusing strictly on building
11:04actual computers themselves this Gap
11:07inspired dozens of entrepreneurs to come
11:09in and feel that need so by the late
11:111970s we get Microsoft and Apple the
11:14founding of the two richest companies in
11:16the world today that will lay the
11:17groundwork for modern Computing over 97%
11:20of the kids that graduate from high
11:23school have hands-on experience with an
11:24apple before they graduate these kids
11:26are growing up learning how to use this
11:28new tool in many many phases of their
11:30life and so very rapidly the process of
11:33the integration of personal computers
11:35into the society will be accomplished
11:37and these companies fors the road that
11:38led to the PC boom of the 80s and early
11:41'90s
11:41single-handedly capturing 96% of the PC
11:44market between them but even though
11:46computers were selling like hotcakes
11:48year-over-year the biggest artificial
11:50intelligence breakthroughs during the
11:51time wasn't in Computing but rather in
11:54the world of math because in 1986 a
11:56brilliant British computer scientist
11:58named Jeffrey H H created back
12:00propagation which is a machine learning
12:02algorithm that acts like a teacher who
12:04helps the computer learn from his
12:05mistakes it checks the computer's
12:07answers sees where went wrong and then
12:09gives it tips on how it can improve the
12:11next time immediately the back
12:12propagation becomes the Cornerstone for
12:14all neuron Nets inspiring companies like
12:17Ward systems to invent neuro shell one
12:19of the world's first forecasting tools
12:21using back propagation and machine
12:23learning but neuronet wasn't the only
12:25way that AI was advancing because in
12:271997 IBM built deep blue an AI program
12:31that Ed a highly sophisticated search
12:32algorithm a database of games played and
12:35combined it with brw Force computing
12:37power to beat the world's best chess
12:39player but little did they know at the
12:41time IBM's win gave the blueprint for
12:43the future of AI which is when you
12:45combine large volumes of data strong
12:48algorithms and a lot of compute power
12:50you can build something super
12:54intelligent but more on that later
12:55because by the late '90s the power of
12:57computers combined with the internet has
12:59taken over Humanity because now new
13:01millionaires are being minted overnight
13:03by building companies that are taking
13:05our analog world digital well if you do
13:07your social networking on the net then
13:09you know about facebook.com the website
13:12is the latest and hottest thing its
13:14founder is a 22-year-old computer whz
13:16who turned down get this a billion bucks
13:19to sell his site to Yahoo the creation
The Era of Big Data and Machine Learning
13:21of internet companies like Google Amazon
13:23and Facebook brings about the
13:25information age and now there are
13:27hundreds of companies generating more
13:29data every year than all of humanity did
13:31in a
13:33century so this creates a new Need for
13:35computers to be able to analyze all of
13:37this big amounts of data so top
13:40companies start paying the world's best
13:42computer scientists for new and
13:44innovative ways to analyze the data
13:46which brings us back to Jeffrey Hinton
13:49remember him the young computer
13:50scientist that helped create back
13:52propagation well he's no longer a
13:53student now he's a professor at the
13:55University of Toronto that's training
13:57the next generation of Minds in AI
13:59and all of this big data being generated
14:01by these new internet companies renews
14:03this interest in the idea of neuronet
14:06and finding ways to take them to the
14:08next level so in 2006 Jeffrey Hinton
14:11created a new algorithm called the
14:12convolutional neuron Network a way that
14:14computers can begin to think recognize
14:17patterns and even images a convolutional
14:20neural networks instantly become a hit
14:22amongst Tech Giants Facebook and Google
14:24uses them to tag and recognize photos
14:27Amazon uses it as a way to recommend the
14:29next product that you will buy and apple
14:31uses it as a cool way to unlock your
14:33phone now this algorithm becomes so
14:35important to the AI community that it
14:37gives Jeffrey Hinton a new name the
14:39Godfather of
14:44[Music]
14:50AI you're the father
14:53of whether you think artificial
14:55intelligence will save the world or end
14:58it you have Jeffrey Hinton to thank
15:01Hinton has been called The Godfather of
15:04AI you're seen as like a Godfather of
15:06this industry do you have any concern
15:08about what you've wrought a British
15:10computer scientist whose controversial
15:13ideas help make advanced artificial
15:15intelligence possible and so changed the
15:19world but even though every major tech
15:21company is finding useful ways to use
15:23convolutional neural networks to analyze
15:25the data everyone knows that there's
15:27still a huge opportunity to unlock true
15:29intelligence so in 2007 a professor out
15:33of cowtech named Dr fth F Lee launched
15:35imet a new competition dedicated to
15:37providing the world's largest open-
15:39source data set in order to find the
15:41best algorithm in the world that can
15:43exhibit true intelligence we were
15:45thrilled to have put together imag net
15:47and we wanted the whole research world
15:50to benefit from it we opened up the
15:52entire data set for free so for a few
15:55years she announces the winners but
15:57nothing happens that isn't until 2012
16:00where our old friend Jeffrey inton
16:01decided to enter the competition with
16:03two of his students ilas sger and Alice
16:06kesy together they submit their CNN
16:08model called alexnet and ladies and
16:10gentlemen let me tell you this moment is
16:11so big in the AI world that they
16:13literally call it the Big Bang of AI the
16:16Big Bang of deep learning the Big Bang
16:20of modern AI it's universally known as
16:22the day that AI was born but hold up
16:25because the alexl algorithm wasn't the
16:26only thing that powered the AI model
16:29because do you remember the formula to
16:30AI that IBM laid out with deep blue data
16:33plus model plus compute well guess what
16:36the real secret here with the GPU
16:38computing power behind it created by
16:40Nvidia Jeff Hinton reached out to us and
16:42we started hearing about that and yeah I
16:43guess 2012 was also the year when Alex
16:45net came out yeah we started feeling it
16:46we started hearing about it before that
16:48and then imag net kind of it was it was
16:50the Big Bang if you will got all of our
16:52attention yeah and it was this
16:54breakthrough that forced Nvidia CEO
16:56Jensen Wong to completely DISD
16:58development of the comp's core product
16:59which up until that point was graphics
17:01cards for video games and now Jensen has
17:04decided to bet the farm on the future of
17:06AI by building the most powerful
17:08microchips in the world that will power
17:10them a bet that will totally pay off
17:12almost a decade later because as of
17:14today Nvidia is currently the third
17:16richest company in the world because
17:18they power 92% of the world's AI the
17:20California based company saw its stock
17:23market value soore from 1 trillion to $2
17:26trillion in just 8 months few Red by the
17:29insatiable demand for its cuttingedge
17:31technology the hardware and software
17:34that make today's artificial
17:36intelligence possible but Nvidia going
17:38all in in 2012 only caus us Google to
17:40follow suit except they don't focus on
17:42computing power instead they decide to
17:45focus on dominating the space of
17:46breakthrough algorithms Google is buying
17:49Deep Mind an artificial intelligence
17:51company for an unknown amount of money
17:53that may exceed actually $500 million so
17:56they buy up and hire every brilliant
17:58mind in the world of AI including DNN
18:01research the company founded by our good
18:03buddy Jeffrey hitton and his two
18:05students that were on imet and by 2015
18:08Google has a complete Monopoly on the
18:10frontier AI model space but Google's
18:12hoarding of AI Talent starts to concern
18:14a lot of Silicon Valley billionaires
18:16like Reed hman Peter teal and Elon
18:20Musk you see like many of us there were
18:22that if the world built a true super
18:24intelligent Ai and the only people with
18:26access to it was a closed source
18:28for-profit company well let's just say
18:30there's a half a dozen movies showing us
18:32why that's a bad
18:34idea so to fight back against Google
18:37Elon and the Gang decide to start open
18:39AI an open source nonprofit company
18:42geared towards building AGI safely but
18:45there's only one problem none of them
18:47are Ai genuses and there's no way to
18:49compete with Google without the talent
18:51so Elon decides to personally recruit
18:53ilas sucer from Google you remember him
18:56he was one of the three mins behind Alex
18:58net and a re student of Jeffrey Hinton
19:00and so Elon works his magic and steals
19:02Ilia from Google but elon's recruitment
19:05of Ilia suger doesn't come without a
19:07cost because he loses a lifelong friend
19:09in Larry pagee but this new rivalry
19:11supercharges Larry pige so he triples
19:14down with Googles investment in Deep
19:15Mind and AI so in 2016 Deep Mind builds
19:19Alpha go an AI program that beat the
19:20strongest go player in the world follow
19:22directly by Alpha zero a chess program
19:25that does the same and these apps
19:26instantly validate deep M they Google as
19:29kings of the AI world but they weren't
19:31done because in 2017 Google also
19:34stumbled across Transformers Autobots
19:37roll out we Roll n not those
19:40Transformers I'm talking about the AI
19:42model which is now one of the most
19:43powerful AI Tools around and so I want
19:46you to think of Transformers as super
19:47smart robots that can read a lot of
19:49books really fast holy C you can read
19:53but these new Transformer models get the
19:54entire AI World thinking what if we
19:56throw a bunch of text Data at
19:58Transformer and then have humans talk to
20:00them to train them could we build a
20:02better version of Eliza the chat bot
20:04from the 1960s and several companies all
20:06have the same idea the most notable of
20:09which is open AI but there's a big
20:11problem in the plan remember building AI
20:13requires a lot of computing power which
20:15in turn requires a lot of capital
20:18capital that they don't have despite
20:19having the richest man in the world as a
20:21co-founder and now open ey knows that it
20:24needs a minimum of $1 billion to even
20:26compete with Google so they decid to
20:28broker deal with Microsoft to give them
20:30the money necessary to build AI
20:32applications in exchange for cap profits
20:35but this decision totally pisses off
20:37Elon because from his perspective the
20:39entire purpose of open AI was to be open
20:41source and the deal with Microsoft only
20:43leavs the company right back to the road
20:45that deep mine and Google were on this
20:47Rift leads to Elon leaving open Ai and
20:50Sam mman becoming the sole CEO of the
20:52company so in 2020 with Sam acting as
20:55CEO he manages to procure $10 billion
20:58investment for from Microsoft and now
20:59fueled by this new Fusion of capital
21:02open AI launched an updated version of
21:03Elijah a chatting generative pre-trained
21:07Transformer in 2022 and within months
21:10the tool reaches 100 million users
21:12becoming the fastest growing app in
21:14history but during this year Chad GPT
21:17wasn't the only AI app Making Waves
21:19because during the same year other
21:21companies like 11 Labs mid jery and
21:23stability AI all launch groundbreaking
21:25gener of AI tools for audio and images s
21:28sending the entire world into the age of
21:31AI and that brings us to today and now 2
The Future of Artificial Intelligence
21:34years of explosive AI growth has fueled
21:36the industry more than ever and now over
21:38$40 billion a year is being invested in
21:41AI startups and Nvidia and Microsoft are
21:43now two of the three richest companies
21:44in the world all because of their bets
21:46on AI and startups like op AR are now
21:49seeking over $7 trillion doll in
21:51investment to begin this long turn bet
21:53on AI tips and robotic production but
21:55it's unclear where the technology will
21:57go from here and if you want to learn
21:58more then I highly suggest that you read
22:00this book called Chip War by Chris
22:02Miller it's a really amazing read I'll
22:04put the link in the description below
22:06Chip War explains the intense level of
22:08Rd that went into the AI industry over
22:10the years and it explains why companies
22:12like Nvidia tsmc and asml are all
22:15skyrocketing and value and if you're
22:17looking for more history on artificial
22:18intelligence then go watch this video
22:20about how Nvidia built the Monopoly on
22:22gpus it's a really good story and thanks
22:24for
22:27watching down
22:33and my mother