Home Lex Fridman Notes
Lex Fridman · 2020-10-22 · 3h 08m

George Hotz: Hacking the Simulation & Learning to Drive with Neural Nets | Lex Fridman Podcast #132

George Hotz riffs on hacking the simulation, crypto, immortality, and why end-to-end neural nets beat Tesla's task-by-task approach to self-driving.

George Hotz: Hacking the Simulation & Learning to Drive with Neural Nets | Lex Fridman Podcast #132
The guest

George Hotz — Hacker known as geohot, famous for jailbreaking the iPhone and PlayStation 3. Founder of comma ai, which sells the $1,000 comma two device and open-source openpilot software for semi-autonomous driving.

The gist

In his second appearance, George Hotz talks with Lex Fridman about whether we live in a simulation and whether it's worth trying to hack it, plus crypto, smart contracts, and immortality. The bulk of the conversation centers on comma ai's approach to self-driving: an end-to-end neural network trained on user driving data, contrasted with Tesla's multi-task 'data engine' feature-engineering pipeline. Hotz argues end-to-end and ideas like MuZero will ultimately win, defends driver monitoring as easy and essential, and explains comma's consumer-electronics business model. He closes with sharp opinions on NVIDIA's pricing, programming languages everyone should learn, book recommendations, drugs, love, and what counts as madness.

Big reveals

  • Hotz dismisses UFO sightings as a psyop and frames Bob Lazar's alien-tech claims as likely MK-Ultra-style experiments to stimulate young physicists.
  • He confirms the legend: he walked into a restaurant, met the Optimism crypto team mid-deadline, and wrote a 300-line compiler diff to solve their Solidity-to-OVM problem.
  • Hotz bets Tesla is wrong and end-to-end learning is the only viable path to Level 5, calling task-by-task approaches 'feature engineering' that always loses.
  • He declares MuZero the cornerstone paper of the deep learning era and effectively 'the solution to self-driving cars'.
  • He bets $10,000 that Elon will ship driver monitoring before he ships Level 5.
  • He calls out NVIDIA for price-gouging A100s at $10K when they're 'not that different' from a $699 3080, predicting it opens the door to competitors.
  • Asked how he'd run Waymo, he says he'd get Anthony Levandowski out of jail and put him in charge, calling him unironically a genius.
  • He says he laughs in the faces of acquisition offers, calling M&A people demeaning and the money 'fedcoin'.

Things worth remembering

  • Hotz says a von Neumann probe plus a million years of sublight travel would let a civilization take over the whole galaxy, which is why he thinks intelligent civilizations blew themselves up.
  • He compares lawyers to Python: lawyers cost $1,000/hour and aren't deterministic, while Python is ~10,000x cheaper and reliable, making smart contracts compelling.
  • openpilot went from an unplanned disengagement every 10 miles to every 100 miles in about a year, a 10x improvement.
  • 70% of comma two buyers are daily active users, an unusually high retention rate.
  • Hotz can recall only three transformational days in his life: discovering Yudkowsky, the Hutter Prize (AI as compression), and the blog Unqualified Reservations.
  • He defines intelligence as lossless compression and notes a lossy compressor can be made lossless via an arithmetic encoder.
  • He calls GPT-3 overhyped, arguing cross-entropy loss on characters isn't the loss function of general intelligence and that GPTs lack long-term memory.
  • His recommended programming languages span four paradigms: assembly, C, Python (imperative), Haskell (functional), Verilog (hardware), and PyTorch (ML / 'programming 2.0').
  • He argues driving is more Markovian than language, so transformers may help but won't be a game changer for autonomous driving.
  • He criticizes San Francisco as a corrupt one-party city that votes against building houses, recommending San Diego instead.

Recommended in this episode

Books, products and media the guest or host genuinely endorsed here — with the buy link.

Affiliate link — we may earn a commission at no extra cost to you.

Guest’s ownProduct

comma two

comma ai

“they sell the comma two device for one thousand dollars that when installed in many of their supported cars can keep the vehicle centered in the lane” — Lex Fridman 00:00:00
Find it on Amazon
Guest’s ownProduct

openpilot

comma ai

“open pilot is all the software kind of around that neural network that if you have a neural network that says here's where you want to send the car” — George Hotz 00:57:23
Find it on Amazon
RecommendedProduct

NVIDIA 1080 Ti

NVIDIA

“and so the 1080 ti was a great gpu still have a lot of them it was yeah but at the same time” — George Hotz 01:32:08
Find it on Amazon
RecommendedProduct

PyTorch

Meta (inferred)

“we've switched everything to pie torch now put months into the switch i can't believe how much better pie torch is” — George Hotz 02:25:28
Find it on Amazon
RecommendedProduct

Kinesis keyboard

Kinesis

“i'm addicted to the kinesis weird keyboard that you could you could see uh yeah so you don't have any of that” — Lex Fridman 02:26:30
Find it on Amazon
RecommendedProduct

Vim

Bram Moolenaar (inferred)

“i code most of the time in vim like literally i'm using an editor from the 70s you know you didn't make anything better” — George Hotz 02:24:58
Find it on Amazon
RecommendedBook

Infinite Jest

David Foster Wallace

“infinite jest is a book about wireheading really very enjoyable to read very uh well-written you will grow as a person reading this book” — George Hotz 02:51:57
Find it on Amazon
RecommendedBook

Atlas Shrugged

Ayn Rand

“the second book which is pornography it's called atlas shrugged it is a great book for a kind of framework of human relations” — George Hotz 02:51:57
Find it on Amazon
RecommendedBook

Permutation City

Greg Egan

“there's sci-fi uh permutation city um great things to start thinking about copies of yourself and then that is uh greg egan” — George Hotz 02:55:05
Find it on Amazon
RecommendedBook

The Metamorphosis of Prime Intellect

Roger Williams (inferred)

“it's called the metamorphosis of prime intellect it's a story set in a post-singularity world it's 50 pages everyone should go read it” — George Hotz 02:55:05
Find it on Amazon
RecommendedBook

Snow Crash

Neal Stephenson (inferred)

“everyone should read snow crash if you haven't read those like start there” — George Hotz 02:57:08
Find it on Amazon