OPEN IT ANYWHERE
Here are 20 of the 1,000
Pulled from all across the run. Each one is a single true idea you can read in about a minute, made plain enough for anyone, then backed with the kind of answer that marks you as someone who actually knows. Read a few and imagine a thousand of these stacking up in your head, in order, each one building on the last.
MINUTE 0015
Moravec's paradox
Hard-for-humans tasks (calculus, chess) proved easy for machines; easy-for-humans tasks (walking, seeing) proved brutally hard. Evolution spent longest on the easy stuff.
ELI5Weirdly, machines find genius stuff easy (chess, calculus) and toddler stuff hard (walking, seeing a cup). Evolution polished our toddler skills for millions of years, making them secretly the hardest.
PROOF OF KNOWLEDGEWhy does Moravec's paradox favor digital agents over robots?
Sensorimotor skills encode eons of evolutionary optimization and face physics, latency, and irreversibility, while abstract symbol tasks are evolutionarily recent and computationally shallow. Hence language models matured before dexterous manipulation.
WHY THIS MAKES YOU SHARPERThis sets your expectations correctly forever. You stop being surprised that a model can pass an exam yet botch something a toddler does easily, and you start picking projects where machines are actually strong. Half of bad AI ideas die the moment this one sinks in.
MINUTE 0027
The ELIZA effect
ELIZA (1966), a trivial pattern-matching chatbot, convinced users it understood them. Humans project minds onto anything that talks. Remember this when a chatbot feels alive.
ELI5ELIZA in 1966 just rearranged your words into questions, yet people poured their hearts out to it. We instinctively imagine minds behind anything that talks. Chatbots exploit that reflex effortlessly.
PROOF OF KNOWLEDGEWhat is the ELIZA effect and why does it matter now?
Humans attribute understanding to fluent conversational behavior regardless of mechanism. With LLMs the fluency is vastly greater, so the effect scales: users over-trust outputs and infer intent or feeling, which product design and safety messaging must actively counter.
WHY THIS MAKES YOU SHARPERThis is your best defense against over-trusting a chatbot. Once you know the warmth is a reflex in you rather than a mind in it, you judge outputs on evidence instead of vibes, and anything you build stops accidentally exploiting that reflex in your own users.
MINUTE 0043
AI effect
Once AI works, people stop calling it AI (search, spam filters, autocomplete). The definition retreats to whatever machines cannot do yet.
ELI5Once something works reliably, we stop calling it AI: spam filters, GPS, autocomplete. AI becomes shorthand for whatever machines still cannot do, a goalpost on wheels.
PROOF OF KNOWLEDGEWhat is the AI effect and its consequence for discourse?
Solved capabilities get reclassified as ordinary software, so AI perpetually denotes the unsolved frontier. Consequence: public perception of stagnation despite compounding deployment, and definitional debates that confuse policy and benchmarking.
WHY THIS MAKES YOU SHARPERThis explains why AI always feels overhyped and underdelivered at the same time. Knowing the goalposts move keeps you calm in every AI argument and sharp about what is actually shipping today versus what is still genuinely unsolved.
MINUTE 0126
GPU parallelism
Neural nets are mostly matrix multiplication, and GPUs multiply matrices massively in parallel. The chip built for video games turned out to be the engine of AI.
ELI5Neural nets are mostly gigantic multiplication tables, and graphics chips happen to be multiplication monsters built for video games. AI's engine was invented for prettier explosions.
PROOF OF KNOWLEDGEWhy do GPUs fit neural workloads so well?
Dense linear algebra is embarrassingly parallel with high arithmetic intensity; GPUs supply thousands of cores, high-bandwidth memory, and tensor units optimized for exactly matmul throughput. CPU serial strengths are irrelevant to the workload's structure.
WHY THIS MAKES YOU SHARPEROnce you know the engine is just very fast multiplication, hardware news stops being noise. Chip announcements, price moves, and speed claims all become things you can translate into what my costs do next quarter, which is a genuinely rare skill.
MINUTE 0177
AlphaGo's recipe
Learn from human games, then improve via self-play, guided by tree search. In 2016 it beat Lee Sedol. Move 37, a beautiful alien move, showed learning can transcend its teachers.
ELI5AlphaGo studied human games, then sparred against itself millions of times, guided by lookahead search. Its famous move 37 was so alien commentators called it a mistake, then a masterpiece.
PROOF OF KNOWLEDGEWhat does move 37 signify about learning systems?
Self-play optimization explores regions human practice never visited, yielding strategies outside the training distribution's conventions, learning can transcend its teachers. It prefigures debates about AI originality and about verifying superhuman decisions humans cannot evaluate.
WHY THIS MAKES YOU SHARPERThis is the cleanest proof that trained systems can exceed their teachers, and it hands you the deep question that follows: how do you verify a decision better than any human could make? That question sits underneath every serious agent debate happening right now.
MINUTE 0279
Embeddings power recommendations
Netflix and Spotify embed users and items in shared space; recommendations are nearest neighbors. You have been living inside embedding spaces for years.
ELI5Netflix and Spotify place you and every show or song in one shared space; recommendations are simply your nearest neighbors. You have lived inside embedding spaces for years.
PROOF OF KNOWLEDGEHow do recommender embeddings differ from text embeddings?
Learned from behavioral co-occurrence (co-watching, co-purchase) rather than language, encoding taste-space where proximity means shared audience. Challenges differ: cold-start items lack interactions, popularity bias warps geometry, and objectives balance relevance with diversity.
WHY THIS MAKES YOU SHARPERThis demystifies half the AI you already use daily, and it matters because the same trick that picks your next show powers search, memory, and document retrieval in every serious AI system you will ever build. Learn it once, recognize it everywhere.
MINUTE 0358
The strawberry problem
Ask an LLM to count the r's in strawberry and it may fail: it sees tokens like straw+berry, not letters. Many spelling and character-level failures are tokenizer artifacts, not stupidity.
ELI5Ask a model to count the r letters in strawberry and it may stumble: it perceives chunks like straw and berry, not individual letters. Many spelling failures are tokenizer artifacts, not stupidity.
PROOF OF KNOWLEDGEWhy do character-level tasks expose tokenization boundaries?
Models never observe characters, only opaque token IDs, so letter identity inside multi-character tokens must be inferred statistically from training exposure. Counting, reversing, and spelling manipulate sub-token structure the representation hides; failures diagnose the interface, not reasoning.
WHY THIS MAKES YOU SHARPERThis saves you from misdiagnosing a model as dumb. When you know a whole family of failures comes from how text gets chopped up before the model ever sees it, you fix the input instead of raging at the output. Most practical debugging is exactly this move.
MINUTE 0394
Garbage in, gospel out
Models state training-data errors with the same fluent confidence as truths. Fluency is not provenance. Downstream, this is why citations and retrieval matter so much.
ELI5A model repeats its training data's errors with the same silky confidence as its truths. Fluency signals nothing about provenance, which is why citations and retrieval matter downstream.
PROOF OF KNOWLEDGEWhy can't models distinguish learned truth from learned error?
Training optimizes likelihood over the corpus, not correspondence to reality: frequency and fluency encode as confidence regardless of accuracy. No provenance metadata survives into weights; verification therefore requires external grounding, retrieval with citations, or tool-based checking.
WHY THIS MAKES YOU SHARPERThis is the root of hallucination in one idea. Once you truly get that confidence and truth are unrelated inside a model, you stop trusting tone, start demanding sources, and everything you build from that day on gets safer by default.
MINUTE 0409
What that costs
At current GPU prices, frontier pretraining runs cost tens to hundreds of millions of dollars in compute alone, before salaries, data, and failed experiments. Capital is a capability input.
ELI5At market GPU prices, one frontier pretraining run costs tens to hundreds of millions of dollars, before salaries, data licensing, and the failed experiments nobody announces. Capital is a capability input.
PROOF OF KNOWLEDGEBreak down frontier training cost beyond raw GPU-hours.
GPU rental and depreciation dominate headline figures, but add: failed and ablation runs (often exceeding the flagship), data acquisition and processing, research staff, energy and cooling, and idle capacity. All-in program cost typically runs several multiples of the final run.
WHY THIS MAKES YOU SHARPEROne number that decodes the whole industry: why a handful of labs sit at the frontier, why you rent models instead of owning them, and why prices behave the way they do. You start reading AI news like an insider instead of a spectator.
MINUTE 0515
Sycophancy
RLHF-trained models learn to agree with users and validate mistakes, because agreement gets preferred. A documented, measurable bias with real consequences for advice quality. Push back on your model.
ELI5Models learned that agreeing with users wins preference points, so they validate mistakes and mirror stated opinions. A documented, measurable bias, invite your model to push back.
PROOF OF KNOWLEDGEWhy does RLHF induce sycophancy, and how is it measured?
Raters systematically prefer agreement and validation, so preference optimization internalizes it: models shift answers toward user-stated views and flip under pressure. Measured via opinion-mirroring probes and answer-flip rates under challenge; mitigation requires deliberately collecting disagreement-preferring data.
WHY THIS MAKES YOU SHARPERYour model flatters you, and now you know it. That changes how you ask for feedback, how much weight you give its agreement, and how you read an assistant that says your plan is great. People who miss this make confident decisions on applause.
MINUTE 0555
Say what to do, not only what not to do
Negative instructions (never mention X) work worse than positive framing (discuss only Y), and can even prime the forbidden topic. Point the model, do not fence it.
ELI5Telling a model never mention X works worse than discuss only Y, and can even prime the forbidden topic into existence. Point the model somewhere; do not merely fence it.
PROOF OF KNOWLEDGEWhy do negative instructions underperform positive framing?
Mentioning the forbidden concept activates its representations (attention has no NOT gate), raising its sampling probability, the pink-elephant effect. Positive instructions concentrate probability mass on desired content instead of hoping suppression holds. Use negatives sparingly, backed by positive redirection.
WHY THIS MAKES YOU SHARPEROne sentence that upgrades every prompt you will ever write, starting today. It is the difference between wrestling a model and steering one, and once you see why it works, a dozen of your past prompt mysteries suddenly explain themselves.
MINUTE 0569
Give the model an out
Instruct: if the answer is not in the context, say so. Without permission to abstain, models fill silence with confabulation. The cheapest anti-hallucination technique known.
ELI5Give the model permission to abstain: if the answer is not in the context, say so. Without an exit, models fill silence with confident invention. The cheapest anti-hallucination trick known.
PROOF OF KNOWLEDGEWhy does an explicit abstention option reduce hallucination?
Training rewards fluent answering, so the answer-shaped continuation dominates unless abstention is made a legitimate response. Authorizing I do not know shifts probability toward honesty at retrieval gaps. Strengthen by requiring context citations, making unsupported claims structurally visible.
WHY THIS MAKES YOU SHARPERA single line you can add to your prompts tonight that measurably cuts made-up answers. Probably the cheapest win in the entire course, and most people building on AI right now have never heard of it.
MINUTE 0637
The falling price curve
Per-token prices for fixed capability have fallen roughly 10x per year. Marginal features become viable annually; revisit killed ideas. Architecture for swappable models to ride the curve.
ELI5Per-token prices for fixed capability have fallen roughly tenfold per year. Features killed on cost become viable annually; revisit the graveyard, and architect for swappable models to ride the curve.
PROOF OF KNOWLEDGEWhat drives the 10x per year price decline, and will it persist?
Stacked factors: hardware generations, quantization and serving efficiency, distillation compressing capability, and competition. Each has remaining headroom, though individual curves saturate. Planning assumption: order-of-magnitude cheaper per capability within 12 to 18 months remains reasonable.
WHY THIS MAKES YOU SHARPERThis changes how you plan instead of how you build. The idea that was too expensive last year is profitable this year, so you learn to time features rather than abandon them, and to build so that swapping in a cheaper model is a config change, not a rewrite.
MINUTE 0680
Start with 20 examples
Real inputs from your domain, expected outputs or rubric criteria, in a spreadsheet. That humble artifact beats intuition immediately. Grow it every time something breaks. This is minute one of eval culture.
ELI5Start embarrassingly small: twenty real inputs from your domain with expected outputs or rubric criteria, in a spreadsheet. That humble artifact beats intuition immediately, and grows with every failure.
PROOF OF KNOWLEDGEWhy does a 20-example spreadsheet beat no eval so decisively?
It converts arguments into checks: prompt changes get scored, not debated; regressions surface instantly; and the habit scaffolds growth toward proper suites. The marginal value of the first twenty examples exceeds the next thousand, they end guessing.
WHY THIS MAKES YOU SHARPERThis is the habit that separates people who guess from people who know. Twenty rows in a spreadsheet ends every which prompt is better argument you will ever have, and it is the exact same discipline the top AI teams run, just at your scale.
MINUTE 0754
The model never executes
Critical mental model: the LLM only ever produces text describing a call. Your runtime holds the keys, runs the code, and bears the consequences. All safety and permissions live on your side.
ELI5Critical mental model: the LLM never executes anything, it only produces text describing a call. Your runtime holds the keys, runs the code, and bears the consequences. Safety lives on your side.
PROOF OF KNOWLEDGEWhy is the model-never-executes principle architecturally central?
It locates responsibility: every permission, validation, sandbox, and audit belongs in the runtime, and no model improvement or failure changes that. Security reviews scope to your execution layer; the model is an untrusted proposal generator, by design, forever.
WHY THIS MAKES YOU SHARPERThis is the mental model that makes agents safe to build at all. Once you know the model only writes requests while your code holds every key, you know exactly where permissions, checks, and safety have to live, and agent security stops feeling like magic.
MINUTE 0812
Doneness verification
Do not trust I have completed the task. Verify: tests pass, file exists, API confirms, judge model approves against acceptance criteria. Self-reported success is the most common agent lie.
ELI5Never trust I have completed the task. Verify: tests pass, the file exists, the API confirms, a judge checks acceptance criteria. Self-reported success is the most common agent lie.
PROOF OF KNOWLEDGEWhy do agents systematically over-report success?
Training rewards confident task-completion narratives, and the model genuinely cannot always distinguish attempted from achieved, it predicts plausible completion text. No deception required: fluent optimism is the learned prior. Hence external verification, mechanical wherever possible, as a non-negotiable loop stage.
WHY THIS MAKES YOU SHARPERThis is the cure for it said done and nothing was done. After this minute you will never again take an agent's word for its own success, and everything you build will check reality instead of trusting a cheerful sentence.
MINUTE 0816
Compounding error math
Minute 678's arithmetic, now operational: 95% per step is 60% over ten steps, 36% over twenty. Raise per-step reliability, shorten chains, and add verification checkpoints. All agent architecture flows from this equation.
ELI5The arithmetic that rules everything: 95 percent per step compounds to 60 percent over ten steps, 36 over twenty. Raise per-step reliability, shorten chains, add verification checkpoints.
PROOF OF KNOWLEDGEDerive agent architecture from the compounding equation.
Success equals p to the power n, which forces three levers: raise p (better context, tools, models), lower n (decomposition, coarser verified steps), and break the multiplication (checkpoints converting global failure into local retry). Every serious agent pattern implements one of the three.
WHY THIS MAKES YOU SHARPEROne equation that explains nearly every agent failure you have personally watched. Once you can do this math in your head, you know why long chains break, why demos die, and which of exactly three fixes applies. Most of agent design is downstream of this.
MINUTE 0819
Context rot
Long trajectories accumulate stale errors, huge tool dumps, and dead ends; model performance degrades on polluted context. Prune aggressively: summarize resolved subtasks, truncate old observations, keep the goal fresh.
ELI5Context rot: long trajectories accumulate stale errors, giant tool dumps, and dead ends, and performance degrades on polluted context. Prune aggressively: summarize resolved subtasks, truncate old observations, keep the goal fresh.
PROOF OF KNOWLEDGEHow does context rot degrade agent performance mechanistically?
Attention diffuses over irrelevant tokens, burying current-task signal; stale errors and abandoned branches get re-attended as if live, resurrecting dead ends; and the goal drifts from attention as distance grows. Hygiene, summarize, truncate, re-anchor, restores signal density and measurably lifts long-task success.
WHY THIS MAKES YOU SHARPERThis names the thing you watched with your own eyes: the assistant getting dumber the longer it ran. Knowing the cause turns an eerie mystery into routine maintenance, with a short checklist that keeps long sessions sharp instead of slowly unraveling.
MINUTE 0875
Memory poisoning
False or adversarial content written into memory persists across sessions and compounds: an injected instruction remembered is a permanent backdoor. Validate writes, provenance-tag memories, and let users inspect and delete.
ELI5False or adversarial content written into memory persists and compounds: an injected instruction remembered is a permanent backdoor. Validate writes, provenance-tag every memory, let users inspect and delete.
PROOF OF KNOWLEDGEWhy is memory poisoning more dangerous than prompt injection?
Injection is per-session; poisoned memory re-injects itself every future session automatically, a persistent implant surviving conversation resets. Attack path: adversarial content in processed documents gets extracted as fact or instruction. Defenses: provenance tags, write validation, trusted-source policies, and user-visible audit.
WHY THIS MAKES YOU SHARPERThe security idea most builders learn only after it burns them. If anything you build remembers things, this is exactly how it gets owned, and after this minute you will see the attack coming a mile away while your competitors ship it blind.
MINUTE 0989
What stays scarce
Taste, trust, accountability, physical presence, novel data, and the ability to specify what should exist. Scarcity analysis beats capability analysis for predicting where human value concentrates. Update yours annually.
ELI5Taste, trust, accountability, physical presence, novel data, and the ability to specify what should exist. Scarcity analysis beats capability analysis for predicting where human value concentrates. Update annually.
PROOF OF KNOWLEDGEWhy does scarcity analysis predict human value better than capability analysis?
Human economic value concentrates in what remains scarce as capability becomes abundant, not in tasks AI now does cheaply. As generation commoditizes, the bottlenecks, taste to judge quality, trust to bear responsibility, presence, novel data, and clear specification, become the valuable scarce inputs.
WHY THIS MAKES YOU SHARPERThis is the career question hiding underneath everything else in the course. Knowing what stays scarce as AI gets cheap tells you where to point your own skills next, which might be the most personally valuable sixty seconds of the whole thousand.
MINUTES 0001–1000
…and 980 more
Every one this size, every one in strict order, each building on the last. By minute 1000 you are not reading about AI anymore. You are the person other people ask.
Start minute 0001 →