EXECUTIVE SUMMARY
In 2019, DeepMind's AlphaStar achieved Grandmaster status in StarCraft II—one of the most complex real-time strategy games ever created—ranking among the top 0.2% of human players. Yet despite embodying many principles of Richard Sutton's "Bitter Lesson," which advocates for training AI systems from scratch using only computation and general methods, AlphaStar required seeding with human game replays to succeed.
This paradox reveals a critical tension in modern AI development: the theoretical ideal of learning from scratch versus the practical necessity of leveraging prior knowledge. While Sutton's "Bitter Lesson" correctly emphasizes that scalable computation ultimately trumps human-designed features, real-world AI systems—even the most advanced ones—often require some form of seeding to be practical.
Key Findings:
- Even systems designed around "training from zero" principles, like AlphaStar, required human data seeding to achieve feasible training times
- Seeding can accelerate training by 30-50% and reduce compute costs significantly, but may limit ultimate performance potential
- The decision to seed or train from zero depends on domain complexity, computational resources, time-to-market constraints, and performance requirements
- As computational power scales, the threshold of "necessary seeding" continues to shift, but complete elimination of seeding remains elusive for complex domains
Free preview
Read the full essay
You are seeing a short preview of “The Seeding Paradox: When "Learning From Scratch" Meets Practical Reality in AI.” Enter your email for a magic link—no account required. Paid plans add ad-free reading plus courses and labs.
Already subscribed? Check your inbox for the confirmation link, then return to this page.
