What Silicon Valley Gets Wrong About AI in Medicine
Silicon Valley AI proponents operate under the assumption that increasing raw AI capabilities ("AGI") will automatically solve complex real-world problems. However, in heavily regulated domains like medicine, intelligence is rarely the primary bottleneck—governance, regulatory policy, and structural incentives are.
Key Takeaways & Evidence
1. The Real Bottlenecks in Medicine Are Regulatory & Structural
The Cost of Clinical Trials: Bringing a drug to market takes roughly 7 years and over $1 billion, primarily consumed by human clinical trials. AI-driven preclinical speed cannot bypass the necessity of gathering human data.
Eroom’s Law: Despite decades of exponential technological and scientific advancement, the number of new drugs approved per dollar of R&D has steadily declined. Capabilities do not automatically yield real-world outcomes.
Governance Holds Back Innovation: AI tools could revolutionize trials via continuous biomarkers and surrogate endpoints (reducing trial time/cost up to 10x). However, progress is stalled by bureaucratic delay—such as the FDA taking 12 years to validate bone mineral density as a surrogate endpoint despite existing data.
Regulatory Speed Drives Progress (The China Example): China's biotech surge (now accounting for over 50% of big Western pharma licensing deals, up from 0% a decade ago) stems from regulatory reforms allowing faster in-human data iteration, not superior basic science.
2. Misaligned Economic and Patent Incentives
Target Herding: Drugs fail or duplicate because firms flock to a few "de-risked" biological targets.
Flawed Patent Protection: The patent system rewards composition of matter (novel molecules) rather than novel biological target discovery.
Misdirected AI Capital: Massive funding rounds go to AI companies focused on molecule optimization (e.g., Chai Discovery, Isomorphic Labs). While useful, molecule design is the easier problem; expanding validated biological targets would yield far higher societal value, but current economic incentives discourage it.
3. The Silicon Valley Monoculture & Blind Spots
Delusion of Universal Applicability: Unreasonable conviction helps founders build successful startups, but it inflates confidence in unrelated, heavily regulated fields.
Social Echo Chamber: Suggesting AI won't instantly transform every sector is treated as low-status within elite SF tech circles. Smart insiders self-censor to appear "AGI-pilled."
Counterfeit Contrarianism: Tech elites view themselves as brave dissenters against outside skeptics, obscuring the fact that AGI-maximalism is the safe consensus inside their own group.
Neglect of Human Problems: Fixing real-world friction—like regulatory reform, housing, deskilling, and social fragmentation—requires policy and human effort, not just waiting for an "AGI god" to solve everything.
