We live in a world where our civilization and daily lives depend upon institutions, infrastructure, and technological substrates that are _complicated_ but not _unknowable_. Join Patrick McKenzie (patio11) as he discusses how decisions, technology, culture, and incentives shape our finance, technology, government, and more, with the people who built (and build) those Complex Systems.
Patrick McKenzie (patio11) is joined by Aaron Brown, author of Wrong Number, to examine why institutions that produce bad statistics face so few consequences for doing so. They trace the pattern from Aaron’s 1975 summer job, where two credentialed experts confidently produced opposite conclusions about whether American tractors ran on diesel or gasoline, through decades of case studies involving the NTSB, COVID-era research, and the eviction moratorium. Along the way they discuss why financial markets are unusually good at error-correction, why “wanna bet?” functions as a tax on bullshit, and what it means that every senior economist Aaron told about the tractor problem simply laughed and topped it with a worse story.
–
Full transcript available here: https://www.complexsystemspodcast.com/aaron-brown/
–
Presenting Sponsors: Mercury & Granola
Complex Systems is presented by Mercury—radically better banking for founders. Mercury offers the best wire experience anywhere: fast, reliable, and free for domestic U.S. wires, so you can stay focused on growing your business. Apply online in minutes at mercury.com.
If meetings consistently leave you with hazy action items and lost context, Granola handles the transcription so you can actually participate and gives you searchable notes afterward. Try it free at granola.ai/complexsystems with code COMPLEXSYSTEMS
–
Links:
- Wrong Number (book): https://www.amazon.com/Wrong-Number-Blizzard-Quantitative-Disinformation/dp/1394379781
- Wrong Number with Aaron Brown (video series): https://www.youtube.com/playlist?list=PLBuns9Evn1w_SLGfUY5i__wzUF5f8e7ec
–
Timestamps:
(00:00) Intro
(01:12) The agricultural demand curve discrepancy
(04:06) Why experts prioritize teaching over learning
(05:17) Institutional indifference to error
(06:26) The brand halo of high-status institutions
(08:34) Lessons from COVID-era decision making
(10:19) Financial statements versus scientific rigor
(14:53) Sponsors: Mercury | Granola
(18:19) The difficulty of auditing and replicating research
(22:12) The CDC eviction moratorium and its justification
(23:34) The NTSB curbside carrier safety study
(26:41) Conspiracy versus incompetence in data manipulation
(30:05) Error correction in financial markets
(32:52) The culture of the advantage gambler versus the academic
(35:28) Betting as a tax on bullshit
(38:44) Using market pricing to evaluate risks
(41:04) The track record of scary predictions
(43:34) Environmental success stories and technological optimism
(48:21) Energy efficiency and the path to global wealth
(54:10) Wrap and where to find Wrong Number
The official podcast of the Santa Fe Institute. Subscribe now and be part of the exploration!
Guest:
- Melanie Mitchell, Resident Professor, Santa Fe Institute
Hosts: Abha Eli Phoboo
Producer: Katherine Moncure
Podcast theme music by: Mitch Mignano
Follow us on:
Twitter • YouTube • Facebook • Instagram • LinkedIn • Bluesky
More info:
- Tutorial: Fundamentals of Machine Learning
- Lecture: Artificial Intelligence
- SFI programs: Education
- Competition: ARC Prize
Books:
- Gödel, Escher, Bach: an Eternal Golden Braid by Douglas Hofstadter
- Artificial Intelligence: A Guide for Thinking Humans by Melanie Mitchell
- Complexity: A Guided Tour by Melanie Mitchell
Talks:
- The Future of Artificial Intelligence by Melanie Mitchell
- Introduction: AI and the Barrier of Meaning 2 by Melanie Mitchell
- Conceptual Abstraction and Analogy in Natural and Artificial Intelligence by Melanie Mitchell
Papers & Articles:
- “The metaphors of artificial intelligence,” in Science (November 14, 2024), doi: 10.1126/science.adt6140
- “Using counterfactual tasks to evaluate the generality of analogical reasoning in Large Language Models,” in arXiv (February 14, 2024), doi.org/10.48550/arXiv.2402.08955
- “Comparing humans, GPT-4, and GPT-4V on abstraction and reasoning tasks, ” (Proceedings of the LLM-CP Workshop, AAAI 2024), arXiv (December 11, 2023), doi.org/10.48550/arXiv.2311.09247
- “The debate over understanding in AI’s large language models,” in PNAS (March 21, 2023), doi.org/10.1073/pnas.2215907120
- “The ConceptARC benchmark: evaluating understanding and generalization in the ARC domain,” in Transactions on Machine Learning Research (August 2023), arXiv (May 11, 2023), doi.org/10.48550/arXiv.2305.07141
Discussions about philosophy, psychology, and sociology through the lens of systems thinking.
Sam and Vox investigate the art of decision-making through game theory; how to navigate rules, players, and payouts to make smarter choices. We’ll explore classic game theory scenarios, the psychology behind decisions, and why emotions like pride can shift the game.
Explore the myths, mysteries, and medical breakthroughs of the most complex and powerful organ in your body – your brain. Weaving together expert interviews with heartfelt, inspiring snapshots of the patients and family members in the middle of it all, Heather Sherman dives into the latest science on Alzheimer’s, Parkinson’s, epilepsy, stroke, concussion, spinal cord injury, brain cancer, chronic pain and other brain diseases and disorders. Along the way she uncovers surprising insights, sheds light on the latest research, and shares heroic, real life stories from the people on the front lines. Brought to you by Krembil Brain Institute at UHN, one of the largest and most comprehensive neurological centres in North America. Learn more about our mission at: http://www.uhn.ca/krembil
In this bonus episode, we delve into the life-changing journey of Carmen Chu, a cancer survivor and mother who was diagnosed with sleep apnea. Carmen shares her struggles with interrupted sleep, fatigue, and the impact on her daily life. She discusses her experience with sleep tests and the transformative benefits of using a CPAP machine.
Additional Resources
UHN’s Centre for Sleep Health and Research
Dr. Frances Chung named UHN Inventor of the Year
Dr. Douglas Bradley featured in KITE Research spotlight: Use of non-invasive breathing device to alleviate obstructive and central sleep apnea improves quality of life
The Your Complex Brain production team is Heather Sherman, Jessica Schmidt, Dr. Amy Ma, Kim Perry, Alley Wilson, Sara Yuan, Meagan Anderi, Liz Chapman, and Lorna Gilfedder.
The Krembil Brain Institute, part of University Health Network, in Toronto, is home to one of the world's largest and most comprehensive teams of physicians and scientists uniquely working hand-in-hand to prevent and confront problems of the brain and spine, such as Parkinson's, Alzheimer's, epilepsy, stroke, spinal cord injury, chronic pain, brain cancer or concussion, in their lifetime. Through state-of-the-art patient care and advanced research, we are working relentlessly toward finding new treatments and cures.
Do you want to know more about the Krembil Brain Institute at UHN? Visit us at: uhn.ca/krembil
To get in touch, email us at krembil@uhn.ca or message us on social media:
Instagram – @krembilresearch
Twitter – @KBI_UHN
Facebook – https://www.facebook.com/KrembilBrainInstitute
Thanks for listening!