We are joined by Cristopher Moore, a professor at the Santa Fe Institute with a diverse background in physics, computer science, and machine learning. The conversation begins with Cristopher, who calls himself a "frog" explaining that he prefers to dive deep into specific, concrete problems rather than taking a high-level "bird's-eye view". They explore why current AI models, like transformers, are so surprisingly effective. Cristopher argues it's because the real world isn't random; it's full of rich structures, patterns, and hierarchies that these models can learn to exploit, even if we don't fully understand how. ADDITIONAL FREE CONTENT: We also filmed Cris' talk at DISI, the audio quality was too bad for us to officially publish, slides included https://www.dropbox.com/scl/fo/bn0tn7z9fxrh1rya1ycrt/AH_d4SOOvlauxLzBgfnNUA0?rlkey=ec65ero4feo5uezum0j6p9z4t&dl=0 **SPONSORS** Take the Prolific human data survey - https://www.prolific.com/humandatasurvey?utm_source=mlst and be the first to see the results and benchmark their practices against the wider community! --- cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy (note we got url wrong in the video, this is correct URL!) Oct SF conference - https://dagihouse.com/?utm_source=mlst - Joscha Bach keynoting(!) + OAI, Anthropic, NVDA,++ Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst Submit investment deck: https://cyber.fund/contact?utm_source=mlst *** Cristopher Moore: https://sites.santafe.edu/~moore/ TOC: 00:00:00 - Introduction 00:02:05 - Meet Christopher Moore: A Frog in the World of Science 00:05:14 - The Limits of Transformers and Real-World Data 00:11:19 - Intelligence as Creative Problem-Solving 00:23:30 - Grounding, Meaning, and Shared Reality 00:31:09 - The Nature of Creativity and Aesthetics 00:44:31 - Computational Irreducibility and Universality 00:53:06 - Turing Completeness, Recursion, and Intelligence 01:11:26 - The Universe Through a Computational Lens 01:26:45 - Algorithmic Justice and the Need for Transparency TRANSCRIPT: https://app.rescript.info/public/share/VRe2uQSvKZOm0oIBoDsrNwt46OMCqRnShVnUF3qyoFk Filmed at DISI (Diverse Intelligences Summer Institute) https://disi.org/ REFS: The Nature of computation [Chris Moore] https://nature-of-computation.org/ Birds and Frogs [Freeman Dyson] https://www.ams.org/notices/200902/rtx090200212p.pdf Replica Theory [Parisi et al] https://arxiv.org/pdf/1409.2722 Janossy pooling [Fabian Fuchs] https://fabianfuchsml.github.io/equilibriumaggregation/ Cracking the cryptic [YT channel] https://www.youtube.com/c/CrackingTheCryptic Sudoko Bench [Sakana] https://sakana.ai/sudoku-bench/ Fractured entangled representations “phylogenetic locking in comment” [Kumar/Stanley] https://arxiv.org/pdf/2505.11581 (see our shows on this) The War Against Cliché: [Martin Amis] https://www.amazon.com/War-Against-Cliche-Reviews-1971-2000/dp/0375727167 Rule 110 (CA) https://mathworld.wolfram.com/Rule150.html Universality in Elementary Cellular Automata [Matt Cooke] https://wpmedia.wolfram.com/sites/13/2018/02/15-1-1.pdf Small Semi-Weakly Universal Turing Machines [Damien Woods] https://tilde.ini.uzh.ch/users/tneary/public_html/WoodsNeary-FI09.pdf COMPUTING MACHINERY AND INTELLIGENCE [Turing, 1950] https://courses.cs.umbc.edu/471/papers/turing.pdf Comment on Space Time as a causal set [Moore, 88] https://sites.santafe.edu/~moore/comment.pdf Recursion Theory on the Reals and Continuous-time Computation [Moore, 96]