Dr. Keith Duggar and Dr. Tim Scarfe in this second edition of the hosts-only "philosophical steakhouse" discuss artificial intelligence, consciousness, and understanding. They explore the computational limits of language models, the challenges of training AI systems to be Turing-complete, and the implications of these limitations for AI capabilities. The conversation covers philosophical arguments about machine consciousness, including John Searle's famous Chinese Room thought experiment. They discuss different views on what's required for a system to truly understand or be conscious, touching on ideas from various philosophers and scientists. The hosts also talk about the recent Nobel Prize awarded for work in deep learning, debating its merits and controversies. They touch on the recent Liron Doom Debates show which Duggar was just on, and at the end Ethics vs AI risk. TOC: 1. Computational Foundations of AI 00:00:00 1.1 Turing Completeness and Computational Limits of Language Models 00:06:37 1.2 Finite State Automata vs. Turing Machines in AI 00:13:16 1.3 Challenges in Training Turing-Complete Systems 00:17:23 1.4 Mapping Turing Machine Programs to Language Models 00:20:41 1.5 Future Directions: Hybrid Systems and Novel Programming Approaches 2. AI Consciousness and Understanding 00:31:30 2.1 Chinese Room Argument and AI Consciousness 00:41:15 2.2 Searle's Views on Physical Realization and Consciousness 00:50:30 2.3 Emergence and Computational Limitations in Cognitive Science 00:59:55 2.4 Friston's Theory on Self-Awareness in Machines 01:04:25 2.5 Causal Structures and Understanding in AI Systems 01:06:50 2.6 Concept Role Semantics and Language Models 01:09:41 2.7 Consciousness and Computational Theories 3. AI Impact and Ethics 01:21:38 3.1 Deep Learning and the Nobel Prize for Hinton 01:29:56 3.2 AI Harm and Existential Risk 01:34:05 3.3 Balancing AI Ethics and Practical Policy Refs: Keith/Liron discussion on Doom Debates (must watch!) https://www.youtube.com/watch?v=4v-Qh3JQ4Jc Liron's show was in response to our previous "steak house" chat- Is o1 reasoning? https://www.youtube.com/watch?v=nO6sDk6vO0g&t=0s Minds brains and programs (Searle) https://home.csulb.edu/~cwallis/382/readings/482/searle.minds.brains.programs.bbs.1980.pdf Searle Google talk https://www.youtube.com/watch?v=rHKwIYsPXLg J. Mark Bishop on MLST https://www.youtube.com/watch?v=_KVAzAzO5HU Chinese room argument https://plato.stanford.edu/entries/chinese-room/ Dancing with pixies - J. Mark Bishop https://philarchive.org/rec/BISDWP-2 Artificial Intelligence Is Stupid and Causal Reasoning Will Not Fix It - Bishop https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2020.513474/full Deconstructing the AI Myth: Fallacies and Harms of Algorithmification (Dagmar Monnett) https://www.researchgate.net/publication/382802495_Deconstructing_the_AI_Myth_Fallacies_and_Harms_of_Algorithmification Nestedly Recursive Functions (Stephen Wolfram) https://writings.stephenwolfram.com/2024/09/nestedly-recursive-functions/ Measure of intelligence - Chollet https://arxiv.org/abs/1911.01547 What is the philosophy of information - Floridi https://www.researchgate.net/publication/225070243_What_Is_the_Philosophy_of_Information Godel, Escher, Bach: An Eternal Golden Braid https://www.amazon.co .uk/Godel-Escher-Bach-Eternal-Golden/dp/0465026567 Shownotes/transcript/refs (autogenerated) https://www.dropbox.com/scl/fi/jc6qwn7m2i69t13bo2hlm/TimKeithPSH2.pdf?rlkey=wtegece4e32v4xhvp9expnpcq&st=1tm6868m&dl=0 x Recorded Friday 11th Oct 2024