AI Helps Ukraine - Charity Conference A charity conference on AI to raise funds for medical and humanitarian aid for Ukraine https://aihelpsukraine.cc/ Support us! https://www.patreon.com/mlst Dr. Joscha Bach (born 1973 in Weimar, Germany) is a German artificial intelligence researcher and cognitive scientist focusing on cognitive architectures, mental representation, emotion, social modelling, and multi-agent systems. http://bach.ai/ https://twitter.com/plinz Pod version: https://anchor.fm/machinelearningstreettalk/episodes/82---Dr--JOSCHA-BACH---Digital-Physics--DL-and-Consciousness-UNPLUGGED-e1rctlc TOC: [00:00:00] Ukraine Charity Conference and NeurIPS 2022 [00:03:40] Theory of computation, Godel, Penrose [00:11:44] Modelling physical reality [00:15:19] Is our universe infinite? [00:24:30] Large language models, and on DL / is Gary Marcus hitting a wall? [00:45:17] Generative models / Codex / Language of thought [00:58:46] Consciousness (with Friston references) References: Am I Self-Conscious? (Or Does Self-Organization Entail Self-Consciousness?) [Friston] https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00579/full Impact of Pretraining Term Frequencies on Few-Shot Reasoning [Yasaman Razeghi] https://arxiv.org/abs/2202.07206 Deep Learning Is Hitting a Wall [Gary Marcus] https://nautil.us/deep-learning-is-hitting-a-wall-238440/ Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets [Alethea Power et al] https://arxiv.org/abs/2201.02177 Picbreeder [Stanley] https://wiki.santafe.edu/images/3/34/Stanley_innovation_workshop14.pdf Turing machines https://en.wikipedia.org/wiki/Turing_machine Lambda Calculus https://en.wikipedia.org/wiki/Lambda_calculus Godel's incompletness theorem https://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems Oracle machine https://en.wikipedia.org/wiki/Oracle_machine