We have a chat with Alexander Mattick aka ZickZack from Yannic's Discord community. Alex is one of the leading voices in that community and has an impressive technical depth. Don't forget MLST has now started it's own Discord server too, come and join us! Patreon: https://www.patreon.com/mlst Discord: https://discord.gg/ESrGqhf5CB Pod version: https://anchor.fm/machinelearningstreettalk/episodes/66-ALEXANDER-MATTICK---Unplugged--Community-Edition-e1f12n9 [00:00:00] Introduction to Alex [00:02:16] Spline theory of NNs [00:05:19] Do NNs abstract? [00:08:27] Tim's exposition of spline theory of NNs [00:11:11] Semantics in NNs [00:13:37] Continuous vs discrete [00:19:00] Open-ended Search [00:22:54] Inductive logic programming [00:25:00] Control to gain knowledge and knowledge to gain control [00:30:22] Being a generalist with a breadth of knowledge and knowledge transfer [00:36:29] Causality [00:43:14] Discrete program synthesis + theorem solvers References; A Spline Theory of Deep Networks [Balestriero] http://proceedings.mlr.press/v80/balestriero18b/balestriero18b.pdf Why Should I Trust You, Bellman? The Bellman Error is a Poor Replacement for Value Error https://arxiv.org/pdf/2201.12417.pdf DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning https://arxiv.org/abs/2006.08381 Solving (Some) Formal Math Olympiad Problems https://openai.com/blog/formal-math/ Facebook Infer https://fbinfer.com/docs/getting-started Coq https://coq.inria.fr/about-coq Leantap (Lean, Tableau-based Deduction) https://formal.kastel.kit.edu/beckert/leantap/ https://en.wikipedia.org/wiki/Inductive_logic_programming https://en.wikipedia.org/wiki/Homotopy_type_theory