Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/ESrGqhf5CB
In this special edition episode, we're elated to unveil the Professor Noam Chomsky video! In this select episode, we had the opportunity to converse with one of the most significant thinkers of our generation. We proffered a variety of topics to Professor Chomsky, encompassing his sentiments on the advancement of linguistics and cognitive science, to the convoluted mysteries of science and philosophy. This was a priceless chance to procure perspicacity from one of the most preeminent intellectuals of the 20th century, and we're appreciative to have had the opening to talk with him.
We have crafted a comprehensive opening section in which we explore Yann LeCun's recent stance on AGI, a new paper on emergence in LLMs, empiricism pertaining to cognitive science, cognitive templates, "the ghost in the machine" and language.
Panel:
Dr. Tim Scarfe
Dr. Keith Duggar
Dr. Walid Saba
Pod version: https://anchor.fm/machinelearningstreettalk/episodes/MLST-78---Prof--NOAM-CHOMSKY-Special-Edition-e1l0760
Transcript of Chomsky interview; https://whimsical.com/chomsky-transcript-WgFJLguL7JhzyNhsdgwATy
Original corrupt recording: https://share.descript.com/view/N9KNaZTav27
00:00:00 Kick off
00:02:24 C1: LeCun's recent position paper on AI, JEPA, Schmidhuber, EBMs
00:48:38 C2: Emergent abilities in LLMs paper
00:51:32 C3: Empiricism
01:25:33 C4: Cognitive Templates
01:35:47 C5: The Ghost in the Machine
02:00:08 C6: Connectionism and Cognitive Architecture: A Critical Analysis by Fodor and Pylyshyn
02:20:12 C7: We deep-faked Chomsky
02:29:58 C8: Language
02:34:34 C9: Chomsky interview kick-off!
02:35:32 Q1: Large Language Models such as GPT-3
02:39:07 Q2: Connectionism and radical empiricism
02:44:37 Q3: Hybrid systems such as neurosymbolic
02:48:40 Q4: Computationalism silicon vs biological
02:53:21 Q5: Limits of human understanding
03:00:39 Q6: Semantics state-of-the-art
03:06:36 Q7: Universal grammar, I-Language, and language of thought
03:16:20 Q8: Profound and enduring misunderstandings
03:25:34 Q9: Greatest remaining mysteries science and philosophy
03:33:04 Debrief and 'Chuckles' from Chomsky
References;
(Currently incomplete, we will add to this)
LeCun Path to Autonomous AI paper
https://openreview.net/forum?id=BZ5a1r-kVsf
Tim’s marked up version:
https://acrobat.adobe.com/link/review?uri=urn:aaid:scds:US:8c5260f5-8959-3f11-bb3b-befb3bc65f13
Emergent Abilities of Large Language Models [Wei et al] 2022
https://arxiv.org/abs/2206.07682
Connectionism and Cognitive Architecture: A Critical Analysis [Fodor, Pylyshyn] 1988
http://ruccs.rutgers.edu/images/personal-zenon-pylyshyn/docs/jaf.pdf
Ghost in the machine
https://psychology.fandom.com/wiki/Ghost_in_the_machine
https://forum.wordreference.com/threads/in-an-aristotelian-sense.3350478/
https://news.ycombinator.com/item?id=26448901 (thanks to user tikwidd for your analysis)
Noam Chomsky in Greece: Philosophies of Democracy (1994) [Language chapter]
https://www.youtube.com/watch?v=-kL0UNWcWFc
Richard Feynman clip
https://vimeo.com/340695809
Chomsky Bryan Magee BBC interview:
https://www.youtube.com/watch?v=PxvSQnmcYLo
Randy Gallistel's work (question 3)
Helmholtz “NNs : they’ve damn slow”
Purkinje cells
Barbara Partee
https://www.youtube.com/watch?v=aA_T20HAzyY
Iris Berent
https://cos.northeastern.edu/people/iris-berent/
Penrose Orch OR
https://en.wikipedia.org/wiki/Orchestrated_objective_reduction
https://en.wikipedia.org/wiki/Shadows_of_the_Mind
Alan Turing “Systems of Logic Based on Ordinals”
https://rauterberg.employee.id.tue.nl/lecturenotes/DDM110%20CAS/Turing/Turing-1939%20Sysyems%20of%20logic%20based%20on%20ordinals.pdf
https://www.amazon.com/Events-Semantic-Architecture-Paul-Pietroski/dp/0199244316https://www.amazon.com/Conjunction-Reduction-Redux-MIT-Press/dp/0262035634
Fodor “The Language of Thought”
https://www.amazon.com/Language-Thought/dp/0674510305
Least Effort
http://materias.df.uba.ar/dnla2019c1/files/2019/03/scaling_in_language.pdf
structure dependence in grammar formation…