- The Plausibility of Near-Term Machine Sentience.
- Formalism, Platonism and Mentalese
- Comprehension Based Language Modeling
- Cognitive Architectures
- Architectures and Language Instincts
- Why we need a new foundation of mathematics
- The Foundations of Mathematics.
- Friendly AI and the Servant Mission
- AI and Free Will: When do choices exist?
- Metaphor and Mathematics
- Chomsky vs. Hinton
- The Free Lunch Theorem
- Tarski and Mentalese
- Wittgenstein and Mentalese
- Vector semantics or Vector Categories
Author Archives: McAllester
When should we expect “operational sentience” — the point where the most effective way to interact with a machine is to assume it is sentient — to assume that it understands what we tell it. I want to make an … Continue reading
This is a sequel to an earlier post on Tarski and Mentalese. I am writing this sequel for two reasons. First, I just posted a new version of my treatment of type theory which focuses on “naive semantics”. I want to explain … Continue reading
One of the holy grails of the modern deep learning community is to develop effective methods for unsupervised learning. I have always held out hope that the semantics of English could be learned from raw unlabeled text. The plausibility of a … Continue reading
Within the deep learning community there is considerable interest in neural architecture. There are convolutional networks, recurrent networks, LSTMs, GRUs, attention mechanisms, highway networks, inception networks, residual networks, fractal networks and many more. Most of these architectures can be viewed as certain feed-forward circuit … Continue reading
This post is inspired by a recent book and article by Vyvyan Evans declaring the death of the Pinker-Chomsky notion of a language instinct. I have written previous posts on what I call the Comsky-Hinton axis of innate-knowledge vs. general learning and … Continue reading
I just finished what I am confident is the final revision of my paper on the foundations of mathematics. I want to explain here what this is all about. Why do we need a new foundation of mathematics? ZFC set … Continue reading
It seems clear that most everyday human language, and presumably most everyday human thought, is highly metaphorical. Most human statements do not have definite Boolean truth values. Everyday statements have a degree of truth and appropriateness as descriptions of actual … Continue reading