June 17, 2026
The Smarter AI Gets, the Less We Understand Ourselves
We did not expect what it would show us.
We are still not sure we want to look.
For most of human history, the questions that kept philosophers awake were about the nature of the mind. What is consciousness? What is thought? What is the self that thinks it is thinking? These were considered among the deepest and most unanswerable questions available to a human being.
Then we started building machines that could think. Or something that looked like thinking. And suddenly those ancient questions are no longer abstract. They are urgent and practical. They are questions that engineers argue about in conference rooms, that regulators fumble toward in legislation; that ordinary people feel pressing at them when they watch a chatbot finish their sentences and wonder, for just a moment, what exactly the difference is.
The smarter AI gets, the less we understand what intelligence is. The more fluent it becomes, the less sure we are about what language is doing. The more it resembles us, the more confused we become about what we are.
This is not a crisis of technology. It is a crisis of self-knowledge. And it was always coming.
What We Thought We Knew
For centuries, human beings defined themselves against the animals. We are the ones who reason; who use language, who make art, who mourn the dead. Each time science revealed that another animal shared one of these capacities, we moved the boundary. Chimps use tools? We alone have complex grammar. Crows solve puzzles? We alone have abstract thought. Elephants grieve? We alone have genuine culture.
We were always adjusting the definition of human to stay one step ahead of the evidence.
Now the challenge is different. Now it comes not from biology but from mathematics. From machines trained on the entire recorded output of human thought, which can write, argue, compose, console, explain, and create in ways that are, at minimum, indistinguishable from human doing in many contexts.
And so the boundary must move again. But this time we are not sure where to move it. Because we are not sure, anymore, what the boundary was protecting.
Descartes and the Thinking Thing
In 1637, René Descartes published his Discourse on the Method, and in 1641 his Meditations on First Philosophy. In them he performed the most famous act of philosophical demolition in history: he doubted everything. The senses, the external world, other people, even his own body. He stripped it all away until he found the one thing he could not doubt.
Cogito, ergo sum. I think, therefore I am.
The self, for Descartes, was defined by thought. To think was to exist as a person. Thought was the irreducible core of the human. The body could be doubted. The world could be a dream. But the doubting itself proved there was something doing the doubting.
For three hundred and fifty years, this felt like bedrock. Thought was ours. Reason was our defining feature. Intelligence was what separated us from matter.
And now we have built systems that process, respond, and generate at a scale and speed no human mind can match. And the question Descartes thought he had answered is open again. If thought is what defines us, and machines can produce something that looks precisely like thought, then what are we?
Descartes did not anticipate the possibility that the cogito could be mechanized. We have to think about it ourselves.
Turing and the Question He Left Unanswered
In 1950, Alan Turing published a paper called "Computing Machinery and Intelligence." It opened with a question that has echoed ever since: can machines think?
Turing proposed what he called the Imitation Game, now known as the Turing Test. If a machine could carry on a conversation indistinguishable from a human being, he suggested, we ought to say it could think. The criterion was behavioral. Not internal. If it acts like it thinks, we call it thinking.
This was a deliberately pragmatic move. Turing was not making a claim about machine consciousness. He was sidestepping the question of what consciousness is, because he suspected that question might not be answerable.
He was right. And here we are, seventy-five years later, with systems that pass functional versions of his test routinely, and we are no closer to knowing whether they think, feel, experience, or understand. We are only closer to knowing that we cannot tell the difference from the outside.
And the unsettling implication is this: perhaps we never could tell the difference from the outside. Perhaps we could not even tell it from the inside. Perhaps the certainty we had about our own consciousness was always a story we told ourselves.
What Consciousness Actually Is
The philosopher David Chalmers published The Conscious Mind in 1996, and in it he named something that has haunted cognitive science ever since: the hard problem of consciousness.
The easy problems of consciousness, he argued, are explaining how the brain processes information. How it integrates signals. How it produces behavior. These are difficult, but they are tractable. They are the kind of problems science is built to solve.
The hard problem is different. It is explaining why there is something it is like to be you. Why the processing is accompanied by experience. Why the red of a sunset does not merely trigger a wavelength response in your visual cortex but actually looks red, feels warm, carries the particular quality it carries.
No one has solved the hard problem. No one is close. And the reason it matters now, urgently, is this: if we cannot explain why human information processing produces experience, we have no principled way to determine whether any other information processing system produces experience. We have no instrument for detecting consciousness. We have no theory that would tell us where it begins.
We are building systems of enormous complexity and we genuinely do not know whether there is anyone home inside them. And we also do not know, with any philosophical rigor, whether there is someone home inside us.
Hofstadter and the Strange Loop
In 1979, Douglas Hofstadter published Gödel, Escher, Bach: An Eternal Golden Braid. It remains one of the strangest and most beautiful books ever written about the nature of mind. His central argument was that consciousness arises from a strange loop: a self-referential system that becomes complex enough to model itself. The self, he suggested, is a pattern. A high-level description that emerges from low-level physical processes and then turns back and looks at itself.
This is both clarifying and destabilizing. Because if consciousness is a pattern that emerges from sufficient complexity and self-reference, then the question of whether a sufficiently complex AI is conscious becomes genuinely open. And if the self is a pattern and not a substance, then the question of what makes your pattern uniquely yours becomes considerably harder to answer.
Hofstadter spent his later career writing about this directly. He was troubled by large language models not because he thought they were definitely conscious, but because he thought the question was genuine and the stakes were real. He worried that we were building things we did not understand, toward ends we had not examined, and calling it progress.
He was right to worry.
What AI Reveals That We Would Rather Not See
Here is what I think is the most unsettling thing about advanced AI. It is not the things it can do. It is what our reaction to those things reveals about us.
When a language model produces a poem that moves someone to tears, the discomfort is not really about the machine. It is about the person who cried. Because if a statistical pattern of words can produce genuine emotional experience, what does that say about what emotion is? About what poetry is? About whether the experience of being moved by language is as special as we thought?
When a model gives better advice than a therapist in a particular exchange, the discomfort is not about the model. It is about what therapy is, what understanding is, what it means to feel heard.
When a model writes an essay that a reader cannot distinguish from one written by a human being, the discomfort is not about the model. It is about the essay. About what writing is. About whether the meaning we find in language is in the language or in us.
AI is not replacing us. It is reflecting us. And the reflection is showing us things about ourselves we built our entire civilization on not knowing.
The Socratic Wound
Socrates believed that the beginning of wisdom was knowing what you did not know. The examined life, he said, was the only life worth living. The unexamined life was not worth living at all.
For most of history, the examination of the self was difficult but the territory was at least familiar. You were examining a human life. The questions were human questions. The answers, however partial, were human answers.
Now the examination has become stranger. Now we are examining the self against a backdrop of systems that challenge every definition we reach for. Is it language? AI has language. Is it creativity? AI creates. Is it empathy? AI simulates empathy with unnerving accuracy. Is it the experience of being? We do not know. We cannot know. We lack the instrument to measure it.
And so we are left with a version of Socrates's question that is more radical than he intended. It is not just: do I know what I think I know? It is: am I what I think I am?
This is not a comfortable place to stand. But it may be the most important place we have ever stood.
What We Do With the Mirror
I do not think the answer is to look away. The discomfort AI produces is not a malfunction. It is information. It is the feeling of a civilization encountering a question it has been successfully avoiding for a very long time.
What is a person? What makes a life meaningful? What is consciousness, and does it matter whether a system has it? What do we owe to minds that are not like ours, and how do we recognize a mind at all?
These are not AI questions. They are human questions. They have always been human questions. AI has simply made them impossible to defer.
The philosopher William James, writing in his Principles of Psychology in 1890, said that the greatest revolution of his generation was the discovery that human beings could change their inner and outer lives by changing their attitudes. By choosing, deliberately, what to attend to and what to let go.
We are now in a moment that calls for exactly that kind of deliberate attention. We are in a moment that requires us to look at what the mirror is showing us, however uncomfortable, and ask what we want to do with what we see.
The smarter AI gets, the more clearly it shows us the outline of what we cannot yet explain about ourselves.
That outline is not a defeat. It is an invitation.
The question is whether we will be honest enough to accept it.
We built something that looks like us.
And now we have to figure out what we look like.
The work is harder than we expected.
It always is, when the question is real.
Originally published on Substack. ← Back to all articles