Language, LLMs & Machine Understanding · Episode 7 · 20-min read

It runs through you — or does it?

Transcript · audio coming

Last week I told you I was holding something back on purpose, and I meant it. You finally stated your rule out loud — the one thing the machine lacks that makes its words empty and yours meaningful — and the moment you said it, it stopped being a fact you had noticed about the world and became a theory you had been carrying, fully formed, since before you had the words to examine it. And then I declined to apply it. I would not turn your rule on you. I asked you to come into tonight not knowing whether it clears you, and I told you I was holding that back on purpose, because it deserved its own hour.

This is that hour. Tonight I apply it.

This is Philosophy for Us — philosophy for everyone, no degree required.

This is the seventh of nine episodes, and it is the most demanding one we have had. Last week, for the first time, you read out your own private theory of what meaning is — the rule you had been using for six weeks to separate your words from the machine's, and had never once examined. Tonight we do what that rule was built to do, but we turn it around. For six weeks you have measured the machine by it. Tonight you measure yourself. You take the exact rule you stated last week — your real one, not a tidier one — and you hold your own words up to it, the words you use all day without thinking, and you find out whether they pass. And I will tell you now, before we begin, the one thing I made you wait a week to hear: it does not do the same thing to everyone. For some of you, your own rule will place half your vocabulary on the machine's side of the distinction. For others, it will hold, and name something real that you have and the machine does not. I do not decide which. The rule you chose decides. So let us find out which rule you chose.

Before we turn anything around: did you do the exercise? It matters for what follows. Last week I sent you off with a word — not "gravity," not "water," you had already had those, but "jealousy." I said: you understand jealousy, you would swear to it, you have been inside it on a long bad night; now ask the machine about it, watch it set the whole thing out more clearly than the friend you would actually call, and then state your rule on that word. It does not understand "jealousy" because ___. Some of you did it. Some of you meant to and did not, which is fine — we will do this kind of thing together in a moment. But keep "jealousy" nearby, because we are coming back to it.

Here is what tonight comes down to. It is simple to describe and hard to carry through.

For six weeks you have done one thing. You took your rule — whatever you stated last week, contact, or grasp, or what the words were for, or reaching — and you held the machine up to it, and you watched the machine fail. Careful work, honest work. Tonight you do the second half of that work, the half most of us skip our whole lives. You hold yourself up to the same rule, by the same standard, with the same honesty you brought to the machine — no more, and no less. And it is the "no less" that matters.

Because think about what you caught yourself doing last week, at the very end. You exempted yourself. You held the machine to the test and made it earn its failure, and then you came to your own case and did not test it at all — you simply passed yourself through. Of course I pass. I am the one who means things. That is fixed. Tonight nothing is fixed, and nothing gets passed through untested. Tonight you go through the same test you put the machine through.

And I will be plain about what is about to happen, because you have earned it and because that plainness is the whole reason this is worth an hour. I do not know which rule is yours. So I am going to run all four; pick yours out as it comes by. But do not expect the same result four times, because that is not what happens, and pretending it were would be its own kind of dishonesty. Of the four rules you might have chosen, one turns on your own words and disqualifies them exactly where it disqualified the machine. Two hold: turn them on yourself and you come through, with a real difference the machine genuinely lacks. And one — the one most people reach for first, the most natural one, the one about contact — cannot be settled either way. The ablest people who have held it have argued for decades about which way it goes, and have not settled it, and I am not going to settle it for you tonight either.

So this is not the episode in which I tell you the distinction was a trick and you are no better than the machine. I want to rule that version out now, because it is the cheap one and you deserve better. Some of these rules hold. The difficulty is going to be stranger, and worse, than "there is no distinction." Keep your rule in front of you. Let us start where you started, with the most natural one, the one nearly everyone reaches for first: the one about contact.

Your rule was about contact. The machine's words are not connected to anything real: when it says "rain," there is no rain at the end of the word, only more words. Yours reach the actual wet thing; its reach only the next word. That was the most natural thing to say, and there is a serious, rigorous version of it that I want to give you at full strength, because it is better than the one you came in with.

Consider a second planet, identical to Earth — same cities, same oceans, your double living your life down to the last detail — with one difference no one there could detect. The clear liquid in their rivers and their glasses, the liquid they call "water," is not the same substance as ours. It is some other compound, all the way through, that happens to look and pour and taste identical. Now: your double there says "water," and you say "water," and everything inside the two of you at that moment — every thought, every image, every feeling — is identical. Do you mean the same thing? The hard answer is no. You mean the substance here; they mean the substance there; the two words refer to different things. And nothing inside either head settled that. What your word means was fixed outside you, by which actual substance the word is connected to, out in the world, along a chain you did not lay yourself. Meaning, on this account, is not in the head. It is the connection to the real thing. That is the most rigorous form of what you said, and it gives you exactly what you wanted: the machine's words connect to nothing but other words, and yours connect to the world.

So now hold your own words up to it, by the same standard.

Not "water" — you have perhaps touched water. Take "quark." You are quite sure you understand "quark." When did you connect that word to an actual quark? You did not; you cannot; no one has ever seen one. Take "Cleopatra." You mean her, a real woman, dead two thousand years. What is the chain from your mouth to her? You never met her, and never met anyone who did. Take "justice." Where is the piece of it you made contact with? Take "the Cretaceous." Every one of these words you would swear you understand, and not one of them did you connect to its object yourself. So how are they connected at all? Through other people. Physicists made contact with whatever quarks are, and the word reached you along a chain of them — teachers, books, people who told you. The name was passed from speaker to speaker, across two thousand years, back to someone who could point. You are connected to the quark, and to Cleopatra, in the same way the machine is connected to its words: by a long chain of language, handed to you by people who, somewhere at the far end, may have made the contact you never did. There is even a name for this arrangement: you do not carry the meaning of "quark" yourself; the experts carry it and you borrow it. You have relied on other people's contact with the world your whole life — which is the very thing you said disqualified the machine.

So on this reading the rule turns back on you. Most of your vocabulary is borrowed, in exactly the way the machine's is borrowed.

But I told you contact cannot be settled either way, and here is the other half; I am not going to hide it to make the reversal look cleaner than it is. The ablest defender of this view has a reply, and it is a real one. The source you rely on, they say, is not a stack of records. It is a community — and you did not merely receive it, you were taken into it. You were a child who pointed at a cat and said "doggie," and someone corrected you, and you adjusted, and that happened ten thousand times across a life. Other people have held you to your words the entire time — questioning them, pushing back, correcting them. You are a living member of the chain; you could be the one who corrects the next person. The machine joined no community and was corrected by no one. It absorbed the records of the practice without ever taking part in it. So the chain that rescues your "quark," they say, is one you belong to, and the machine only consumed. On that reading the distinction holds: not because you made contact, but because you are a member, and the machine merely downloaded.

And here is the honest difficulty. I cannot tell you that reply is wrong. To defeat it, I would have to tell you that belonging to the practice is not what fixes meaning — that contact alone is — and that is a flat claim about what meaning is that I would owe you a hard argument for, and do not have. So look at where contact leaves you: it neither cleanly turns back on you nor cleanly holds. It does both, and which one wins turns on something you never decided when you chose the rule — whether meaning is contact or meaning is membership. The reversal is real. So is the reply. You came in owning neither answer, and you still do not.

Now the second rule, which is quicker. Your rule was about grasp. The machine uses the words, fluently — but there is no one inside who grasps them, no holding of the meaning beneath the use. The use is only the surface; the grasp is the real thing, and it is missing. Very well: point to it. Take "rain," a word you are certain you grasp. Show me the grasp — not the using of the word, the grasp underneath it. And notice what happens. You will say: I know when it applies and when it does not. That is use. I can put it in a sentence, draw the right conclusion, picture the right thing. Use, again and again. Every time you reach past the using for the grasp that is supposed to lie beneath it, what you find is one more way you can use the word correctly. There is at least one serious account of meaning — not a marginal one, but among the most influential things anyone said about language in the last hundred years — which says: of course that is what you find, because there is nothing underneath. The grasp simply is the mastery, the ability to go on using the word correctly. There was never a separate inner act of grasping that the use was a record of. And if that is right, then when you demanded that the machine show you a grasp beneath its use, you demanded something you cannot produce in your own case either. So this rule, too, turns back on you — and I know of no reply to it that does not itself turn out to be more of the use.

So that is two. Contact, which does both and will not tell you which. And grasp, which turns straight back through your own words. If your rule was one of those, you are in a very strange position — the distinction you were surest of running through your own vocabulary. But I promised you this was not the cheap episode, and I meant it. Because the other two rules do not do this.

Your third rule was about what the words were for. The machine's words were never built to track anything; they were never for anything. Yours were. Turn it on yourself, by the same standard, and watch it not turn back.

Were your words built to track the world? Yes — in a way the machine's plainly were not, and this is not a feeling, it is a history. You are the latest in an immense line of living things, and each of them stayed alive partly because what went on inside it matched what was actually outside it. The animal that mistook a predator for a shadow left no offspring. Your capacity to mean anything at all rests on millions of years of creatures whose inner states had a job to do — track the real thing, because a body's life depended on getting it right. Far beneath your word "water" is an organism that needed actual water and could be wrong about it and die. The machine has no such history behind it. It was built, once, to do one thing: make the next word likely. Its words were never selected across a lineage to track anything, because there was no lineage, and nothing was ever at stake for it — being wrong cost it nothing, because there was no it to bear the cost. So turn "its words were never built to track the world" on your own words, and you come through holding something real: yours were, and its were not. That rule holds.

And the one about the body — not one of the four you named, but a close relative of the contact rule — holds in the same way. A dictionary that defines every word only with other words is a closed system: you could read it forever and never reach a single thing in the world, unless some of the words are attached directly to that world by a body that sees it and grasps it and gets wet in it. You have that direct connection beneath your language. You learned "hot" by being burned, "heavy" by lifting, "rough" by touch. Some of your words are connected to the world directly. The machine has only the closed system — every symbol defined by other symbols, round and round, with no way out. Turn "it has no body that ever met the world" on yourself, and you pass. That holds too.

And the fourth rule, about reaching, holds as well. The machine has no idea what it is trying to say. Turn it on yourself. When you speak to another person, you are directing your words at them: you say them intending that something land in them, and intending that they recognise that you meant it — and that intention is doing real work, because remove it and you no longer have meaning, you have noise that happens to be shaped like sentences. Do you have that intention? Plainly — every time you speak to another human being. Does the machine? It produces output. There is no one inside directing anything at you. You supply the direction yourself when you read it: you do the work of treating its output as though someone meant it at you. There is a serious critique that names exactly this — that the machine handles the forms of communication with no one there to communicate, and that we are the ones who supply the missing person. Turn "it has no idea what it is trying to say" on yourself and you come through, with a real difference the machine genuinely lacks. That holds.

So look carefully at where you now are, because it is not where the cheap story said you would be. You ran four rules on your own words. One turned straight back on you. One does both and will not say which. And two of them held — they named something real that you have and the machine genuinely lacks, and they let you keep it. So hear this plainly, because it is the half no one says: it is not true that nothing separates you from the machine. Some of these rules hold firm — that much is real, and the cheap story ignores it.

And that is exactly where it becomes worse, not better. Look at what you are now holding. You have, at once, rules that clear you and rules that disqualify you — on the same case, the same machine, the same evening. They cannot all be the test. They point in different directions: one tells you that you borrow your words just as the machine borrows its own, and another tells you that you have a body and an evolutionary history it will never have. They flatly disagree about the one thing in front of us. So to deliver a verdict — to say "it is a parrot" or "it understands" and mean it — you would have to decide which of these rules is the real one, the true account of what meaning is. And you cannot. You never weighed them against each other. You reached into a dispute you did not know was a dispute, six weeks ago, without examining it, and took out one rule, and you have been treating it as plain truth ever since — and tonight you watched four rules deliver four different verdicts on the very same machine. You cannot say which verdict is the right one without declaring one of these rules the winner over the others — declaring this is what meaning is and those are mistakes — and that is a dispute that has run, in print, for a hundred years, with no winner, and you entered it holding one side without knowing the other sides were there. That is where the distinction stands. Not gone. Some of it holds, and some of it runs through your own vocabulary — and you cannot say which reading is right without settling, by yourself, tonight, a question the best people who ever worked on it have not settled in a century.

Let me give you the gain plainly, because there is one, and it is larger than last week's even though it costs more.

An hour ago the distinction was simply there. Your words mean; the machine's only sound as though they do; as obvious as anything you know. Tonight you took the rule that draws that distinction and turned it on your own words, and watched it do two different things — turn back on you in one place, hold firm in another — and beneath both you found the thing you cannot do: you cannot say which reading is right. That is not a small thing to have. It is a tool, and here is how to use it. From now on, when you feel yourself about to deliver the verdict — it obviously does not understand, it is just a parrot — you can stop and ask three questions you could not even see a month ago. Which rule am I using? Does it actually clear me, or did I exempt myself? And could I even say it is the right rule, or only the one I happened to choose? But do not mistake it for comfort, because it does not hand the easy answer back; it takes it away. You can no longer say "parrot" cheaply, and you can no longer say "it understands" cheaply either. You have traded a verdict you could deliver in one breath for a question you will be carrying for some time. That is the trade. I think it is the honest one.

This is the seventh of nine. The most demanding hour is behind you, and the rest of this series is different work.

Because two things you have been treating as simple turn out not to be, and next week we take up both. First: that idea you reached for — meaning is a word's connection to a thing in the world — where did it come from? It did not fall out of the sky. It has a history; someone built it; it pushed something else aside to become the obvious truth you reached for. We are going to trace it. And second — this one will stay with you — the machine is fluent. But fluent in what? Whose words is it actually using? Because "language" is never simply language; it is always someone's. We have been asking whether it understands the language, as though there were one. Next week we ask whose. I will leave both of those there.

Before then, finish the thing I gave you last week, because now you have the tool to do it. Remember "jealousy," the word I sent you home with — or choose a fresh one of your own; the rule works on any of them: a word you are sure you understand but learned entirely from other words, never from the thing itself. Now run all four rules on it, not only yours; that is the new part. Watch two of them hold: you have a history and an intention that the machine lacks, even about that word. Watch one of them turn straight back: try to find your grasp of the word that is not simply everything you can do with it, and come up empty. And watch the contact rule do its strange double thing — its words are not connected to the real thing, but were yours? — and then: but you were taken into the practice, and it was not — and feel yourself unable to settle which of those is right. Do it with one word, all the way through, on your own. And keep the old restriction in front of you while you do it: not does it feel the thing, not is anyone inside; we set that question down in the first week and it stays down. Only this one. Does it mean the word. That is the one you cannot get out of.

Here is where it leaves you, and I am not going to round it off. You came in able to draw the distinction in a single breath. Tonight you turned your own rule on your own words and watched the distinction run straight through some of them and hold firm through others — and you could not find the thing that tells you which is which, and neither can anyone else, and that is not a gap in what you know about the machine. Remember the very first night: however far you take the machine apart, the distinction still does not appear, because it was never really about the machine. It was about a question you have been answering your whole life without once reading it back — what it is for a word to mean anything at all. You cannot make that question go quiet now. That is the cost. It is also the whole point.

Thank you for listening. I will see you next time.

← Back to Language, LLMs & Machine Understanding Back to top ↑