The Self Across Time · Episode 2 · 27-min read

You are who you remember

Listen now — or read the transcript below.

Somewhere there is a photograph of you at four years old. You have seen it: a small child, the features not yet settled into the face you have now, doing something you have no memory of doing, in a room you could not now describe. And you call that child you. Not a person related to you. Not an earlier version. You — the same person, you would say, who is listening now, only younger.

Pause on how strange that certainty is. You do not share a body with her; almost every cell you had at four has been replaced. You cannot remember being her — try to reach back to four, and for most people almost nothing comes, or a few fragments that might be memories and might be stories you were told. So what connects you to her? What makes that child in the photograph you, rather than simply a child who grew up into someone, as every child does?

This is Philosophy for Us — philosophy for everyone, no degree required.

This is the second episode of The Self Across Time. Last week we examined the one record most people would never think to doubt — their own memory — and found that it is not a recording. A single suggested word can produce a false detail a week later; an entire childhood afternoon that never happened can be planted and then sincerely defended as one's own; and even our most vivid, most confident memories turn out to be wrong about as often as right. You may keep your memories. What you cannot keep is the certainty that any single one of them is accurate. Tonight we turn from the memories to the one who has them — the self that owns that photograph — and to the classic answer to what makes her you.

That answer is about three hundred years old, and it is one of the most influential ideas anyone has had about the self. It locates the connection in the very thing we spent last week taking apart. What makes you the same person as the child in the photograph, on this view, is not your body and not your soul. It is that you can, in principle, remember being her — that an unbroken line of consciousness runs from her to you. You are, on this account, not a thing that has memories. You are closer to the memories themselves: a self constituted by its own consciousness reaching back through time.

It is a liberating idea, and we walk in already carrying the problem with it. What it rests on — memory, consciousness reaching back — is precisely what we watched come apart last week.

So tonight the task is the same as last week's, on a harder target. We take the strongest answer anyone has given to what holds the self together across time. We state it in full, and it is a serious answer — more powerful than it first appears. And then we ask whether it can do what is being required of it.

Let us slow down on the question itself, because it is easy to gesture at and hard to answer.

Here is the question. You are, right now, one person. And there was, forty or fifty years ago, a small child in a photograph. We want to say they are the same person — one person, encountered at two different times. Not two people who happen to resemble each other. The very same one, earlier and later. So what makes that true? What runs from the child to the adult and makes them one person, when almost everything has changed — size, cells, opinions, the language one thinks in, the faces one loves?

There are only so many answers anyone has ever given. Start with the most obvious. They are the same person because it is the same body. There is a single physical thing — this organism — that was small once and is full-grown now, present the whole way through, growing but never replaced. The body is what connects them.

It is a reasonable first answer, and it runs into trouble quickly, on facts we already know. The body is not, in any simple sense, the one thing present the whole way through. The cells that made up the four-year-old are almost entirely gone — shed, replaced, rebuilt, many times over. The atoms cycle out. What one has is not the child's body persisting but a long, continuous replacement of one body by a slightly different one, every day, for decades. So if the body is what makes the adult the same as the child, it cannot be the matter, because the matter has turned over. It would have to be the continuous form — the pattern carried forward rather than any fixed material. That distinction matters, and we will need it: continuity, a pattern carried across change, rather than one unchanging thing. But notice that it has already given up the simple picture of a single solid object that has just been sitting there being you.

There is a second, deeper reason the body answer does not satisfy us. Consider a case people have imagined for centuries. One wakes tomorrow in a different body — taller, older, a different face in the mirror — but it is unmistakably oneself inside. The memories, the fears, the argument left unfinished the night before, all present, all one's own, looking out through new eyes. Almost everyone has the strong intuition that the person would have gone with the mind — that the person is wherever the inner life ends up, not wherever the old body stayed. That tells us something. When we look hard at what we mean by "the same person," we do not in fact point at the body. We point at something mental.

So try the other old answer, the one many traditions reach for next: it is the same soul. Beneath the changing body and the changing mind there is a single immaterial thing — the real person — that persists whole and unbroken from the child to now. The matter changes; the soul does not.

But ask what work the soul is actually doing, and it turns out to be doing very little. Suppose there is such a soul. How would anyone ever know it is the same one? It cannot be seen or checked. And here is the sharper version. Suppose that overnight one's soul were quietly exchanged for a different one, while everything else stayed as it was — all the memories, the character, the way one would finish that argument, carrying on without a flicker. Would one have died and been replaced by a stranger? Or would nothing that matters have changed at all? Most people, thinking it through honestly, find they cannot bring themselves to care about the exchange — which means the soul was not carrying the thing they actually meant by "me." Once again, what we care about turns out to be on the mental side: the memories, the character, the consciousness, not the invisible substance underneath them.

So the question has already driven us somewhere before any philosopher has spoken. It is not the body — the matter turns over, and we would follow the mind out of it in any case. And it is not the bare soul — we cannot find it, and we would not grieve its quiet replacement. Both times, what we reached for instead was the inner life: the memories, the consciousness, the sense of reaching back and owning one's own past. What makes a person the same person seems to lie on the side of the mind.

That is the answer John Locke gave, three hundred and thirty years ago — and gave so cleanly that we are still arguing within the terms he set. He said: stop looking for the same underlying stuff. What connects them is consciousness. You are the same person as the child because you can reach back and join her to yourself from the inside. That answer deserves its full due, and it is where we turn next.

In sixteen ninety-four, John Locke added a chapter to the second edition of his Essay Concerning Human Understanding, a long book about how the mind works. In that chapter he did something that still feels modern: he separated two words everyone had been using as one.

The two words are man and person. By man, Locke means the living human animal — the body, the organism, the creature. By person he means something else: a thinking thing that can consider itself as itself, the same thinking thing, at different times and in different places. A person, for Locke, is a self-aware point of view that can hold its own past. And his claim — the one still argued over — is that the two can come apart. The same person could, in principle, appear in a different animal. The question "is this the same person?" is not the question "is this the same body?"

So what makes a person at one time the same person as a person at an earlier time? Locke's answer is one word: consciousness. Not the same matter, not the same soul, but the same consciousness, extended backward. You are the same person as someone in the past exactly as far as your consciousness can reach back and take their experiences as your own — as far as you can remember being them, from the inside, owning what they did or felt as something you did or felt. That reaching back is not evidence that you are the same person. On Locke's view it is what being the same person consists in. The self is consciousness extended across time, joining its moments into one by reaching back and claiming them. What connects you to the child in the photograph is not bone or blood or soul; it is that line of consciousness running back to her.

To show how far this goes, Locke tells a short story, and it is worth telling slowly, because three centuries of argument have grown out of it. Suppose the consciousness of a prince — all his memories, his sense of his own royal life, everything he can reach back and own — leaves the prince's body and enters the body of a cobbler, a poor shoemaker, just as the cobbler's own consciousness departs. Now there is a man with the cobbler's body, the cobbler's hands and face, walking around the workshop — but the memories and the inner life inside are the prince's. He remembers the palace. He remembers being the prince. Locke asks: who is this? His answer is firm. To everyone in the street it is the cobbler — same body, same man. But the person is the prince, because personhood follows consciousness, and the consciousness is the prince's. The man is the cobbler; the person is the prince. The person went where the memories went.

The view gets a lot right. It matches the case of the exchanged soul a moment ago: we said one would follow the mind out of the old body, and Locke explains why — the person is the consciousness, so of course the person goes where the consciousness goes. It matches how we actually treat one another. When someone we love has a stroke and the memories and the manner are gone — when the body is present but no one seems to be reaching back from behind the eyes — we say, in grief, that they are not there anymore. The man is in the bed; we are no longer sure the person is. We were reasoning as Locke did the whole time, without knowing the name for it.

And this is the part Locke himself emphasised, the part that makes the view not merely clever but humane. It is a liberating account of what a person is. It says one need not be the same piece of matter one was at four — and one is not, and that is no cause for alarm. It says one need not stake one's identity on an invisible soul one can never inspect. What makes you you is something you actually have access to, from the inside, without cost: your own consciousness, owning your own life. On this account you are not something handed to you by your body or your God. You are, in a real sense, self-constituted — the one who holds your own past together by claiming it. Three hundred years before anyone spoke of authoring one's own story, Locke had already located the self in consciousness rather than in substance. Much of how we think about ourselves now descends from that one chapter.

So that is the answer, stated in full. Not a weak version set up to be knocked down, but the strongest one, the version its defenders would endorse. What makes the child in the photograph you is that your consciousness can reach back and own her experiences as yours. The self is the line of consciousness, and it is what you follow back to find the child on the other end.

It is a powerful idea. Now we have to do the harder thing and ask whether it can do what it is being required to do. Because there is a problem inside it — the same problem we spent last week uncovering — and Locke's own century saw it coming.

Locke says you are the same person as the child in the photograph because you can reach back and own her experiences as your own. So let us do that — not as a theory, but in practice. Reach back.

Reach back to four years old, to the child in the photograph. What actually comes?

For most people the honest answer is: almost nothing. A few fragments — a colour, a fear, a Christmas morning — and one is not even sure those are memories rather than stories one was told and has since pictured. The first years are largely blank. One cannot, in fact, reach back and own the four-year-old's day from the inside. Consciousness does not extend that far. Now apply Locke's test strictly, as he stated it: you are that person exactly as far as your consciousness reaches. If the reaching is what makes her you, and the reaching comes up empty, then by Locke's own rule the four-year-old is not you. She is a small stranger your body used to be. That cannot be right — but it is what the view says, taken at its word. The connection you meant to use to claim her does not reach her.

One might try to repair it: not directly, perhaps, but in steps. I do not remember being four, but I remember being a teenager, and the teenager remembered being a child, and the child remembered the morning in the photograph — so we are linked down the line, even if I cannot see all the way back. That is a good repair, and it is worth holding onto, because it is the one the modern defenders use, and we will return to it. But notice what has just happened. One has just conceded that what connects the adult to the child is not consciousness reaching back after all. It is a series of overlapping steps, no single one of which spans the whole distance. The thing Locke described — one consciousness owning its whole past — is already gone, replaced by something else that has not yet been named.

And in seventeen eighty-five, the Scottish philosopher Thomas Reid, in his Essays on the Intellectual Powers of Man, found the cleanest way to show that the series of steps has a problem of its own. It is a short example. People have called it the brave officer ever since.

Consider three moments in one life. First: a boy is caught stealing apples from an orchard and is flogged for it. He never forgets the flogging. Years later — the second moment — that boy has become a young soldier, and in his first battle he does something brave: he captures the enemy's flag under fire. Standing there, flag in hand, the young officer remembers being flogged as a boy for the apples. The memory is right there. Years later again — the third moment — he is an old general, decorated, near the end of his life. The old general clearly remembers the day as a young officer, taking the flag. But the flogging — the orchard, the apples, the boy — is gone, worn away by sixty years. He cannot reach it at all.

Now apply Locke's rule across the three. The young officer remembers being the flogged boy, so by Locke's rule the officer and the boy are the same person. The old general remembers being the young officer, so the general and the officer are the same person. But the old general has no memory whatsoever of being the flogged boy. So by Locke's rule — you are whoever you can remember being — the general is not the boy. They are different people.

And there is the contradiction. The general is the officer. The officer is the boy. The general is not the boy. That cannot all be true, for the plainest of reasons. If two things are each identical to a third thing, they are identical to each other. If the general is the officer and the officer is the boy, then the general simply is the boy; there is no room for it to be otherwise. Identity does not admit exceptions. Yet Locke's rule has produced one — same person, same person, different person — within a single human life. The rule contradicts itself the moment a memory drops out of the sequence, and memories drop out constantly. This is not an exotic case. It is every long life. You stand to your own infancy exactly as the old general stands to the flogged boy.

So the first difficulty with Locke is not even our doubt about whether memories are reliable. It is worse and more basic than that. Even if every memory were perfectly accurate, memory still could not do the job Locke assigned it, because memory comes and goes — it drops out in the middle — and identity cannot come and go. A person cannot be themselves in patches.

Now lay last week's finding on top of that, because it adds still more weight. Reid's general at least had real memories, merely incomplete ones. But we found last week that the memories themselves are not trustworthy even when they are present. A memory can be a fabrication — vivid, certain, sincerely owned, and of something that never happened. So Locke is asking the self to rest on memory that both drops out in the middle and, where it remains, may be counterfeit. That is a lot to ask of something we have now watched fail in two entirely different ways.

The defender is already preparing a reply, and there is a real one coming. But before we allow the repair, there is a second problem, and it is deeper than a dropped memory. It concerns the whole idea of using memory to constitute a self at all.

The second problem is not one that goes away when the sequence of memories is patched. It goes after the idea that memory could ever be the thing that makes a self at all.

Return to last week for a moment, to the people in the shopping-centre study. Someone read a short booklet and, a few days later, remembered being lost in a shopping centre at five years old — frightened, crying, found by a stranger. It never happened. Now ask a simple question: did that person remember getting lost? We want to say no. They did not remember it, because there was nothing to remember. They only seemed to remember it. They had a vivid experience with all the character of a memory, directed at an event that never occurred and a self that was never there.

So we need a distinction: between really remembering something and merely seeming to. Without it, Locke's whole account collapses at once, because false memories would manufacture false selves. If seeming to remember the prince's life were enough to make you the prince, then every deluded person who sincerely remembers being Napoleon would be Napoleon. No one accepts that. So memory makes you the past person only if it is a real memory, not a merely apparent one.

All right — what is the difference? What makes a memory real rather than merely apparent? Here the difficulty is fundamental, because the answer everyone reaches for is this: a real memory is a memory of something that actually happened to you. A memory you can trust is one where the remembered event is genuinely yours — where the person in the remembered scene, the one being flogged or holding the flag or lost in the shopping centre, really is you.

Read that back slowly, because the reasoning has become circular. We were using memory to explain what makes the past person you. And now, to say which memories count, we have had to help ourselves to the very thing we were explaining — we have said that a memory counts only if it is a memory of your own past. We defined the self in terms of memory, and then defined the right kind of memory in terms of the self. The thing to be explained is standing inside its own explanation. That is a circle, and nothing can be built on a circle. Joseph Butler saw this clearly — a bishop writing a few decades after Locke, in a short dissertation on personal identity appended to his Analogy of Religion in 1736. His charge was exactly this: being conscious of having done something presupposes that you did it, so consciousness cannot be what makes the deed yours. Memory can be a sign that you are the same person. It cannot be what makes you the same person, because it already assumes it.

This is a different objection from the brave officer. The brave officer was a problem about gaps — memories dropping out of the sequence — and one could imagine fixing it with a longer, more careful sequence. This is a problem about what the connections are made of. It says they were never joining two independent things in the first place. To pick out which experiences are yours to remember, you already had to know which person you are. Memory did not connect the child to you. It assumed, at every step, that the person at the far end was you — which is precisely what it was supposed to establish.

So lay the three objections against Locke's idea out at once, because it is now facing all of them together. Memory drops out in the middle of every ordinary life, and identity cannot drop in and out — that is the brave officer. The memories that remain can be fabrications indistinguishable from the real ones — that is last week. And the whole scheme runs in a circle, because one cannot say which memories are genuinely one's own without already knowing who one is — that is Butler. Three separate failures, and they do not share a cause. A view can usually survive one strong objection. Locke's is carrying three, from three directions.

And yet the idea is not dead. It is right about too much to discard. It got the exchanged soul right. It got the stroke right. It got the prince and the cobbler right; we still nod along when the person goes with the memories. Something close to Locke has to be true, because the alternatives we cleared at the start — same body, same soul — were worse. So the question is not whether to abandon Locke. It is whether what he was reaching for can be rebuilt without the part that keeps failing. Serious people think it can. Let us hear them out, and then see what the repair costs.

The repair begins by giving something up, and the giving-up is the clever part.

The modern defenders — the line called neo-Lockean, with Sydney Shoemaker near its centre and David Lewis developing the same ground in his own way — look at the brave officer and say: you are right, and the fix is to stop asking memory to do the impossible thing. Locke, read strictly, demanded that you, now, reach all the way back and directly own each past moment as yours. Drop that demand. Do not ask any single act of memory to span the whole life. Distinguish two things. There is direct memory-connection — whether you can, now, remember a particular past experience — and that plainly fades and breaks; you cannot now reach the four-year-old. But there is also continuity, which is a different relation: an overlapping series of those direct connections, each stretch of the life connected to the next, even when no single memory reaches from one end to the other. The old general cannot remember being the flogged boy directly. He does not have to. He remembers being the young officer; the officer remembered being the boy; each stage is connected to the one beside it, and that overlapping series is unbroken even though no single memory covers the whole distance. There is no gap, because we never required one memory to cross the whole life. Call it psychological continuity, and it genuinely resolves the brave officer. Identity holds — not because any one memory is long, but because the local connections never run out.

It has an answer to Butler as well — to the circle — and it deserves a fair hearing. The neo-Lockeans loosen what a connection even is. It need not be a memory of your own past, which was what reintroduced the self without acknowledgement. Let a connection be any psychological link carried forward by the ordinary causes — a memory, yes, but also a belief you still hold, an intention you formed and later act on, a persisting trait of character, a desire that carries over from yesterday to today. These overlap and continue whether or not one has already settled whose they are; they are simply the actual connections of a continuing mental life. Define the self by that — by broad continuity, rather than narrowly by memory of one's own deeds — and the circle loosens. Identity becomes the whole overlapping set of connections carried forward, not one special memory that had to know in advance whose it was.

This is a serious repair. Take it seriously. It survives the brave officer, it eases the circle, and it keeps everything Locke got right: you are still, fundamentally, on the side of the mind rather than the body or the soul; the person can still in principle come apart from the animal; the stroke and the exchanged soul still come out the way our intuitions wanted. If one came tonight wanting the Lockean picture to survive, it survives.

So why are we not finished? Why not stop here — Locke wounded, Locke repaired, the self secure after all?

Because it is worth looking hard at what the repair gave back to save the account. To survive the objections, it had to stop describing one thing and start describing another. You came in holding a felt conviction: that there is one you, single and entire and indivisible — the same whole self that was the child and is here now. That is what the account was meant to secure. And the repaired account does not secure that. It secures something adjacent to it: continuity — an overlapping set of connections, memory and belief and intention and habit, carried forward year by year. And those connections come in degrees. The ones tying you to yesterday are strong; the ones reaching back to the child are real but faint. That set of connections is genuine. You have it. But it is not the single indivisible self you came in certain of.

That is the cost, and it is not small, and I will not make it smaller than it is. The Lockean answer can be saved. But the version that survives no longer even attempts to hand you the one indivisible you. It describes the overlapping connections — and then it says nothing about whether, underneath them, there is also a single whole self to which the connections belong. And we are not entitled to fill that silence in either direction. Perhaps there is no such self — perhaps the connections are all there ever was. Or perhaps there is a deeper fact about you that this whole method, memory and continuity alike, was simply never built to detect — in which case its failure to appear in the argument counts nothing against it, because one was never going to find a thing of that kind by listing psychological connections. The repair cannot tell us which of those is true. What it can tell us is narrower and harder to set down: the best account of the self built out of one's remembered life cannot, on its own, deliver the single indivisible I one walked in sure of. You can keep the self. What you cannot keep, again, is the certainty that you already knew what it was.

So this is where tonight leaves us, one step beyond last week. Last week you lost the right to be sure of any single memory. Tonight you have watched the strongest account of what you are — the elegant idea that you simply are your remembered life — survive only by becoming something thinner and stranger than the solid self it was meant to defend. We have not said there is no self. We have said that the most appealing answer to what holds it together turns out to hold it together by an overlapping series of connections, not by the single unbroken thing you were picturing. And the next question is already waiting. If the self is held together by short overlapping connections, and not by one thing running the whole way, then perhaps the picture of a single connecting line was wrong from the start. Perhaps what carries across the gaps is not a connection of that kind at all. There is another answer waiting: that you are not a sequence of memories but a story you tell, and a story does not need every part to join to the next in the way a sequence does. A story can cross a gap. It can carry a childhood it does not remember. Next week we take that up — the self as a story you author, its real power, and the philosopher who argues that some of us are not telling one at all.

For now, do this with your own life, on the way out. Find the photograph — the early one, the child you cannot remember being. Try Locke's test honestly. Reach for her. And when the reaching comes up mostly empty, ask what you actually want to say. That she is not you — that you merely inherited her body? Or that she is you anyway — in which case it is not your memory making it so, because the memory is not there, and you are holding on to her by means of something you have not yet named. Whatever that something is, it is not the clean, single connection you assumed. You have been calling a small stranger by your own name your whole life, and tonight you have found that you were never quite sure on what authority.

Thanks for listening. I'll see you next time.

← Back to The Self Across Time Back to top ↑