In The Blue Book, Wittgenstein defined a category of uses of “I” which he termed “I”-as-subject, contrasting them with “I”-as-object uses. The hallmark of this category is immunity to error through misidentification (IEM). This article extends Wittgenstein’s characterisation to the case of memory-judgments, discusses the significance of IEM for self-consciousness—developing the idea that having a first-person thought involves thinking about oneself in a distinctive way in which one cannot think of anyone or anything else—and refutes a common objection to the claim that memory-judgments exhibit IEM.