Despite having received more attention over the past few years, Wittgenstein's phenomenology is still one of the least understood aspects of his philosophical work. While it is widely accepted that it only represented a short-lived phase (1929–1933)—disappearing after the "The Big Typescript"—his analysis and statements in Remarks on Colour are not only intriguing, but call for a re-examination of this view. In this contribution, I will use his analysis of color in Remarks on Colour in order to reassess the relationship and development of his earlier work on grammar and phenomenology to his later thoughts and investigations, thereby addressing the question whether he actually gave up on phenomenology or, as Spiegelberg contends, Wittgenstein's phenomenology simply "went underground.'