Psychological experiments indicate that mental images are more difficult to reinterpret than physical drawings. This difficulty is often attributed to various limitations of the mental image and/or mental image fading. However, experiments indicate that additional, non-visual factors might be involved. In view of this, we propose a model of mental image reinterpretation which focuses on the interaction between conceptual and visual information in the cognitive system. Simulations of this model support our hypothesis that reinterpretations are inhibited when the presently held interpretation is kept within focus of attention. Also, it appears that the mental image itself can inhibit the reinterpretation process in cases when potential new interpretations do not match well with the mental image.