Regard mind's eye as a classification scheme
The mind's eye need not be interpreted as a location in space. The mind's eye is better thought of as a processor (or visual buffer) that interprets sensory information in a series of stages.
In the process of interpretation, sensory information is classified into conceptual categories the correlated with objects and their properties.
Stephen Kosslyn and James Pomerantz, 1977.