Nothing special
One hypothesis is that being in a down-entropy fluctuation will not seem special because the thermodynamic and psychological arrows are aligned. Some like Boltzmann (see citation) appear to have just assumed this. Others have tried to show it formally (follow cross-link).