Reversal of memory accretion would presumably involve erasing newly added memories back to some point. Were this to occur, this process would be undetectable to the observer whose memories had been so affected.