Refrigerator objection
There is no evidence that the psychological arrow, indicated by the direction of remembering, reverses when an observer is placed in a decreasing-entropy environment. We don't start remembering the future when sitting in a refrigerator - or more prosaically - an air-conditioned room.