We Have Only What We Remember