Current studies have not consistently shown hippocampal atrophy in APOE4 carriers, in the absence of overt AD pathology. Here, APOE is linked to hippocampal atrophy.