We found novel evidence that APOE ɛ4 worsened age-related ODI decreases in brain regions typically associated with atrophy patterns of Alzheimer’s disease. Here, APOE is linked to Atrophy.