These results suggest that APOE-ɛ4 and AD-PRS independently and additively influence longitudinal declines in brain volumes sensitive to Alzheimer’s disease and synergistically increase white matter hyperintensity accumulation among cognitively normal individuals. Here, APOE is linked to Alzheimer disease.