Associations of APOE genotype and memory decline with Aβ accumulation and GM atrophy were examined separately for each neuroimaging modality, controlling for baseline Aβ levels and diagnosis. Here, APOE is linked to Atrophy.