de Silva et al. report that in subjects with mild cognitive impairment, a coronary artery disease-polygenic risk score is more strongly associated with whole-brain volume atrophy than an Alzheimer’s disease-polygenic risk (excluding the APOE region). Here, APOE is linked to early-onset autosomal dominant Alzheimer disease.