APOE ε4 is associated with faster cognitive decline in old age, but this is driven by Alzheimer’s disease neuropathological burden. This evidence concerns the gene APOE and early-onset autosomal dominant Alzheimer disease.