In this population-based cohort study, we found that an estimated one-fourth of the effect of APOE ε4 on cognition is mediated by structural brain imaging markers, driven mainly by cerebral microbleeds. This evidence concerns the gene APOE and cerebral microbleeds.