In this population-based cohort study, we found that approximately one-fourth of the effect of APOE ε4 on cognition is mediated by structural brain imaging markers, mainly driven by the presence of cerebral microbleeds. Here, APOE is linked to cerebral microbleeds.