APOE and AD-PRS associations with MRI measures did not differ by sex. Here, APOE is linked to Alzheimer disease.