Here, we tested the impact of APOE-ε4 and two other risk factors, a family history of dementia and obesity, on grey matter macro- and microstructure across the whole brain in 165 asymptomatic individuals (38–71 years). Here, APOE is linked to obesity due to melanocortin 4 receptor deficiency.