This cohort study highlights a significant association between hearing loss and smaller brain volume, with an accelerated accrual of white matter abnormalities, an accelerated decline in executive function, and a near tripling of dementia risk among persons carrying an APOE ε4 allele that is partially mitigated by hearing aid use. This evidence concerns the gene APOE and dementia.