This population-based prospective cohort study demonstrates that trajectories of plasma GFAP and NfL are associated with brain atrophy, impaired white matter microstructure integrity, and accelerated cognitive decline in middle-aged and older adults, and that cognitive reserve can modify the associations between these plasma biomarkers and cognitive phenotypes. Here, NEFL is linked to Brain atrophy.