Neighborhood age structure is related to cognitive function among adults over 50. Neighborhood social factors explain some of this relationship. Neighborhood socioeconomic status does little to explain this relationship. Neighborhood social factors may be a policy lever for improving cognitive health.