The spectral anatomy of plasticity loss