Fermionic zero modes and violation of the fluctuation-dissipation theorem