Identifying the Hamiltonian structure in linear response theory