Colored collapse models from the non-interferometric perspective