After doing some Investigation I think I figured the main problem:
It was caused by high IMU_GYRO_CUTOFF/ MC_DTERM_CUTOFF parameters