Horizontally drifting away while landing in RTL mode

Hello everyone!

I have little problem with landing in my multicopter.

During RTL, after approaching the target horizontal position, multicopter starts descending.
But at the early stage of the descending, the multicopter drifts away(position control seems not working) for a while and returns back to its home position. (It seems, it may crash.)
This happens time to time.

Does anyone know how to fix this problem ?

Here is my flight log : https://logs.px4.io/plot_app?log=f1ab8a6a-e60c-4026-987e-d2dc6aa1cca7