Drone flies away during RTL

Firmware version: 1.9.2 with slight modifications (but nothing RTL related)

We have observed this behaviour now a couple of times: After triggering RTL the drone flies over its destination point, but breaks out a few meters to north-east. This behaviour can be seen in the local position x and local position y graphs in Flight Review where the estimated (=percepted by us!) deviates from the setpoint.

Another such flight is Flight Review

Is there any sensor error responsible for that? Or is there something wrong with RTL?