Can you inspect the position data without the propellers on? Just move the drone manually. Can you cause the tracking to break? In QGC, go to Inspect>Analyze and look at the Vision messages. ATTITUDE and rate messages can be a good indicator of a problem (i.e. reversed coordinate).
What tracking system are you using? You need something quite precise, <1 cm resolution.