I think I have found the solution to this problem ,
-
Check if your drone is 3D locked
-
Decrease your hover throttle to 30% in tuning .
-
Check Hold flight mode , if it is holding position properly then point no 2 will solve the problem in position hold mode.
-
I would also recommend you to decrease your p roll and pitch rate in pid tuning to increase stability