I would give it a try and see if you still find it complicated.
Typically I only use 2 switches.
1 main mode switch (3 positions) - STABILIZED / ALTITUDE CONTROL / MISSION (configure as desired)
1 RTL switch (2 position) - my emergency switch that overrides the others
Depending on the situation I either pull the main switch all the way towards me for a manual mode, or flip into RTL.
For anything more complicated you can connect a phone/tablet/computer and change modes through QGroundControl.