Colcon-build fails when trying to run the offboard control example

I am trying to follow the offboard-control PX4 example from ARK electronics (

When I get to the part where I have to run colcon-build I get this error: ModuleNotFoundError: No module named ‘em’ The Python package ‘empy’ must be installed

I looked online to see if there is a fix, and I tried installing em then removing empy and vice versa, I also tried installing an older version of empy (<4) but nothing seems to work. I have been trying to figure this out for like 4 hours now, please help.