Sindre
February 19, 2025, 12:28pm
2
Hi, I’m trying to add neural network support for px4 to lower the barrier for using RL on UAVs in research. I have some make problems, and was wondering if someone could help me. I will be attending the sync call.
main ← SindreMHegre:neural_control_with_tflm
opened 12:23PM - 19 Feb 25 UTC
### Solved Problem
Using neural networks for various tasks on UAVs in research … is becoming more and more commonplace. My aim is to provide a module that can be used to replace the MC controller with NN to lower the barrier for using RL and NN on UAVs in general, and give researchers and hobbyist a place to start for NN use.
### Solution
- Add TensorFlow Lite Micro as an inference lib into PX4
- Make custom board configs with neural controllers
- Make a module for NN control
### Changelog Entry
For release notes:
```
Feature/Bugfix XYZ
New parameter: XYZ_Z
Documentation: Need to clarify page ... / done, read docs.px4.io/...
```
### Alternatives
We could also use Eigen or executorch
### Test coverage
- Built and tested SITL
- Passed all PR cheks when commited on v1.15.3
### Context
Related links, screenshot before/after, video
