How can we leverage the power of TinyML to unlock novel applications with constrained flying robots?
In our recent work, we present fully autonomous source seeking onboard a highly constrained nano quadcopter, by contributing application-specific system and observation feature design to enable inference of a deep-RL policy onboard a nano quadcopter. We verify our approach with simulation and in-field testing on a Bitcraze CrazyFlie, a 30g nano quadcopter, using only the cheap and ubiquitous Cortex-M4 microcontroller unit.
We show how ML can be a critical component in application-specific system design for robotics, as our model learns to use lightweight and cheap sensors instead of heavy and expensive cameras. Deploying TinyML onboard a flying robot poses a unique set of challenges, such as severe payload and endurance constraints. Contrary to most TinyML applications, the weight of compute is much more important than its power consumption: every gram counts!
We would love to hear your feedback on this project, that is currently under review at ICRA.