DronePaint: Swarm Light Painting with DNN-based Gesture Recognition – SIGGRAPH 2021, Emerging Technologies
Authors: Valerii Serpiva , Ekaterina Karmanova , Aleksey Fedoseev , Stepan Perminov , Dzmitry Tsetserukou
Abstract:
We propose a novel human-swarm interaction system, allowing the user to directly control a swarm of drones in a complex environment through trajectory drawing with a hand gesture interface based on the DNN-based gesture recognition.
The developed CV-based system allows the user to control the swarm behavior without additional devices through human gestures and motions in real-time, providing convenient tools to change the swarm’s shape and formation. The two types of interaction were proposed and implemented to adjust the swarm hierarchy: trajectory drawing and free-form trajectory generation control.
Keyword: Human-Drone Interaction, Light Painting, Gesture Recognition, Deep Neural Network
