User Tools

Site Tools


drones:mini_drones:start

This is an old revision of the document!


Object Detection with Mini Drones

Tello drone video stream used as input for NVIDIA Jetson Object Detection.
Object Detection - Demo Video Person tracking - Demo Video

Description

The Tello drone changes own angle to keep the detected person close to the center of camera viewpoint. If there are more than one person, the one is chosen, which is closer to the camera. The calculation of the closest person is done through detection area comparison in order to select the detection with the biggest area.

Used libraries

In order to control and detect objects a several Python libraries were used. To control the drone, the Tello library [1] was imported and applied to send basic movement and streaming commands. The object detection was implemented by using standard jetson.inference [2] module. The output of camera and key controls was implemented via OpenCV library [3].

PID Controller

To make the process of changing yaw angle smoother, the PID Controller mechanism was implemented in Python. The values of P and D were adjusted during experiment for the given image parameters. More about it you can read here https://en.wikipedia.org/wiki/PID_controller

The motivation for this experiment were the numerous public papers and Youtube videos. Particularly, the videos of Murtaza (https://youtube.com/playlist?list=PLMoSUbG1Q_r8ib2U4AbC_mPTsa-u9HoP_) were used as for PID implementation.

The code is published for open access on GitHub under the link: https://github.com/eligosoftware/ryzetellohsrw. The main python file is https://github.com/eligosoftware/ryzetellohsrw/blob/main/move_head.py

More on Mini-Drones and Object Detection

Mini Drones

1. Educational Drone 1,
Parrot Mambo (discontinued)
2. Educational Drone 2,
Ryze Tello EDU
drones/mini_drones/start.1645016928.txt.gz · Last modified: 2022/02/16 14:08 by rolf001