User Tools

Site Tools


drones:mini_drones:start

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
drones:mini_drones:start [2022/02/16 14:08] rolf001drones:mini_drones:start [2022/08/11 16:29] (current) – [Table] rolf001
Line 1: Line 1:
 ~~NOTOC~~ ~~NOTOC~~
-====== Object Detection with Mini Drones ====== +====== Mini Drones ======
- +
- +
- +
-|  {{drones:mini_drones:od_tello_jetson.png?800}}  || +
-|  Tello drone video stream used as input for NVIDIA Jetson Object Detection.  || +
-|  {{ :drones:mini_drones:initial_test_tello_jetson.mp4?400 |}}  |  {{ :drones:mini_drones:person-tracking-demo01.mp4?400 |}}  | +
-| Object Detection - Demo Video | Person tracking - Demo Video | +
- +
-|  {{:drones:mini_drones:banner-tello-jetson.jpg?800|}}  || +
- +
-=== Description === +
- +
-The Tello drone changes own angle to keep the detected person close to the center of camera viewpoint. If there are more than one person, the one is chosen, which is closer to the camera. The calculation of the closest person is done through detection area comparison in order to select the detection with the biggest area. +
- +
-=== Used libraries === +
- +
-In order to control and detect objects a several Python libraries were used. To control the drone, the Tello library [1] was imported and applied to send basic movement and streaming commands. The object detection was implemented by using standard jetson.inference [2] module. The output of camera and key controls was implemented via OpenCV library [3]. +
- +
-=== PID Controller === +
- +
-To make the process of changing yaw angle smoother, the PID Controller mechanism was implemented in Python. The values of P and D were adjusted during experiment for the given image parameters. More about it you can read here https://en.wikipedia.org/wiki/PID_controller +
- +
- +
-The motivation for this experiment were the numerous public papers and Youtube videos. Particularly, the videos of Murtaza (https://youtube.com/playlist?list=PLMoSUbG1Q_r8ib2U4AbC_mPTsa-u9HoP_) were used as for PID implementation. +
- +
-The code is published for open access on GitHub under the link: https://github.com/eligosoftware/ryzetellohsrw. The main python file is https://github.com/eligosoftware/ryzetellohsrw/blob/main/move_head.py +
-=== External links === +
- +
-1. Tello library GitHub https://github.com/harleylara/tello-python\\ +
-2. Jetson Inference GitHub https://github.com/dusty-nv/jetson-inference\\ +
-3. OpenCV https://opencv.org/\\ +
- +
- +
- +
- +
- +
-/* +
-===== Communication Overview ===== +
- +
-{{ :drones:mini_drones:od_tello_jetson.png?800 |}} +
- +
-*/ +
- +
-===== More on Mini-Drones and Object Detection ===== +
- +
-  * [[https://randomnerdtutorials.com/esp32-cam-video-streaming-face-recognition-arduino-ide/|ESP32-CAM Video Streaming and Face Recognition with Arduino IDE]] +
-  * [[https://www.youtube.com/watch?v=NfWd9Kn30i0|Building an ESP32-CAM based recon drone from Rainbow Six Siege]] +
- +
-==== ESP related projects ==== +
- +
-  * [[https://espressif-docs.readthedocs-hosted.com/projects/espressif-esp-drone/en/latest/index.html|ESP-Drone]], official project by ESPRESSIF +
- +
-  * [[https://espcopter.com/|Meet ESPcopter]], main website +
-  * [[http://store.espcopter.com/|ESPcopter store]] +
- +
- +
-==== Mini Drones ==== +
- +
-| {{youtube>pS7g_c6DbaM?300}}                                                                                                                                    | {{youtube>FVYxxHn8R-k?300}}                                                                                     | +
-| **1. Educational Drone 1**, \\ Parrot Mambo (discontinued)                                                                                                     | **2. Educational Drone 2**, \\ Ryze Tello EDU                                                                   |+
  
 +^ Page                                                                                        ^ Image                                                                                                   ^
 +| [[drones:mini_drones:od_tello|Object Detection with Mini Drones]]                           | [[drones:mini_drones:od_tello|{{ :drones:mini_drones:od_tello_jetson.png?250 }}]]                       |
 +| [[drones:mini_drones:snap_tello|Mini Drones and Snap!]]                                     | [[drones:mini_drones:snap_tello|{{ :drones:mini_drones:snap-tello.jpg?250 }}]]                          |
 +| [[drones:mini_drones:snap_tello_object_detection|Mini Drones, Snap! and Object Tracking!]]  | [[drones:mini_drones:snap_tello_object_detection|{{ :drones:mini_drones:snap-tello-jetson.jpg?250 }}]]  |
 +| [[drones:mini_drones:jetbot-and-snap!|Jetbot and Snap!]]                                    | [[drones:mini_drones:jetbot-and-snap!|{{:drones:mini_drones:jetbot.jpg?200&direct }}]]                  |
 +| [[drones:mini_drones:snapcon2022-documentation|Snap!Con 2022 Documentation]]                | [[drones:mini_drones:jetbot-and-snap!|{{:drones:mini_drones:jetbot.jpg?200&direct }}]]                  |
 +| [[drones:mini_drones:tello:opencv:start|Tello OpenCV]]                                      |                                                                                                         |
drones/mini_drones/start.1645016928.txt.gz · Last modified: 2022/02/16 14:08 by rolf001