ip:ws2021:lets_plaiy:student-documentation:object-detection:start
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
ip:ws2021:lets_plaiy:student-documentation:object-detection:start [2022/01/12 13:49] – [NVIDIA Jetson Object Detection] vipul001 | ip:ws2021:lets_plaiy:student-documentation:object-detection:start [2022/02/27 23:47] (current) – [3.2 Projects and Capabilities] shashank001 | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Object Detection ====== | + | ====== |
- | ===== Introduction ===== | ||
- | ---- | ||
- | Artificial intelligence is a prevailing technology entails both opportunities and risks to society and the | ||
- | environment. It is crucial for students to acquire these competences in school, enabling them to | ||
- | master the technology at an early age. This allows them to avoid being dominated by AI; to demystify AI; and to develop the ability for critical reflection in assessing opportunities, | ||
- | limits of AI for problem solving. | ||
- | \\ \\ | ||
- | The usability of many AI toolkits is continuously improving. They require less and less expert | ||
- | knowledge to utilize them effectively. This simplification can be taken further. The material we | ||
- | develop should be suited for children from 12 - 14 years. We have to hide the complexity of AI in the | ||
- | background and provide easy to use programming and user interfaces as frontends. An option we | ||
- | will investigate, | ||
- | Scratch, and Micro Blocks to control AI enabled embedded computers. | ||
- | \\ \\ | ||
- | The training material to be created focuses on education for sustainable development and other | ||
- | applications oriented towards the common good. Concrete examples are biodiversity monitoring by | ||
- | detecting plant and animal species with robot-borne computer vision and deep learning. | ||
- | \\ \\ | ||
- | We will develop a course curriculum and tutorial material (brain ware), as well as hardware and | ||
- | software for AI-enabled small wheeled robots and tiny DIY drones to be used in education. The open | ||
- | course-ware will be provided and promoted appropriately. The ultimate goal is to design and | ||
- | implement course materials (brain ware, hardware, software) for teaching AI in schools | ||
- | ===== Motivation===== | ||
- | ---- | ||
- | AI, or Artificial Intelligence, | ||
- | by simulating routine human response patterns. | ||
- | Technology in its current form is no longer confined to science fiction authors' | ||
- | is moving into our everyday lives in subtle or not so subtle ways. The technology is now all pervasive, from aiding in weather forecasts, recommending shows on Netflix, filtering spam | ||
- | emails, enabling search predictions in Google, and voice recognition, | ||
- | everywhere. | ||
- | \\ \\ | ||
- | A technology which has a vast scope of growth attach to it, needs to work around minds who | ||
- | thought limitless of what one can imagine, and such a thought process lies mostly in kids, who | ||
- | with their creativity come up with vivid ideas. So a closer look to what A.I is and building a basic | ||
- | understanding in kids, not only by means of information but making them practically playing | ||
- | around with it by means of Snap and NVIDIA Jetson. This will set them on the ground of A.I | ||
- | understanding its working, limitation and capabilities. | ||
- | ====== Begin to Plaiy====== | ||
---- | ---- | ||
- | === NVIDIA Jetson Object Detection === | + | |
+ | === 3.1 NVIDIA Jetson Object Detection === | ||
Jetson Nano is a small, powerful computer that lets you run multiple neural networks in | Jetson Nano is a small, powerful computer that lets you run multiple neural networks in | ||
Line 72: | Line 35: | ||
- | ===== Teaser ===== | ||
- | ---- | ||
- | === Activity | + | |
+ | === 3.2 Activity=== | ||
- Form of group of 10 students and provide them a Nano Jetson kit. | - Form of group of 10 students and provide them a Nano Jetson kit. | ||
- Ask them to start collecting objects around them, which ever they want to be detected. Additionally, | - Ask them to start collecting objects around them, which ever they want to be detected. Additionally, | ||
- | - Students should bring the objects in front of the Jetson camera and see the output on the screen. | + | - Students should bring the objects in front of the Jetson camera and see the output on the screen. |
+ | bash docker/ | ||
+ | detectnet csi:// | ||
+ | - Finally, noting down if their object is detected correctly or not by the Jetson Nano. | ||
After completing the following activity, they should answer the following questions: | After completing the following activity, they should answer the following questions: | ||
Line 86: | Line 51: | ||
- What were their thoughts about A.I earlier and now? | - What were their thoughts about A.I earlier and now? | ||
- Did they enjoy this activity? | - Did they enjoy this activity? | ||
- | === Brain Storming === | + | === 3.3 Brain Storming === |
* Ready to use Jetson Object detector | * Ready to use Jetson Object detector | ||
* What does AI know | * What does AI know | ||
Line 95: | Line 60: | ||
+ | |{{: | ||
+ | ^Figure 2: Banana being detected ^ | ||
+ | |||
+ | |||
+ | | {{: | ||
+ | ^ Figure 3: Apple being detected | ||
- | === Ready to use object detection === | + | === 3.4 Ready to use object detection === |
As the students assemble in groups and are given the NVIDIA Jetson, at first glance it is evident that they would be enthusiastic to see the objects they show on the screen be recognized. They would be provided, or asked to bring, some toys, fruits and other objects to test the working of the Jetson. Using the interface of Snap!, which makes it easier for the students to operate. A block is clicked that captures an image on the stage of Snap! and is recognized by the click of another block. A text-to-speech generator is then activated that narrates the classified object, aloud. This is done several times and a challenge is issued by the teacher to try to trick the Jetson into guessing the wrong object. | As the students assemble in groups and are given the NVIDIA Jetson, at first glance it is evident that they would be enthusiastic to see the objects they show on the screen be recognized. They would be provided, or asked to bring, some toys, fruits and other objects to test the working of the Jetson. Using the interface of Snap!, which makes it easier for the students to operate. A block is clicked that captures an image on the stage of Snap! and is recognized by the click of another block. A text-to-speech generator is then activated that narrates the classified object, aloud. This is done several times and a challenge is issued by the teacher to try to trick the Jetson into guessing the wrong object. | ||
- | === what does AI know? (capabilities) === | + | === 3.5 what does AI know? (capabilities) === |
AI is Artificial Intelligence, | AI is Artificial Intelligence, | ||
- | === Limitations and boundaries === | + | === 3.6 Limitations and boundaries === |
Since the camera that is used is just a simple webcam that is integrated to the PC. This restricts the students into only a confined region in front of the PC. As the Jetson is connected to the PC, the only available objects that they can allow the Jetson to identify are the ones that that are of reach only at the moment. Since we are using COCO dataset for our object detection, this brings us another limitation. | Since the camera that is used is just a simple webcam that is integrated to the PC. This restricts the students into only a confined region in front of the PC. As the Jetson is connected to the PC, the only available objects that they can allow the Jetson to identify are the ones that that are of reach only at the moment. Since we are using COCO dataset for our object detection, this brings us another limitation. | ||
Line 114: | Line 85: | ||
effort and lengthy approach but do make the dataset more capable. | effort and lengthy approach but do make the dataset more capable. | ||
- | === Examples === | + | === 3.7 Examples === |
Once the students have enjoyed playing around with the Jetsons and have had a few objects classified, Assuming that its the first time they have seen objects being classified instantly with their bounding boxes shown, they would be filled with enthusiasm. To this enthusiasm, AI is introduced to them through a YouTube video and an explanation as to how they are identified using the coco dataset is made. Without going too deep into the technical information, | Once the students have enjoyed playing around with the Jetsons and have had a few objects classified, Assuming that its the first time they have seen objects being classified instantly with their bounding boxes shown, they would be filled with enthusiasm. To this enthusiasm, AI is introduced to them through a YouTube video and an explanation as to how they are identified using the coco dataset is made. Without going too deep into the technical information, |
ip/ws2021/lets_plaiy/student-documentation/object-detection/start.1641991789.txt.gz · Last modified: 2022/01/12 13:49 by vipul001