{"id":3007,"date":"2023-03-31T14:29:23","date_gmt":"2023-03-31T14:29:23","guid":{"rendered":"https:\/\/iot-ngin.eu\/?p=3007"},"modified":"2023-04-04T08:15:21","modified_gmt":"2023-04-04T08:15:21","slug":"deploying-ml-models-on-drone-microcontroller-system","status":"publish","type":"post","link":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/","title":{"rendered":"Deploying ML models on Drone Microcontroller system"},"content":{"rendered":"\n<p>Crop diseases can be in many cases predicted or early detected using micro-climate measurements (mainly temperature and humidity in the air, the leaves, and the soil), crop image processing, and visual analytics (see <a href=\"https:\/\/link.springer.com\/chapter\/10.1007\/978-3-030-30241-2_11\">here<\/a>). Within IoT-NGIN \u201cSmart irrigation and precision aerial spraying\u201d, crop diseases prediction will be experimented, utilizing:<\/p>\n\n\n\n<ul class=\"ul-custom\"><li>microclimate measurements acquired via <a href=\"https:\/\/www.synfield.gr\/about\/\">Synelixis SynField\u00ae<\/a> &nbsp;precision agriculture IoT nodes,<\/li><li>images and real-time video analysis of the crop and the leaves captured from visual and multi-spectral cameras located on semi-autonomous drones flying over the orchard.<\/li><\/ul>\n\n\n\n<p>The ML-DRONE sub-project was accepted via the IoT-NGIN Project Open Call #1 in April 2022 and participates in the IoT-NGIN <strong><em>Smart Agriculture Living Lab<\/em><\/strong>. This use case aims to optimize precision aerial spraying based on real-time video analysis conducted at two levels: either locally (on the drone), based on already trained ML models, or remotely (at the edge) based on federated Machine Learning (ML). As a result of this ML processing, the drones are able to dynamically modify their trajectory, achieving optimal, precision aerial spraying limited only in areas of predicted\/ detected disease rather than the whole orchard.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/04\/droneField-1024x473.png\" alt=\"\" class=\"wp-image-3034\" width=\"625\" height=\"287\" srcset=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/04\/droneField-300x139.png 300w, https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/04\/droneField-600x277.png 600w\" sizes=\"(max-width: 625px) 100vw, 625px\" \/><\/figure><\/div>\n\n\n\n<p>More specifically, ML-DRONE is a solution to port ML models as open-source embedded software on <a href=\"https:\/\/acceligence.eu\/\">Acceligence<\/a> <a href=\"https:\/\/acceligence.eu\/products\/\">CERBERUS drone system<\/a><a><\/a> and then utilize it either as an IoT node with AI features or as an instantly deployed edge node. ML-DRONE evaluates the <a href=\"https:\/\/www.tensorflow.org\/lite\">TensorFlow Lite<\/a> and the <a href=\"https:\/\/github.com\/raspberrypi\/pico-tflmicro\">TensorFlow Lite Micro<\/a> systems, leveraging and expanding drone AI intelligence. The tool builds upon, combines, and expands existing embedded open-source implementations on the drone microprocessor system according to the needs and the resource availability. The final drone system, equipped with the AI module can be deployed, upon request, as an edge cloud resource in seconds, and via open APIs support additional IoT devices.<\/p>\n\n\n\n<p>Acceligence\u2019s ML-DRONE implementation is based on <a href=\"https:\/\/acceligence.eu\/products\/\">CERBERUS<\/a>, a fully customized Unmanned Aerial Vehicle (UAV) which is the company\u2019s best seller. CERBERUS is an octa-copter with the following characteristics:<\/p>\n\n\n\n<ul class=\"ul-custom\"><li>max thrust (nominal) 22.8 kg<\/li><li>vehicle mass approx. 7.5 kg<\/li><li>vehicle mass (batteries, camera &amp; companion computer included) approx. 10 kg<\/li><li>max take off weight (50% of max thrust) 11.4 kg<\/li><li>dimensions (between opposite rotor shafts) 1.26 m<\/li><li>flight time up to 40 min (depends on payload and wind)<\/li><li>flight radius with radio control: max 1500 m, with waypoints: it depends on power consumption, payload, and weather conditions operating<\/li><li>temperatures -10 to 45 \u00b0C.<\/li><\/ul>\n\n\n\n<p>Due to its optimized design, it has an extended flight time of up to 30 minutes, which is a substantial advantage when compared to conventional models currently available in the market, and a high-precision localization of 1cm using GPS-RTK2. The drone is able to accommodate the various hardware components (e.g., height\/ distance sensors, cameras) in order to execute smart algorithms (e.g., visual object detection and collision avoidance services, algorithms for swarming), and generally to be easily adapted to the current operation by the user. In addition, CERBERUS UAV is one of the first UAV with a separate onboard computer with an embedded Jetson Xavier processor, running the latest version of Robot Operating System (ROS) in order to host Artificial Intelligence (AI) algorithms for object detection and identification for edge processing. CERBERUS Mission UAV is capable to perform on-board image processing, making use of machine learning-based techniques, and more precisely Deep Neural Networks (DeepNN) and Convolutional Neural Networks (CNN) exploiting the data (e.g., 2D\/ 3D images\/ point clouds) obtained from the various aforementioned sensory inputs.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"943\" height=\"325\" src=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml2.png\" alt=\"\" class=\"wp-image-3010\" srcset=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml2.png 943w, https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml2-300x103.png 300w, https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml2-768x265.png 768w, https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml2-600x207.png 600w\" sizes=\"(max-width: 943px) 100vw, 943px\" \/><figcaption><br>Figure 1: CERBERUS Mission UAV high level architecture, \u00a9 Acceligence Ltd.<\/figcaption><\/figure><\/div>\n\n\n\n<p>The goal is to have an Autonomous Flying Drone (AFD), which is able to move autonomously within a field, inspecting various crops. The service is based on an ML model for object detection, which has been trained and stored in the MLaaS model storage. The model is still in early development and will be further enhanced with the availability of datasets from the pilot site. The AFD service is intended to run on the drone, together with the trained model. Based on the ML predictions regarding the detection of trees, the AFD service will trigger control actions on the Drone, leading to a change in the Drone flight trajectory, in order to avoid the potential collision, but also to be able to reach the set destination.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"604\" height=\"186\" src=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml3.png\" alt=\"\" class=\"wp-image-3011\" srcset=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml3.png 604w, https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml3-300x92.png 300w, https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/ml3-600x185.png 600w\" sizes=\"(max-width: 604px) 100vw, 604px\" \/><figcaption>Figure 2: Autonomous Flight Drone (AFD) microservice demonstration, \u00a9 Acceligence Ltd.<\/figcaption><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-center\"><\/p>\n\n\n\n<div style=\"height:100px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Crop diseases can be in many cases predicted or early detected using micro-climate measurements (mainly temperature and humidity in the air, the leaves, and the soil), crop image processing, and visual analytics (see here). Within IoT-NGIN \u201cSmart irrigation and precision &hellip;<\/p>\n","protected":false},"author":2,"featured_media":3032,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[17],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v17.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Deploying ML models on Drone Microcontroller system - IOT NGIN<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deploying ML models on Drone Microcontroller system - IOT NGIN\" \/>\n<meta property=\"og:description\" content=\"Crop diseases can be in many cases predicted or early detected using micro-climate measurements (mainly temperature and humidity in the air, the leaves, and the soil), crop image processing, and visual analytics (see here). Within IoT-NGIN \u201cSmart irrigation and precision &hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/\" \/>\n<meta property=\"og:site_name\" content=\"IOT NGIN\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-31T14:29:23+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-04T08:15:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/iot-1-576x1024.png\" \/>\n\t<meta property=\"og:image:width\" content=\"576\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Giannis Tsichlas\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/iot-ngin.eu\/#website\",\"url\":\"https:\/\/iot-ngin.eu\/\",\"name\":\"IOT NGIN\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/iot-ngin.eu\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/iot-1.png\",\"contentUrl\":\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/iot-1.png\",\"width\":1500,\"height\":2667},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#webpage\",\"url\":\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/\",\"name\":\"Deploying ML models on Drone Microcontroller system - IOT NGIN\",\"isPartOf\":{\"@id\":\"https:\/\/iot-ngin.eu\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#primaryimage\"},\"datePublished\":\"2023-03-31T14:29:23+00:00\",\"dateModified\":\"2023-04-04T08:15:21+00:00\",\"author\":{\"@id\":\"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1\"},\"breadcrumb\":{\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/iot-ngin.eu\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deploying ML models on Drone Microcontroller system\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1\",\"name\":\"Giannis Tsichlas\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/iot-ngin.eu\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g\",\"caption\":\"Giannis Tsichlas\"},\"url\":\"https:\/\/iot-ngin.eu\/index.php\/author\/tsichlas\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deploying ML models on Drone Microcontroller system - IOT NGIN","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/","og_locale":"en_US","og_type":"article","og_title":"Deploying ML models on Drone Microcontroller system - IOT NGIN","og_description":"Crop diseases can be in many cases predicted or early detected using micro-climate measurements (mainly temperature and humidity in the air, the leaves, and the soil), crop image processing, and visual analytics (see here). Within IoT-NGIN \u201cSmart irrigation and precision &hellip;","og_url":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/","og_site_name":"IOT NGIN","article_published_time":"2023-03-31T14:29:23+00:00","article_modified_time":"2023-04-04T08:15:21+00:00","og_image":[{"width":576,"height":1024,"url":"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/iot-1-576x1024.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"Giannis Tsichlas","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/iot-ngin.eu\/#website","url":"https:\/\/iot-ngin.eu\/","name":"IOT NGIN","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/iot-ngin.eu\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"ImageObject","@id":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#primaryimage","inLanguage":"en-US","url":"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/iot-1.png","contentUrl":"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2023\/03\/iot-1.png","width":1500,"height":2667},{"@type":"WebPage","@id":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#webpage","url":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/","name":"Deploying ML models on Drone Microcontroller system - IOT NGIN","isPartOf":{"@id":"https:\/\/iot-ngin.eu\/#website"},"primaryImageOfPage":{"@id":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#primaryimage"},"datePublished":"2023-03-31T14:29:23+00:00","dateModified":"2023-04-04T08:15:21+00:00","author":{"@id":"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1"},"breadcrumb":{"@id":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/iot-ngin.eu\/index.php\/2023\/03\/31\/deploying-ml-models-on-drone-microcontroller-system\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/iot-ngin.eu\/"},{"@type":"ListItem","position":2,"name":"Deploying ML models on Drone Microcontroller system"}]},{"@type":"Person","@id":"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1","name":"Giannis Tsichlas","image":{"@type":"ImageObject","@id":"https:\/\/iot-ngin.eu\/#personlogo","inLanguage":"en-US","url":"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g","caption":"Giannis Tsichlas"},"url":"https:\/\/iot-ngin.eu\/index.php\/author\/tsichlas\/"}]}},"cc_featured_image_caption":{"caption_text":"","source_text":"","source_url":""},"_links":{"self":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts\/3007"}],"collection":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/comments?post=3007"}],"version-history":[{"count":6,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts\/3007\/revisions"}],"predecessor-version":[{"id":4053,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts\/3007\/revisions\/4053"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/media\/3032"}],"wp:attachment":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/media?parent=3007"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/categories?post=3007"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/tags?post=3007"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}