{"id":1940,"date":"2021-11-25T15:07:34","date_gmt":"2021-11-25T15:07:34","guid":{"rendered":"https:\/\/iot-ngin.eu\/?p=1940"},"modified":"2021-11-25T15:07:35","modified_gmt":"2021-11-25T15:07:35","slug":"gpu-passthrough-in-openstack","status":"publish","type":"post","link":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/","title":{"rendered":"GPU passthrough in OpenStack"},"content":{"rendered":"\n<p><a href=\"https:\/\/www.kubeflow.org\/\">Kubeflow<\/a>&nbsp;is an extraordinary framework essentially allowing the emergence of MLOps or ML as a Service (MLaaS) modalities. It is readily integrated into the overall concept, context and operations of Kubernetes, rendering a perfect match for ML engineers that need to have their ML pipelines scaled at cloud level. But what happens in the context of hybrid clouds, when a graphics card is attached to a server not directly participating in a Kubernetes deployment?<\/p>\n\n\n\n<p>Deep Learning models can be trained faster by simply running all operations at the&nbsp;same time&nbsp;instead of one after the other. GPUs are optimized for training artificial intelligence and deep learning models as they can&nbsp;<em>process multiple computations<\/em>&nbsp;simultaneously.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.synelixis.com\/\"><em>Synelixis<\/em><\/a><em>\u2019s&nbsp;<\/em>mini-cloud infrastructure consists of an on-premises bare-metal Kubernetes cluster comprising multiple nodes accompanied by a disjoint OpenStack installation hosted on a single server (yes, VMs are really needed even nowadays ?). In the context of the&nbsp;<a href=\"https:\/\/iot-ngin.eu\/\">IoT-NGIN<\/a>&nbsp;project, we faced the need to introduce a new Kubernetes node with specialized hardware allowing Data Scientists and ML Engineers run workflows upon (effectively implementing MLaaS). Reading the documentation of Kubeflow &amp; Kubernetes, everything seemed to be well thought of and straightforward, except for one thing; the GPU would need to be attached to a server-part of the Kubernetes cluster. In our case, however, this was not the case; the GPU was attached to the OpenStack server and could not be relocated. Consequently, we had to create a VM inside the OpenStack environment, with the GPU attached, then donate this VM to our hungry Kubernetes installation.<\/p>\n\n\n\n<p>If you are interested in experimenting GPU passthrough in OpenStack, you can find a complete guide <a href=\"https:\/\/medium.com\/@thomasal14\/gpu-passthrough-in-openstack-da2a98a16f7b\">here<\/a>.<\/p>\n\n\n\n<div style=\"height:100px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Kubeflow&nbsp;is an extraordinary framework essentially allowing the emergence of MLOps or ML as a Service (MLaaS) modalities. It is readily integrated into the overall concept, context and operations of Kubernetes, rendering a perfect match for ML engineers that need to &hellip;<\/p>\n","protected":false},"author":2,"featured_media":1944,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[17],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v17.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>GPU passthrough in OpenStack - IOT NGIN<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"GPU passthrough in OpenStack - IOT NGIN\" \/>\n<meta property=\"og:description\" content=\"Kubeflow&nbsp;is an extraordinary framework essentially allowing the emergence of MLOps or ML as a Service (MLaaS) modalities. It is readily integrated into the overall concept, context and operations of Kubernetes, rendering a perfect match for ML engineers that need to &hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/\" \/>\n<meta property=\"og:site_name\" content=\"IOT NGIN\" \/>\n<meta property=\"article:published_time\" content=\"2021-11-25T15:07:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-11-25T15:07:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2021\/11\/kubernetesmaster.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1113\" \/>\n\t<meta property=\"og:image:height\" content=\"412\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Giannis Tsichlas\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/iot-ngin.eu\/#website\",\"url\":\"https:\/\/iot-ngin.eu\/\",\"name\":\"IOT NGIN\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/iot-ngin.eu\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2021\/11\/kubernetesmaster.png\",\"contentUrl\":\"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2021\/11\/kubernetesmaster.png\",\"width\":1113,\"height\":412},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#webpage\",\"url\":\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/\",\"name\":\"GPU passthrough in OpenStack - IOT NGIN\",\"isPartOf\":{\"@id\":\"https:\/\/iot-ngin.eu\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#primaryimage\"},\"datePublished\":\"2021-11-25T15:07:34+00:00\",\"dateModified\":\"2021-11-25T15:07:35+00:00\",\"author\":{\"@id\":\"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1\"},\"breadcrumb\":{\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/iot-ngin.eu\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"GPU passthrough in OpenStack\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1\",\"name\":\"Giannis Tsichlas\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/iot-ngin.eu\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g\",\"caption\":\"Giannis Tsichlas\"},\"url\":\"https:\/\/iot-ngin.eu\/index.php\/author\/tsichlas\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"GPU passthrough in OpenStack - IOT NGIN","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/","og_locale":"en_US","og_type":"article","og_title":"GPU passthrough in OpenStack - IOT NGIN","og_description":"Kubeflow&nbsp;is an extraordinary framework essentially allowing the emergence of MLOps or ML as a Service (MLaaS) modalities. It is readily integrated into the overall concept, context and operations of Kubernetes, rendering a perfect match for ML engineers that need to &hellip;","og_url":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/","og_site_name":"IOT NGIN","article_published_time":"2021-11-25T15:07:34+00:00","article_modified_time":"2021-11-25T15:07:35+00:00","og_image":[{"width":1113,"height":412,"url":"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2021\/11\/kubernetesmaster.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"Giannis Tsichlas","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/iot-ngin.eu\/#website","url":"https:\/\/iot-ngin.eu\/","name":"IOT NGIN","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/iot-ngin.eu\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"ImageObject","@id":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#primaryimage","inLanguage":"en-US","url":"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2021\/11\/kubernetesmaster.png","contentUrl":"https:\/\/iot-ngin.eu\/wp-content\/uploads\/2021\/11\/kubernetesmaster.png","width":1113,"height":412},{"@type":"WebPage","@id":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#webpage","url":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/","name":"GPU passthrough in OpenStack - IOT NGIN","isPartOf":{"@id":"https:\/\/iot-ngin.eu\/#website"},"primaryImageOfPage":{"@id":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#primaryimage"},"datePublished":"2021-11-25T15:07:34+00:00","dateModified":"2021-11-25T15:07:35+00:00","author":{"@id":"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1"},"breadcrumb":{"@id":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/iot-ngin.eu\/index.php\/2021\/11\/25\/gpu-passthrough-in-openstack\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/iot-ngin.eu\/"},{"@type":"ListItem","position":2,"name":"GPU passthrough in OpenStack"}]},{"@type":"Person","@id":"https:\/\/iot-ngin.eu\/#\/schema\/person\/dac2bc3c10805a89083986685c5801d1","name":"Giannis Tsichlas","image":{"@type":"ImageObject","@id":"https:\/\/iot-ngin.eu\/#personlogo","inLanguage":"en-US","url":"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/740c19c414d2291ee24fcbe553ee2609?s=96&d=mm&r=g","caption":"Giannis Tsichlas"},"url":"https:\/\/iot-ngin.eu\/index.php\/author\/tsichlas\/"}]}},"cc_featured_image_caption":{"caption_text":false,"source_text":false,"source_url":false},"_links":{"self":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts\/1940"}],"collection":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/comments?post=1940"}],"version-history":[{"count":1,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts\/1940\/revisions"}],"predecessor-version":[{"id":1941,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/posts\/1940\/revisions\/1941"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/media\/1944"}],"wp:attachment":[{"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/media?parent=1940"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/categories?post=1940"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/iot-ngin.eu\/index.php\/wp-json\/wp\/v2\/tags?post=1940"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}