{"id":11191,"date":"2026-11-05T22:12:58","date_gmt":"2026-11-06T02:12:58","guid":{"rendered":"https:\/\/hostingdiscussion.com\/news\/?p=11191"},"modified":"2026-11-05T22:12:58","modified_gmt":"2026-11-06T02:12:58","slug":"zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached","status":"publish","type":"post","link":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/","title":{"rendered":"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached"},"content":{"rendered":"<p dir=\"ltr\">A GPU that sits idle still costs money. <a href=\"https:\/\/www.zstack-cloud.com\/\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">ZStack<\/a> wants to fix that, and it has released GPUWorks under the Apache License 2.0 to do it. The software lets several AI models take turns on shared GPU capacity, and it doesn\u2019t need an existing Kubernetes cluster to run.<\/p>\n<p dir=\"ltr\">The method is straightforward. <a href=\"https:\/\/github.com\/flitai-io\/gpuworks\/\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">GPUWorks<\/a> lets operators rank models by priority, free up resources that nobody is using and rotate workloads on a schedule. It also puts models to sleep and wakes them again, including models spread across several GPUs, which it handles as a group. The aim is to stop operators from reserving a separate GPU for every model and watching it wait for requests.<\/p>\n<p dir=\"ltr\">Sharing helps, but it doesn\u2019t remove the need to plan for demand. Think of two customers whose models both wake up at once. Someone\u2019s request has to wait. A rarely used internal document assistant can tolerate that. A customer-facing app with steady traffic probably can\u2019t. So any savings should be judged next to response times and service promises. Averages can also hide the awkward moments when a model has to be restored.<\/p>\n<p dir=\"ltr\">Memory enters the bill too. ZStack\u2019s fast restore keeps model weights in the host\u2019s RAM, so a model doesn\u2019t reload from storage every time. That speeds recovery, yet it means planners must count system memory when deciding how many models stay ready.<\/p>\n<p dir=\"ltr\">Then there\u2019s the small install size of about 40 MB. That describes the software, not the whole environment, because models, runtimes and applications still need room. Skipping the Kubernetes requirement helps teams that lack orchestration. Teams already deep in <a href=\"https:\/\/hostingdiscussion.com\/news\/kubernetes-quietly-becomes-the-control-plane-for-production-ai\/\">Kubernetes<\/a> might see GPUWorks as one more system to integrate.<\/p>\n<p dir=\"ltr\">Hardware coverage looks broad, with <a href=\"https:\/\/hostingdiscussion.com\/news\/nvidia-reportedly-sets-51-non-chinese-sales-floor-for-its-cloud-partners\/\">Nvidia<\/a>, AMD and several Chinese accelerators listed. A shared interface doesn\u2019t promise equal performance on every chip, though.<\/p>\n<p dir=\"ltr\">ZStack reports that one management server controlled 1,003 GPU servers in a physical test. That shows management scale. It says little about recovery, customer isolation or steady performance when workloads compete.<\/p>\n<p dir=\"ltr\">A provider planning to sell shared capacity should test failures first: a dead node, an interrupted model switch, a request arriving mid-reassignment. Those cases matter most, and demos rarely show them.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A GPU that sits idle still costs money. ZStack wants to fix that, and it has released GPUWorks under the Apache License 2.0 to do it. The software lets several AI models take turns on shared GPU capacity, and it doesn\u2019t need an existing Kubernetes cluster to run. The method is straightforward. GPUWorks lets operators [&hellip;]<\/p>\n","protected":false},"author":20624,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[8676,8673,8675,8672,8674,8671],"class_list":["post-11191","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-apache-license-2-0","tag-gpu-sharing-inference","tag-gpu-utilization","tag-gpuworks","tag-open-source-ai","tag-zstack"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached - Web Hosting News<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached - Web Hosting News\" \/>\n<meta property=\"og:description\" content=\"A GPU that sits idle still costs money. ZStack wants to fix that, and it has released GPUWorks under the Apache License 2.0 to do it. The software lets several AI models take turns on shared GPU capacity, and it doesn\u2019t need an existing Kubernetes cluster to run. The method is straightforward. GPUWorks lets operators [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/\" \/>\n<meta property=\"og:site_name\" content=\"Web Hosting News\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-06T02:12:58+00:00\" \/>\n<meta name=\"author\" content=\"Justine Juyad\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Justine Juyad\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/\",\"url\":\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/\",\"name\":\"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached - Web Hosting News\",\"isPartOf\":{\"@id\":\"https:\/\/hostingdiscussion.com\/news\/#website\"},\"datePublished\":\"2026-11-06T02:12:58+00:00\",\"dateModified\":\"2026-11-06T02:12:58+00:00\",\"author\":{\"@id\":\"https:\/\/hostingdiscussion.com\/news\/#\/schema\/person\/3a1732732b90f8c57c2a0ec68d3c49e3\"},\"breadcrumb\":{\"@id\":\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/hostingdiscussion.com\/news\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/hostingdiscussion.com\/news\/#website\",\"url\":\"https:\/\/hostingdiscussion.com\/news\/\",\"name\":\"Web Hosting News\",\"description\":\"Cloud and web hosting industry daily news\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/hostingdiscussion.com\/news\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/hostingdiscussion.com\/news\/#\/schema\/person\/3a1732732b90f8c57c2a0ec68d3c49e3\",\"name\":\"Justine Juyad\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/hostingdiscussion.com\/news\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/96df33d01870f85226adf8492251fbefe00bc349b10bb7679b094f3fa086999c?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/96df33d01870f85226adf8492251fbefe00bc349b10bb7679b094f3fa086999c?s=96&d=mm&r=g\",\"caption\":\"Justine Juyad\"},\"description\":\"HostingDiscussion.com senior reporter\",\"sameAs\":[\"https:\/\/hostingdiscussion.com\/news\/\"],\"url\":\"https:\/\/hostingdiscussion.com\/news\/author\/justine-juyad\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached - Web Hosting News","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/","og_locale":"en_US","og_type":"article","og_title":"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached - Web Hosting News","og_description":"A GPU that sits idle still costs money. ZStack wants to fix that, and it has released GPUWorks under the Apache License 2.0 to do it. The software lets several AI models take turns on shared GPU capacity, and it doesn\u2019t need an existing Kubernetes cluster to run. The method is straightforward. GPUWorks lets operators [&hellip;]","og_url":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/","og_site_name":"Web Hosting News","article_published_time":"2026-11-06T02:12:58+00:00","author":"Justine Juyad","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Justine Juyad","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/","url":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/","name":"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached - Web Hosting News","isPartOf":{"@id":"https:\/\/hostingdiscussion.com\/news\/#website"},"datePublished":"2026-11-06T02:12:58+00:00","dateModified":"2026-11-06T02:12:58+00:00","author":{"@id":"https:\/\/hostingdiscussion.com\/news\/#\/schema\/person\/3a1732732b90f8c57c2a0ec68d3c49e3"},"breadcrumb":{"@id":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/hostingdiscussion.com\/news\/zstacks-open-source-gpuworks-puts-idle-gpus-to-work-with-strings-attached\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/hostingdiscussion.com\/news\/"},{"@type":"ListItem","position":2,"name":"ZStack\u2019s open source GPUWorks puts idle GPUs to work, with strings attached"}]},{"@type":"WebSite","@id":"https:\/\/hostingdiscussion.com\/news\/#website","url":"https:\/\/hostingdiscussion.com\/news\/","name":"Web Hosting News","description":"Cloud and web hosting industry daily news","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/hostingdiscussion.com\/news\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/hostingdiscussion.com\/news\/#\/schema\/person\/3a1732732b90f8c57c2a0ec68d3c49e3","name":"Justine Juyad","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/hostingdiscussion.com\/news\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/96df33d01870f85226adf8492251fbefe00bc349b10bb7679b094f3fa086999c?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/96df33d01870f85226adf8492251fbefe00bc349b10bb7679b094f3fa086999c?s=96&d=mm&r=g","caption":"Justine Juyad"},"description":"HostingDiscussion.com senior reporter","sameAs":["https:\/\/hostingdiscussion.com\/news\/"],"url":"https:\/\/hostingdiscussion.com\/news\/author\/justine-juyad\/"}]}},"views":23,"_links":{"self":[{"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/posts\/11191","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/users\/20624"}],"replies":[{"embeddable":true,"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/comments?post=11191"}],"version-history":[{"count":1,"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/posts\/11191\/revisions"}],"predecessor-version":[{"id":11192,"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/posts\/11191\/revisions\/11192"}],"wp:attachment":[{"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/media?parent=11191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/categories?post=11191"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hostingdiscussion.com\/news\/wp-json\/wp\/v2\/tags?post=11191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}