Deploy website - based on a4c87da0ac

2024-07-25 03:50:21 +00:00 · 2024-07-25 03:50:21 +00:00 · 2c566b8271
--- a/404.html
+++ b/404.html
--- a/assets/js/0cb915af.547637ef.js
+++ b/assets/js/0cb915af.547637ef.js
--- a/assets/js/a9a2e533.cb6a0116.js
+++ b/assets/js/a9a2e533.cb6a0116.js
--- a/assets/js/a9a2e533.d03653b8.js
+++ b/assets/js/a9a2e533.d03653b8.js
--- a/assets/js/runtime~main.8a4b5fa3.js
+++ b/assets/js/runtime~main.8a4b5fa3.js
--- a/blog/index.html
+++ b/blog/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">Blog | SuperBench</title><meta data-react-helmet="true" property="og:title" content="Blog | SuperBench"><meta data-react-helmet="true" name="description" content="Blog"><meta data-react-helmet="true" property="og:description" content="Blog"><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/blog"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="blog_posts_list"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/blog"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -28,7 +28,7 @@ Developers can easily add new benchmarks.</p><p><img alt="SuperBench Benchmark P
 and <a href="https://microsoft.github.io/superbenchmark/docs/benchmarks/model-benchmarks.md" target="_blank" rel="noopener noreferrer">model-benchmarks</a>.</p><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="whats-next"></a>What&#x27;s next?<a class="hash-link" href="#whats-next" title="Direct link to heading">#</a></h2><p>We want to extend SuperBench capability to distributed validation and auto-diagnosis, to build a benchmarking eco-system.
 The following figure shows the whole picture.
 <img alt="SuperBench Capabilities and Extension" src="/superbenchmark/assets/images/architecture-31a8f49e1763a52efd81fc0fa4bad05b.svg"></p><p>With SuperBench and its extensions, we can support:</p><ul><li>Quick and trustable distributed validation<ul><li>Distributed validation tools to validate hundreds or thousands of servers automatically</li><li>Provide minute-level fast validation and guarantee high repeatability for each benchmarks</li><li>Provide baseline for different systems as Performance/Quality Gates for hardware and system release</li></ul></li><li>Detailed auto diagnosis<ul><li>Provide comprehensive diagnosis benchmarks to analyze the detailed issued on defective node</li><li>Provide detailed performance report and advanced analysis tool</li></ul></li></ul><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="call-for-contributor"></a>Call for Contributor<a class="hash-link" href="#call-for-contributor" title="Direct link to heading">#</a></h2><p>This project welcomes contributions and suggestions.</p></div><footer class="row docusaurus-mt-lg"><div class="col"><b>Tags:</b><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/superbench">superbench</a><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/announcement">announcement</a></div></footer></article><nav class="pagination-nav" aria-label="Blog list page navigation"><div class="pagination-nav__item"></div><div class="pagination-nav__item pagination-nav__item--next"></div></nav></main></div></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/blog/intro-sb/index.html
+++ b/blog/intro-sb/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">Introduce SuperBench | SuperBench</title><meta data-react-helmet="true" property="og:title" content="Introduce SuperBench | SuperBench"><meta data-react-helmet="true" name="description" content="This blog is to introduce SuperBench to help you validate AI infrastructure."><meta data-react-helmet="true" property="og:description" content="This blog is to introduce SuperBench to help you validate AI infrastructure."><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/blog/intro-sb"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="default"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/blog/intro-sb"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog/intro-sb" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog/intro-sb" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -27,7 +27,7 @@ Developers can easily add new benchmarks.</p><p><img alt="SuperBench Benchmark P
 and <a href="https://microsoft.github.io/superbenchmark/docs/benchmarks/model-benchmarks.md" target="_blank" rel="noopener noreferrer">model-benchmarks</a>.</p><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="whats-next"></a>What&#x27;s next?<a class="hash-link" href="#whats-next" title="Direct link to heading">#</a></h2><p>We want to extend SuperBench capability to distributed validation and auto-diagnosis, to build a benchmarking eco-system.
 The following figure shows the whole picture.
 <img alt="SuperBench Capabilities and Extension" src="/superbenchmark/assets/images/architecture-31a8f49e1763a52efd81fc0fa4bad05b.svg"></p><p>With SuperBench and its extensions, we can support:</p><ul><li>Quick and trustable distributed validation<ul><li>Distributed validation tools to validate hundreds or thousands of servers automatically</li><li>Provide minute-level fast validation and guarantee high repeatability for each benchmarks</li><li>Provide baseline for different systems as Performance/Quality Gates for hardware and system release</li></ul></li><li>Detailed auto diagnosis<ul><li>Provide comprehensive diagnosis benchmarks to analyze the detailed issued on defective node</li><li>Provide detailed performance report and advanced analysis tool</li></ul></li></ul><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="call-for-contributor"></a>Call for Contributor<a class="hash-link" href="#call-for-contributor" title="Direct link to heading">#</a></h2><p>This project welcomes contributions and suggestions.</p></div><footer class="row docusaurus-mt-lg blogPostDetailsFull_xD8n"><div class="col"><b>Tags:</b><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/superbench">superbench</a><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/announcement">announcement</a></div><div class="col margin-top--sm"><a href="https://github.com/microsoft/superbenchmark/edit/main/website/blog/2021-06-24-introduce-superbench.md" target="_blank" rel="noreferrer noopener"><svg fill="currentColor" height="20" width="20" viewBox="0 0 40 40" class="iconEdit_mS5F" aria-hidden="true"><g><path d="m34.5 11.7l-3 3.1-6.3-6.3 3.1-3q0.5-0.5 1.2-0.5t1.1 0.5l3.9 3.9q0.5 0.4 0.5 1.1t-0.5 1.2z m-29.5 17.1l18.4-18.5 6.3 6.3-18.4 18.4h-6.3v-6.2z"></path></g></svg>Edit this page</a></div></footer></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Blog post page navigation"><div class="pagination-nav__item"><a class="pagination-nav__link" href="/superbenchmark/blog/release-sb-v0.2"><div class="pagination-nav__sublabel">Newer Post</div><div class="pagination-nav__label">« Releasing SuperBench v0.2</div></a></div><div class="pagination-nav__item pagination-nav__item--next"></div></nav></main><div class="col col--2"><div class="tableOfContents_vrFS thin-scrollbar"><ul class="table-of-contents table-of-contents__left-border"><li><a href="#the-advantages-of-superbench" class="table-of-contents__link">The Advantages of SuperBench</a><ul><li><a href="#easy-to-use-cli" class="table-of-contents__link">Easy-to-use CLI</a></li><li><a href="#modular-and-extensible-framework" class="table-of-contents__link">Modular and Extensible Framework</a></li><li><a href="#conprehensive-and-strandardized-benchmarks" class="table-of-contents__link">Conprehensive and Strandardized Benchmarks</a></li></ul></li><li><a href="#whats-next" class="table-of-contents__link">What&#39;s next?</a></li><li><a href="#call-for-contributor" class="table-of-contents__link">Call for Contributor</a></li></ul></div></div></div></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/blog/release-sb-v0.10/index.html
+++ b/blog/release-sb-v0.10/index.html
--- a/blog/release-sb-v0.2/index.html
+++ b/blog/release-sb-v0.2/index.html
--- a/blog/release-sb-v0.3/index.html
+++ b/blog/release-sb-v0.3/index.html
--- a/blog/release-sb-v0.4/index.html
+++ b/blog/release-sb-v0.4/index.html
--- a/blog/release-sb-v0.5/index.html
+++ b/blog/release-sb-v0.5/index.html
--- a/blog/release-sb-v0.6/index.html
+++ b/blog/release-sb-v0.6/index.html
--- a/blog/release-sb-v0.7/index.html
+++ b/blog/release-sb-v0.7/index.html
--- a/blog/release-sb-v0.8/index.html
+++ b/blog/release-sb-v0.8/index.html
--- a/blog/release-sb-v0.9/index.html
+++ b/blog/release-sb-v0.9/index.html
--- a/blog/tags/announcement/index.html
+++ b/blog/tags/announcement/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">10 posts tagged with &quot;announcement&quot; | SuperBench</title><meta data-react-helmet="true" property="og:title" content="10 posts tagged with &quot;announcement&quot; | SuperBench"><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/blog/tags/announcement"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="blog_tags_posts"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/blog/tags/announcement"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog/tags/announcement" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog/tags/announcement" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -28,7 +28,7 @@ Developers can easily add new benchmarks.</p><p><img alt="SuperBench Benchmark P
 and <a href="https://microsoft.github.io/superbenchmark/docs/benchmarks/model-benchmarks.md" target="_blank" rel="noopener noreferrer">model-benchmarks</a>.</p><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="whats-next"></a>What&#x27;s next?<a class="hash-link" href="#whats-next" title="Direct link to heading">#</a></h2><p>We want to extend SuperBench capability to distributed validation and auto-diagnosis, to build a benchmarking eco-system.
 The following figure shows the whole picture.
 <img alt="SuperBench Capabilities and Extension" src="/superbenchmark/assets/images/architecture-31a8f49e1763a52efd81fc0fa4bad05b.svg"></p><p>With SuperBench and its extensions, we can support:</p><ul><li>Quick and trustable distributed validation<ul><li>Distributed validation tools to validate hundreds or thousands of servers automatically</li><li>Provide minute-level fast validation and guarantee high repeatability for each benchmarks</li><li>Provide baseline for different systems as Performance/Quality Gates for hardware and system release</li></ul></li><li>Detailed auto diagnosis<ul><li>Provide comprehensive diagnosis benchmarks to analyze the detailed issued on defective node</li><li>Provide detailed performance report and advanced analysis tool</li></ul></li></ul><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="call-for-contributor"></a>Call for Contributor<a class="hash-link" href="#call-for-contributor" title="Direct link to heading">#</a></h2><p>This project welcomes contributions and suggestions.</p></div><footer class="row docusaurus-mt-lg"><div class="col"><b>Tags:</b><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/superbench">superbench</a><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/announcement">announcement</a></div><div class="col text--right"><a aria-label="Read more about Introduce SuperBench" href="/superbenchmark/blog/intro-sb"><b>Read More</b></a></div></footer></article></main></div></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/blog/tags/index.html
+++ b/blog/tags/index.html
--- a/blog/tags/release/index.html
+++ b/blog/tags/release/index.html
--- a/blog/tags/superbench/index.html
+++ b/blog/tags/superbench/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">10 posts tagged with &quot;superbench&quot; | SuperBench</title><meta data-react-helmet="true" property="og:title" content="10 posts tagged with &quot;superbench&quot; | SuperBench"><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/blog/tags/superbench"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="blog_tags_posts"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/blog/tags/superbench"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog/tags/superbench" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/blog/tags/superbench" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -28,7 +28,7 @@ Developers can easily add new benchmarks.</p><p><img alt="SuperBench Benchmark P
 and <a href="https://microsoft.github.io/superbenchmark/docs/benchmarks/model-benchmarks.md" target="_blank" rel="noopener noreferrer">model-benchmarks</a>.</p><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="whats-next"></a>What&#x27;s next?<a class="hash-link" href="#whats-next" title="Direct link to heading">#</a></h2><p>We want to extend SuperBench capability to distributed validation and auto-diagnosis, to build a benchmarking eco-system.
 The following figure shows the whole picture.
 <img alt="SuperBench Capabilities and Extension" src="/superbenchmark/assets/images/architecture-31a8f49e1763a52efd81fc0fa4bad05b.svg"></p><p>With SuperBench and its extensions, we can support:</p><ul><li>Quick and trustable distributed validation<ul><li>Distributed validation tools to validate hundreds or thousands of servers automatically</li><li>Provide minute-level fast validation and guarantee high repeatability for each benchmarks</li><li>Provide baseline for different systems as Performance/Quality Gates for hardware and system release</li></ul></li><li>Detailed auto diagnosis<ul><li>Provide comprehensive diagnosis benchmarks to analyze the detailed issued on defective node</li><li>Provide detailed performance report and advanced analysis tool</li></ul></li></ul><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="call-for-contributor"></a>Call for Contributor<a class="hash-link" href="#call-for-contributor" title="Direct link to heading">#</a></h2><p>This project welcomes contributions and suggestions.</p></div><footer class="row docusaurus-mt-lg"><div class="col"><b>Tags:</b><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/superbench">superbench</a><a class="margin-horiz--sm" href="/superbenchmark/blog/tags/announcement">announcement</a></div><div class="col text--right"><a aria-label="Read more about Introduce SuperBench" href="/superbenchmark/blog/intro-sb"><b>Read More</b></a></div></footer></article></main></div></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/docs/cli/index.html
+++ b/docs/cli/index.html
--- a/docs/design-docs/benchmarks/index.html
+++ b/docs/design-docs/benchmarks/index.html
--- a/docs/design-docs/overview/index.html
+++ b/docs/design-docs/overview/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">Superbench Design | SuperBench</title><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/docs/design-docs/overview"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:version" content="current"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="docs-default-current"><meta data-react-helmet="true" property="og:title" content="Superbench Design | SuperBench"><meta data-react-helmet="true" name="description" content="Goals"><meta data-react-helmet="true" property="og:description" content="Goals"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/docs/design-docs/overview"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/design-docs/overview" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/design-docs/overview" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -22,7 +22,7 @@ or talk with SuperBench Executor inside Docker container to execute benchmarks a
 It will start the monitor (optional), execute each benchmark and handle all pre- and post-processing, including health check, result validation, result processing, etc.</p><p>Here&#x27;re the SuperBench Executor&#x27;s work directory structure inside Docker container.
 The <code>/root</code> directory is mounted from <code>$HOME/sb-workspace</code> on the host path.</p><div class="codeBlockContainer_J+bg"><div class="codeBlockContent_csEI bash"><pre tabindex="0" class="prism-code language-bash codeBlock_rtdJ thin-scrollbar" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">/root</span></span><span class="token-line" style="color:#393A34"><span class="token plain">├── .ssh                              </span><span class="token comment" style="color:#999988;font-style:italic"># SSH directory</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">│   ├── config                        </span><span class="token comment" style="color:#999988;font-style:italic"># generated SSH config file</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">│   ├── id_ed25519                    </span><span class="token comment" style="color:#999988;font-style:italic"># generated SSH private key from Runner</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">│   └── id_ed25519.pub                </span><span class="token comment" style="color:#999988;font-style:italic"># generated SSH public key from Runner</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">└── outputs/                          </span><span class="token comment" style="color:#999988;font-style:italic"># output root directory</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">    └── datetime                      </span><span class="token comment" style="color:#999988;font-style:italic"># output directory name in %Y-%m-%d_%H-%M-%S format</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        ├── benchmarks                </span><span class="token comment" style="color:#999988;font-style:italic"># benchmarks directory</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        │   └── benchmark-0           </span><span class="token comment" style="color:#999988;font-style:italic"># output for each benchmark</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        │       └── rank-0            </span><span class="token comment" style="color:#999988;font-style:italic"># output for each rank in each benchmark</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        │           ├── results.json  </span><span class="token comment" style="color:#999988;font-style:italic"># raw results</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        │           └── monitor.jsonl </span><span class="token comment" style="color:#999988;font-style:italic"># monitor results (optional)</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        ├── sb.config.yaml            </span><span class="token comment" style="color:#999988;font-style:italic"># SuperBench configuration snapshot</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        ├── sb-bench.log              </span><span class="token comment" style="color:#999988;font-style:italic"># SuperBench benchmarks&#x27; runtime log for debugging</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain">        └── sb.env                    </span><span class="token comment" style="color:#999988;font-style:italic"># SuperBench runtime environment variables</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div><h3><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="benchmarks"></a><a href="/superbenchmark/docs/design-docs/benchmarks">Benchmarks</a><a class="hash-link" href="#benchmarks" title="Direct link to heading">#</a></h3><p>Benchmarks are a set of tests that actually run on node to measure the hardware performance.
 Here&#x27;re the related concepts, nccl benchmark is used as an example.</p><ol><li><p>Module</p><p>One benchmark is one module, it has a set of abstract methods that should be implemented, e.g., pre check, measure, post check, save result, etc. The whole nccl benchmark is one module.</p></li><li><p>Mode</p><p>One module may have several modes when running, each mode has corresponding method to run, e.g., local mode is running inside one node, mpi mode is running on all nodes but the command is only executed on one node, pair mode is running between two nodes for every combination, etc. The nccl module may have local mode and mpi mode.</p></li><li><p>Task Group</p><p>One mode may have several task groups to run, each task group has a barrier when running. So only until the task group has finished on all nodes will the next task group start. The mpi mode of nccl module will run all reduce, all gather, etc., each should be treated as one task group.</p></li><li><p>Task</p><p>One task group may contain several tasks to run, there&#x27;s no barrier needed among these tasks inside one task group.</p></li></ol></div><footer class="row docusaurus-mt-lg"><div class="col"><a href="https://github.com/microsoft/superbenchmark/edit/main/website/../docs/design-docs/overview.md" target="_blank" rel="noreferrer noopener"><svg fill="currentColor" height="20" width="20" viewBox="0 0 40 40" class="iconEdit_mS5F" aria-hidden="true"><g><path d="m34.5 11.7l-3 3.1-6.3-6.3 3.1-3q0.5-0.5 1.2-0.5t1.1 0.5l3.9 3.9q0.5 0.4 0.5 1.1t-0.5 1.2z m-29.5 17.1l18.4-18.5 6.3 6.3-18.4 18.4h-6.3v-6.2z"></path></g></svg>Edit this page</a></div><div class="col lastUpdated_wj+Z"></div></footer></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Docs pages navigation"><div class="pagination-nav__item"><a class="pagination-nav__link" href="/superbenchmark/docs/developer-guides/contributing"><div class="pagination-nav__sublabel">Previous</div><div class="pagination-nav__label">« Contributing</div></a></div><div class="pagination-nav__item pagination-nav__item--next"><a class="pagination-nav__link" href="/superbenchmark/docs/design-docs/benchmarks"><div class="pagination-nav__sublabel">Next</div><div class="pagination-nav__label">Benchmarks Design »</div></a></div></nav></div></div><div class="col col--3"><div class="tableOfContents_vrFS thin-scrollbar"><ul class="table-of-contents table-of-contents__left-border"><li><a href="#goals" class="table-of-contents__link">Goals</a></li><li><a href="#architecture" class="table-of-contents__link">Architecture</a></li><li><a href="#pipeline" class="table-of-contents__link">Pipeline</a></li><li><a href="#components" class="table-of-contents__link">Components</a><ul><li><a href="#superbench-cli" class="table-of-contents__link">SuperBench CLI</a></li><li><a href="#superbench-runner" class="table-of-contents__link">SuperBench Runner</a></li><li><a href="#superbench-executor" class="table-of-contents__link">SuperBench Executor</a></li><li><a href="#benchmarks" class="table-of-contents__link">Benchmarks</a></li></ul></li></ul></div></div></div></div></main></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/docs/developer-guides/contributing/index.html
+++ b/docs/developer-guides/contributing/index.html
--- a/docs/developer-guides/development/index.html
+++ b/docs/developer-guides/development/index.html
--- a/docs/developer-guides/using-docker/index.html
+++ b/docs/developer-guides/using-docker/index.html
--- a/docs/getting-started/configuration/index.html
+++ b/docs/getting-started/configuration/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">Configuration | SuperBench</title><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/docs/getting-started/configuration"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:version" content="current"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="docs-default-current"><meta data-react-helmet="true" property="og:title" content="Configuration | SuperBench"><meta data-react-helmet="true" name="description" content="SuperBench config"><meta data-react-helmet="true" property="og:description" content="SuperBench config"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/docs/getting-started/configuration"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/getting-started/configuration" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/getting-started/configuration" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -18,7 +18,7 @@ By default, all benchmarks in default configuration will be run if you don&#x27;
 you need to provide an <a href="https://docs.ansible.com/ansible/latest/user_guide/intro_inventory.html" target="_blank" rel="noopener noreferrer">inventory</a> file
 to configure host list for managed nodes.</p><p>Here&#x27;re some basic examples as your starting point.</p><ul><li><p>One managed node, same node as control node.</p><div class="codeBlockContainer_J+bg"><div style="color:#393A34;background-color:#f6f8fa" class="codeBlockTitle_oQzk">local.ini</div><div class="codeBlockContent_csEI ini"><pre tabindex="0" class="prism-code language-ini codeBlock_rtdJ thin-scrollbar codeBlockWithTitle_ZT05" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">[all]</span></span><span class="token-line" style="color:#393A34"><span class="token plain">localhost ansible_connection=local</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div></li><li><p>Two managed nodes, one is control node and the other can be remote accessed.</p><div class="codeBlockContainer_J+bg"><div style="color:#393A34;background-color:#f6f8fa" class="codeBlockTitle_oQzk">mix.ini</div><div class="codeBlockContent_csEI ini"><pre tabindex="0" class="prism-code language-ini codeBlock_rtdJ thin-scrollbar codeBlockWithTitle_ZT05" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">[all]</span></span><span class="token-line" style="color:#393A34"><span class="token plain">localhost ansible_connection=local</span></span><span class="token-line" style="color:#393A34"><span class="token plain">10.0.0.100 ansible_user=username ansible_ssh_private_key_file=id_rsa</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div></li><li><p>Eight managed nodes, all can be accessed remotely.</p><div class="codeBlockContainer_J+bg"><div style="color:#393A34;background-color:#f6f8fa" class="codeBlockTitle_oQzk">remote.ini</div><div class="codeBlockContent_csEI ini"><pre tabindex="0" class="prism-code language-ini codeBlock_rtdJ thin-scrollbar codeBlockWithTitle_ZT05" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">[all]</span></span><span class="token-line" style="color:#393A34"><span class="token plain">10.0.0.[100:103]</span></span><span class="token-line" style="color:#393A34"><span class="token plain">10.0.0.[200:203]</span></span><span class="token-line" style="color:#393A34"><span class="token plain" style="display:inline-block">
 </span></span><span class="token-line" style="color:#393A34"><span class="token plain">[all:vars]</span></span><span class="token-line" style="color:#393A34"><span class="token plain">ansible_user=username</span></span><span class="token-line" style="color:#393A34"><span class="token plain">ansible_ssh_private_key_file=id_rsa</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div></li></ul></div><footer class="row docusaurus-mt-lg"><div class="col"><a href="https://github.com/microsoft/superbenchmark/edit/main/website/../docs/getting-started/configuration.md" target="_blank" rel="noreferrer noopener"><svg fill="currentColor" height="20" width="20" viewBox="0 0 40 40" class="iconEdit_mS5F" aria-hidden="true"><g><path d="m34.5 11.7l-3 3.1-6.3-6.3 3.1-3q0.5-0.5 1.2-0.5t1.1 0.5l3.9 3.9q0.5 0.4 0.5 1.1t-0.5 1.2z m-29.5 17.1l18.4-18.5 6.3 6.3-18.4 18.4h-6.3v-6.2z"></path></g></svg>Edit this page</a></div><div class="col lastUpdated_wj+Z"></div></footer></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Docs pages navigation"><div class="pagination-nav__item"><a class="pagination-nav__link" href="/superbenchmark/docs/getting-started/installation"><div class="pagination-nav__sublabel">Previous</div><div class="pagination-nav__label">« Installation</div></a></div><div class="pagination-nav__item pagination-nav__item--next"><a class="pagination-nav__link" href="/superbenchmark/docs/getting-started/run-superbench"><div class="pagination-nav__sublabel">Next</div><div class="pagination-nav__label">Run SuperBench »</div></a></div></nav></div></div><div class="col col--3"><div class="tableOfContents_vrFS thin-scrollbar"><ul class="table-of-contents table-of-contents__left-border"><li><a href="#superbench-config" class="table-of-contents__link">SuperBench config</a></li><li><a href="#ansible-inventory" class="table-of-contents__link">Ansible Inventory</a></li></ul></div></div></div></div></main></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/docs/getting-started/installation/index.html
+++ b/docs/getting-started/installation/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">Installation | SuperBench</title><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/docs/getting-started/installation"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:version" content="current"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="docs-default-current"><meta data-react-helmet="true" property="og:title" content="Installation | SuperBench"><meta data-react-helmet="true" name="description" content="SuperBench is used to run validations for AI infrastructure,"><meta data-react-helmet="true" property="og:description" content="SuperBench is used to run validations for AI infrastructure,"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/docs/getting-started/installation"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/getting-started/installation" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/getting-started/installation" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -22,7 +22,7 @@ but it is not strictly necessary.</p><div class="codeBlockContainer_J+bg"><div c
 </span></span><span class="token-line" style="color:#393A34"><span class="token plain">python3 -m pip </span><span class="token function" style="color:#d73a49">install</span><span class="token plain"> </span><span class="token builtin class-name">.</span><span class="token plain"></span></span><span class="token-line" style="color:#393A34"><span class="token plain"></span><span class="token function" style="color:#d73a49">make</span><span class="token plain"> postinstall</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div><p>After installation, you should be able to run SB CLI.</p><div class="codeBlockContainer_J+bg"><div class="codeBlockContent_csEI bash"><pre tabindex="0" class="prism-code language-bash codeBlock_rtdJ thin-scrollbar" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">sb</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="managed-nodes"></a>Managed nodes<a class="hash-link" href="#managed-nodes" title="Direct link to heading">#</a></h2><p>Here&#x27;re the system requirements for all managed GPU nodes.</p><h3><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="requirements-1"></a>Requirements<a class="hash-link" href="#requirements-1" title="Direct link to heading">#</a></h3><div class="tabs-container"><ul role="tablist" aria-orientation="horizontal" class="tabs"><li role="tab" tabindex="0" aria-selected="true" class="tabs__item tabItem_vU9c tabs__item--active">NVIDIA GPU</li><li role="tab" tabindex="-1" aria-selected="false" class="tabs__item tabItem_vU9c">AMD GPU</li></ul><div class="margin-vert--md"><div role="tabpanel"><ul><li>Latest version of Linux, you&#x27;re highly encouraged to use Ubuntu 18.04 or later.</li><li>Compatible GPU drivers should be installed correctly. Driver version can be checked by running <code>nvidia-smi</code>.</li><li><a href="https://docs.docker.com/engine/install/" target="_blank" rel="noopener noreferrer">Docker CE</a> version 20.10 or later (which can be checked by running <code>docker --version</code>).</li><li>NVIDIA GPU support in Docker, install
 <a href="https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#setting-up-nvidia-container-toolkit" target="_blank" rel="noopener noreferrer">nvidia-container-toolkit</a>.</li></ul></div><div role="tabpanel" hidden=""><ul><li>Latest version of Linux, you&#x27;re highly encouraged to use Ubuntu 18.04 or later.</li><li>Compatible GPU drivers should be installed correctly, and group permission should be set to access GPU resources.
 You should be able to run <code>rocm-smi</code> and <code>rocminfo</code> directly to check GPU usage and information.</li><li><a href="https://docs.docker.com/engine/install/" target="_blank" rel="noopener noreferrer">Docker CE</a> version 20.10 or later (which can be checked by running <code>docker --version</code>).</li></ul></div></div></div></div><footer class="row docusaurus-mt-lg"><div class="col"><a href="https://github.com/microsoft/superbenchmark/edit/main/website/../docs/getting-started/installation.mdx" target="_blank" rel="noreferrer noopener"><svg fill="currentColor" height="20" width="20" viewBox="0 0 40 40" class="iconEdit_mS5F" aria-hidden="true"><g><path d="m34.5 11.7l-3 3.1-6.3-6.3 3.1-3q0.5-0.5 1.2-0.5t1.1 0.5l3.9 3.9q0.5 0.4 0.5 1.1t-0.5 1.2z m-29.5 17.1l18.4-18.5 6.3 6.3-18.4 18.4h-6.3v-6.2z"></path></g></svg>Edit this page</a></div><div class="col lastUpdated_wj+Z"></div></footer></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Docs pages navigation"><div class="pagination-nav__item"><a class="pagination-nav__link" href="/superbenchmark/docs/introduction"><div class="pagination-nav__sublabel">Previous</div><div class="pagination-nav__label">« Introduction</div></a></div><div class="pagination-nav__item pagination-nav__item--next"><a class="pagination-nav__link" href="/superbenchmark/docs/getting-started/configuration"><div class="pagination-nav__sublabel">Next</div><div class="pagination-nav__label">Configuration »</div></a></div></nav></div></div><div class="col col--3"><div class="tableOfContents_vrFS thin-scrollbar"><ul class="table-of-contents table-of-contents__left-border"><li><a href="#control-node" class="table-of-contents__link">Control node</a><ul><li><a href="#requirements" class="table-of-contents__link">Requirements</a></li><li><a href="#build" class="table-of-contents__link">Build</a></li></ul></li><li><a href="#managed-nodes" class="table-of-contents__link">Managed nodes</a><ul><li><a href="#requirements-1" class="table-of-contents__link">Requirements</a></li></ul></li></ul></div></div></div></div></main></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/docs/getting-started/run-superbench/index.html
+++ b/docs/getting-started/run-superbench/index.html
@ -7,7 +7,7 @@
 <link rel="alternate" type="application/rss+xml" href="/superbenchmark/blog/rss.xml" title="SuperBench Blog RSS Feed">
 <link rel="alternate" type="application/atom+xml" href="/superbenchmark/blog/atom.xml" title="SuperBench Blog Atom Feed">
 <link rel="search" type="application/opensearchdescription+xml" title="SuperBench" href="/superbenchmark/opensearch.xml"><title data-react-helmet="true">Run SuperBench | SuperBench</title><meta data-react-helmet="true" property="og:url" content="https://microsoft.github.io/superbenchmark/docs/getting-started/run-superbench"><meta data-react-helmet="true" name="docsearch:language" content="en"><meta data-react-helmet="true" name="docsearch:version" content="current"><meta data-react-helmet="true" name="docsearch:docusaurus_tag" content="docs-default-current"><meta data-react-helmet="true" property="og:title" content="Run SuperBench | SuperBench"><meta data-react-helmet="true" name="description" content="Having prepared benchmark configuration and inventory files,"><meta data-react-helmet="true" property="og:description" content="Having prepared benchmark configuration and inventory files,"><link data-react-helmet="true" rel="shortcut icon" href="/superbenchmark/img/favicon.ico"><link data-react-helmet="true" rel="canonical" href="https://microsoft.github.io/superbenchmark/docs/getting-started/run-superbench"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/getting-started/run-superbench" hreflang="en"><link data-react-helmet="true" rel="alternate" href="https://microsoft.github.io/superbenchmark/docs/getting-started/run-superbench" hreflang="x-default"><link data-react-helmet="true" rel="preconnect" href="https://BH4D9OD16A-dsn.algolia.net" crossorigin="anonymous"><link rel="stylesheet" href="/superbenchmark/assets/css/styles.3d1af2f1.css">
-<link rel="preload" href="/superbenchmark/assets/js/runtime~main.15b2037e.js" as="script">
+<link rel="preload" href="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js" as="script">
 <link rel="preload" href="/superbenchmark/assets/js/main.1eed752d.js" as="script">
 </head>
 <body>
@ -18,7 +18,7 @@ After running the following command, SuperBench will automatically access all no
 or your private key requires a passphase before use, you can do</p><div class="codeBlockContainer_J+bg"><div class="codeBlockContent_csEI bash"><pre tabindex="0" class="prism-code language-bash codeBlock_rtdJ thin-scrollbar" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">sb deploy -f remote.ini --host-password </span><span class="token punctuation" style="color:#393A34">[</span><span class="token plain">password</span><span class="token punctuation" style="color:#393A34">]</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div><div class="admonition admonition-note alert alert--secondary"><div class="admonition-heading"><h5><span class="admonition-icon"><svg xmlns="http://www.w3.org/2000/svg" width="14" height="16" viewBox="0 0 14 16"><path fill-rule="evenodd" d="M6.3 5.69a.942.942 0 0 1-.28-.7c0-.28.09-.52.28-.7.19-.18.42-.28.7-.28.28 0 .52.09.7.28.18.19.28.42.28.7 0 .28-.09.52-.28.7a1 1 0 0 1-.7.3c-.28 0-.52-.11-.7-.3zM8 7.99c-.02-.25-.11-.48-.31-.69-.2-.19-.42-.3-.69-.31H6c-.27.02-.48.13-.69.31-.2.2-.3.44-.31.69h1v3c.02.27.11.5.31.69.2.2.42.31.69.31h1c.27 0 .48-.11.69-.31.2-.19.3-.42.31-.69H8V7.98v.01zM7 2.3c-3.14 0-5.7 2.54-5.7 5.68 0 3.14 2.56 5.7 5.7 5.7s5.7-2.55 5.7-5.7c0-3.15-2.56-5.69-5.7-5.69v.01zM7 .98c3.86 0 7 3.14 7 7s-3.14 7-7 7-7-3.12-7-7 3.14-7 7-7z"></path></svg></span>Note</h5></div><div class="admonition-content"><p>You should deploy corresponding Docker image to use release version, for example,</p><p><code>sb deploy -f local.ini -i superbench/superbench:v0.10.0-cuda12.2</code></p><p>You should note that version of git repo only determines version of sb CLI, and not the sb container. You should define the container version even if you specified a release version for the git clone.</p></div></div><h2><a aria-hidden="true" tabindex="-1" class="anchor enhancedAnchor_WiXH" id="run"></a>Run<a class="hash-link" href="#run" title="Direct link to heading">#</a></h2><p>After deployment, you can start to run the SuperBench benchmarks on all managed nodes using <code>sb run</code> command.</p><div class="codeBlockContainer_J+bg"><div class="codeBlockContent_csEI bash"><pre tabindex="0" class="prism-code language-bash codeBlock_rtdJ thin-scrollbar" style="color:#393A34;background-color:#f6f8fa"><code class="codeBlockLines_1zSZ"><span class="token-line" style="color:#393A34"><span class="token plain">sb run -f local.ini -c resnet.yaml</span></span></code></pre><button type="button" aria-label="Copy code to clipboard" class="copyButton_M3SB clean-btn">Copy</button></div></div><div class="admonition admonition-tip alert alert--success"><div class="admonition-heading"><h5><span class="admonition-icon"><svg xmlns="http://www.w3.org/2000/svg" width="12" height="16" viewBox="0 0 12 16"><path fill-rule="evenodd" d="M6.5 0C3.48 0 1 2.19 1 5c0 .92.55 2.25 1 3 1.34 2.25 1.78 2.78 2 4v1h5v-1c.22-1.22.66-1.75 2-4 .45-.75 1-2.08 1-3 0-2.81-2.48-5-5.5-5zm3.64 7.48c-.25.44-.47.8-.67 1.11-.86 1.41-1.25 2.06-1.45 3.23-.02.05-.02.11-.02.17H5c0-.06 0-.13-.02-.17-.2-1.17-.59-1.83-1.45-3.23-.2-.31-.42-.67-.67-1.11C2.44 6.78 2 5.65 2 5c0-2.2 2.02-4 4.5-4 1.22 0 2.36.42 3.22 1.19C10.55 2.94 11 3.94 11 5c0 .66-.44 1.78-.86 2.48zM4 14h5c-.23 1.14-1.3 2-2.5 2s-2.27-.86-2.5-2z"></path></svg></span>TIP</h5></div><div class="admonition-content"><p>For environments that cannot start containers through <code>sb deploy</code>, e.g., a Kubernetes cluster.
 You can create a privileged container with <code>superbench/superbench</code> image, skip <code>sb deploy</code>, and run <code>sb run</code> directly inside the container with <code>--no-docker</code> argument:
 <code>sb run --no-docker -l localhost -c resnet.yaml</code>.</p></div></div></div><footer class="row docusaurus-mt-lg"><div class="col"><a href="https://github.com/microsoft/superbenchmark/edit/main/website/../docs/getting-started/run-superbench.md" target="_blank" rel="noreferrer noopener"><svg fill="currentColor" height="20" width="20" viewBox="0 0 40 40" class="iconEdit_mS5F" aria-hidden="true"><g><path d="m34.5 11.7l-3 3.1-6.3-6.3 3.1-3q0.5-0.5 1.2-0.5t1.1 0.5l3.9 3.9q0.5 0.4 0.5 1.1t-0.5 1.2z m-29.5 17.1l18.4-18.5 6.3 6.3-18.4 18.4h-6.3v-6.2z"></path></g></svg>Edit this page</a></div><div class="col lastUpdated_wj+Z"></div></footer></article><nav class="pagination-nav docusaurus-mt-lg" aria-label="Docs pages navigation"><div class="pagination-nav__item"><a class="pagination-nav__link" href="/superbenchmark/docs/getting-started/configuration"><div class="pagination-nav__sublabel">Previous</div><div class="pagination-nav__label">« Configuration</div></a></div><div class="pagination-nav__item pagination-nav__item--next"><a class="pagination-nav__link" href="/superbenchmark/docs/user-tutorial/benchmarks/micro-benchmarks"><div class="pagination-nav__sublabel">Next</div><div class="pagination-nav__label">Micro Benchmarks »</div></a></div></nav></div></div><div class="col col--3"><div class="tableOfContents_vrFS thin-scrollbar"><ul class="table-of-contents table-of-contents__left-border"><li><a href="#deploy" class="table-of-contents__link">Deploy</a></li><li><a href="#run" class="table-of-contents__link">Run</a></li></ul></div></div></div></div></main></div></div><footer class="footer footer--dark"><div class="container"><div class="row footer__links"><div class="col footer__col"><div class="footer__title">Docs</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/introduction">Introduction</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/getting-started/installation">Getting Started</a></li><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/docs/cli">API</a></li></ul></div><div class="col footer__col"><div class="footer__title">Community</div><ul class="footer__items"><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/issues" target="_blank" rel="noopener noreferrer" class="footer__link-item">Issues</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark/discussions" target="_blank" rel="noopener noreferrer" class="footer__link-item">Discussion</a></li></ul></div><div class="col footer__col"><div class="footer__title">More</div><ul class="footer__items"><li class="footer__item"><a class="footer__link-item" href="/superbenchmark/blog">Blog</a></li><li class="footer__item"><a href="https://github.com/microsoft/superbenchmark" target="_blank" rel="noopener noreferrer" class="footer__link-item">GitHub</a></li></ul></div></div><div class="footer__bottom text--center"><div class="footer__copyright">Copyright © 2024 SuperBench. <br> Built with Docusaurus and hosted by GitHub.</div></div></div></footer></div>
-<script src="/superbenchmark/assets/js/runtime~main.15b2037e.js"></script>
+<script src="/superbenchmark/assets/js/runtime~main.8a4b5fa3.js"></script>
 <script src="/superbenchmark/assets/js/main.1eed752d.js"></script>
 </body>
 </html>
--- a/docs/introduction/index.html
+++ b/docs/introduction/index.html
--- a/docs/release-process/index.html
+++ b/docs/release-process/index.html
--- a/docs/superbench-config/index.html
+++ b/docs/superbench-config/index.html
--- a/docs/user-tutorial/baseline-generation/index.html
+++ b/docs/user-tutorial/baseline-generation/index.html
--- a/docs/user-tutorial/benchmarks/docker-benchmarks/index.html
+++ b/docs/user-tutorial/benchmarks/docker-benchmarks/index.html
--- a/docs/user-tutorial/benchmarks/micro-benchmarks/index.html
+++ b/docs/user-tutorial/benchmarks/micro-benchmarks/index.html
--- a/docs/user-tutorial/benchmarks/model-benchmarks/index.html
+++ b/docs/user-tutorial/benchmarks/model-benchmarks/index.html
--- a/docs/user-tutorial/container-images/index.html
+++ b/docs/user-tutorial/container-images/index.html
--- a/docs/user-tutorial/data-diagnosis/index.html
+++ b/docs/user-tutorial/data-diagnosis/index.html
--- a/docs/user-tutorial/monitor/index.html
+++ b/docs/user-tutorial/monitor/index.html
--- a/docs/user-tutorial/result-summary/index.html
+++ b/docs/user-tutorial/result-summary/index.html
--- a/docs/user-tutorial/system-config/index.html
+++ b/docs/user-tutorial/system-config/index.html
--- a/index.html
+++ b/index.html
--- a/search/index.html
+++ b/search/index.html