A validation and profiling tool for AI infrastructure
Перейти к файлу
guoshzhao 6d895da83c
Benchmarks: Add Feature - Provide option to save raw data into file. (#333)
**Description**
Use config `log_raw_data` to control whether log the raw data into file or not. The default value is `no`. We can set it as `yes` for some particular benchmarks to save the raw data into file, such as NCCL/RCCL test.
2022-04-01 16:26:09 +08:00
.azure-pipelines Benchmarks: Add Benchmark - Add ONNXRuntime inference benchmark based on ORT python API (#245) 2021-12-10 13:53:11 +00:00
.devcontainer Docs - Add config and docs for development experience (#155) 2021-08-16 13:49:19 +08:00
.github Dockerfile - Add dockerfile for rocm5.0.1 (#319) 2022-02-28 19:30:43 +08:00
.vscode Docs - Add config and docs for development experience (#155) 2021-08-16 13:49:19 +08:00
dockerfile Dockerfile - Add dockerfile for rocm5.0.1 (#319) 2022-02-28 19:30:43 +08:00
docs Benchmarks: Add Feature - Provide option to save raw data into file. (#333) 2022-04-01 16:26:09 +08:00
examples/benchmarks Benchmarks: Add Feature - Add GPU-Burn as microbenchmark (#324) 2022-03-16 16:20:11 +08:00
superbench Benchmarks: Add Feature - Provide option to save raw data into file. (#333) 2022-04-01 16:26:09 +08:00
tests Benchmarks: Add Feature - Provide option to save raw data into file. (#333) 2022-04-01 16:26:09 +08:00
third_party Benchmarks: Add Feature - Add GPU-Burn as microbenchmark (#324) 2022-03-16 16:20:11 +08:00
website Bump minimist from 1.2.5 to 1.2.6 in /website (#334) 2022-03-31 12:41:48 +08:00
.clang-format Benchmarks: Add Benchmark - Add the source code of cuda kernel launch overhead benchmark. (#71) 2021-05-18 14:07:27 +08:00
.codecov.yml Bug bash - Merge fix from release/0.2 to main (#124) 2021-07-09 16:54:42 +08:00
.dockerignore Dockerfile - Update CUDA 11.1.1 Dockerfile (#96) 2021-06-16 16:47:52 +08:00
.editorconfig Docs - Add config and docs for development experience (#155) 2021-08-16 13:49:19 +08:00
.flake8 Setup: Revision - Update lint rules (#7) 2021-02-01 14:12:02 +08:00
.gitattributes Setup: Init - Initialize setup.py and basic configs (#4) 2021-01-28 21:01:28 +08:00
.gitignore Benchmarks - Add TensorRT inference benchmark (#236) 2021-11-12 15:27:16 +08:00
.gitmodules Benchmarks: Add Feature - Add GPU-Burn as microbenchmark (#324) 2022-03-16 16:20:11 +08:00
.mypy.ini Config - Add inference config for NC A100 and NV A10 series (#329) 2022-03-21 14:24:37 +08:00
.pre-commit-config.yaml Setup: Init - Initialize setup.py and basic configs (#4) 2021-01-28 21:01:28 +08:00
.style.yapf Setup: Revision - Update lint rules (#7) 2021-02-01 14:12:02 +08:00
CODE_OF_CONDUCT.md Initial CODE_OF_CONDUCT.md commit 2020-12-16 18:22:21 -08:00
LICENSE Initial LICENSE commit 2020-12-16 18:22:25 -08:00
MANIFEST.in Bug bash - Fix bugs in multi GPU benchmarks (#98) 2021-06-23 18:16:43 +08:00
Makefile Runner - Fetch benchmarks results on all nodes (#116) 2021-07-02 21:45:56 +08:00
README.md Release - SuperBench v0.4.0 (#278) 2021-12-30 16:24:00 +08:00
SECURITY.md Setup: Init - Initialize setup.py and basic configs (#4) 2021-01-28 21:01:28 +08:00
SUPPORT.md Docs - Initialize README (#6) 2021-02-01 20:21:12 +08:00
setup.py Analyzer - Add md and html output format for DataDiagnosis (#325) 2022-03-15 18:04:11 +08:00

README.md

SuperBench

Build Image Codecov Website Latest Release Docker Pulls License

Azure Pipelines Build Status
cpu-unit-test Build Status
cuda-unit-test Build Status
ansible-integration-test Build Status

SuperBench is a validation and profiling tool for AI infrastructure.

📢 v0.4.0 has been released!

Check aka.ms/superbench for more details.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.