Граф коммитов

6 Коммитов

Автор SHA1 Сообщение Дата
guoshzhao 80dcc8aaec
Benchmarks: Add Benchmark - Add FAMBench based on docker benchmark (#338)
**Description**
Integrate FAMBench into superbench based on docker implementation:
https://github.com/facebookresearch/FAMBench

The script to run all benchmarks is:
https://github.com/facebookresearch/FAMBench/blob/main/benchmarks/run_all.sh
2022-04-11 15:31:07 +08:00
guoshzhao 6d895da83c
Benchmarks: Add Feature - Provide option to save raw data into file. (#333)
**Description**
Use config `log_raw_data` to control whether log the raw data into file or not. The default value is `no`. We can set it as `yes` for some particular benchmarks to save the raw data into file, such as NCCL/RCCL test.
2022-04-01 16:26:09 +08:00
Yuting Jiang 9f56b2198f
Benchmarks: Unify metric names of benchmarks (#252)
**Description**
Unify metric names of benchmarks.
2021-12-09 04:48:42 +00:00
guoshzhao e98a68124e
Benchmarks: Add Benchmark - Add onnx model benchmarks based on docker image. (#227)
Add RocmOnnxModelBenchmark class to run benchmarks packaged in superbench/benchmark:rocm4.3.1-onnxruntime1.9.0
2021-10-27 18:41:40 +08:00
guoshzhao f841c8f466
Benchmarks: Add Feature - Support AMD and CUDA platform for DockerBenchmark. (#226)
Description
Add CudaDockerBenchmark and RocmDockerBenchmark to support amd and cuda platform for DockerBenchmark.
2021-10-22 15:22:15 +08:00
guoshzhao 37d5dfd5ed
Benchmarks: Code Revision - revise the DockerBenchmark base class (#179)
**Description**
Revise the DockerBenchmark base to support image pull, image rm etc.

**Major Revision**
- image pull in _preprocess()
- image clean in _postprocess()
- execute customized commands in _benchmark()
- add unit tests
2021-09-01 22:15:42 +08:00