923ce2773f
Benchmarks: Code Revision - Revise BenchmarkRegistry interfaces for integration with executor. ( #33 )
...
* revise BenchmarkRegistry interfaces.
* address comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-04-08 23:17:03 +08:00
2871a68b62
Benchmarks: Code Revision - Revise result process interface and add result checking ( #32 )
...
* revise result process interface
* add more comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-04-08 11:54:37 +08:00
0e2b2b0829
Update logger ( #28 )
...
Update logger class.
* add file handler along with stream handler
* add colored formatter
2021-03-29 14:06:55 +08:00
28de899375
Benchmarks: Add Example - Add pytorch-bert-large as the model benchmark example. ( #30 )
...
* add bert-large as the model benchmark example
* add more arguments.
* address comments.
* delete duplicated file.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-29 12:39:38 +08:00
dc493b1b27
fix bug when convert Enum.value to string ( #29 )
...
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-29 11:41:57 +08:00
91b44bc5a1
CLI: Code Revision - Use omegaconf to replace hydra for configuration ( #27 )
...
Use omegaconf to replace hydra for configuration system:
* remove hydra
* use omegaconf to merge configurations
2021-03-26 21:19:17 +08:00
0972b223a1
Benchmarks: Add Benchmark - Add Pytorch BERT benchmarks, including bert-base and bert-large. ( #20 )
...
* add pytorch bert benchmarks.
* revise code
* fix issue
* revise code.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-26 17:16:40 +08:00
8d24d03d9a
Benchmarks: Code Revision - Move benchmarks auto-registration from registry.py to __init__.py ( #24 )
...
* move benchmarks registration from registry.py to __init__.py
* revise __init__.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-22 23:27:21 +08:00
5dfcc6be24
Benchmarks: Add Feature - Add benchmark finish check according to num_warmup/num_steps and duration in ModelBenchmark class. ( #25 )
...
* add is_finished function
* reuse current time.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-22 10:37:37 +08:00
3be4d8eecd
Benchmarks: Add Feature - Register all benchmarks by import model_benchmarks/micro_benchmarks/docker_benchmarks. ( #21 )
...
* clean code.
* minor change.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-18 14:44:01 +08:00
c00dc67021
Benchmarks: Add Feature - Add sample_count argument for ModelBenchmark. ( #22 )
...
* add sample_count argument.
* handle more condidatins.
* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-18 14:33:46 +08:00
31b6f0851a
Benchmarks: Code Revision - Support benchmark re-registration, keep the latest one. ( #23 )
...
* support benchmark re-registration.
* address comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-18 13:47:10 +08:00
5b9b5cc8bf
Benchmarks: Add Test - Add tests for PytorchBase module. ( #18 )
...
* add pytorch base tests.
* add more test cases.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-17 17:50:51 +08:00
80f434cb53
add more checks for PytorchBase module ( #19 )
...
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-15 11:57:19 +08:00
5d11579a10
CLI - Add command sb [version,deploy,exec,run] ( #10 )
...
- Add CLI commands
* sb version
* sb deploy
* sb exec
* sb run
- Add interface with executor and runner
- Add cli test cases
2021-03-12 13:16:43 +08:00
ebea2d5053
Benchmarks: Add Feature - Add random dataset for Pytorch. ( #17 )
...
* add random dataset.
* install pytorch-cpu for test docker.
* fix typo
* add more test cases.
* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-12 02:30:44 +08:00
52848d2fc8
Benchmarks: Add Feature - Add flag to disable GPU. ( #15 )
...
* add flag to disable GPU.
* fix spelling
* fix unittest.
* address comments.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-10 00:59:47 +08:00
83a4e93f4d
rename _cal_params_size as _cal_params_count. ( #16 )
...
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-09 14:02:46 +08:00
088aa19a89
Benchmarks: Add Feature - Add pytorch base class ( #11 )
...
* add pytorch base class
* address comments
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-08 16:22:20 +08:00
52b52c2cbc
Benchmarks: Add Feature - Add optimizer definition in Model Base ( #13 )
...
* add optimizer definition and function to create torch optimizer.
* move optimizer enum into model_base module.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-08 09:58:39 +08:00
9388f8f56a
add more checks for model base ( #12 )
...
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-04 13:20:13 +08:00
abc6c991af
fix typos ( #14 )
...
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-03-04 13:15:03 +08:00
4c87a3e419
Benchmarks: Initialization - Add base class, registry, and result ( #1 )
...
* benchmarks init.
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
2021-02-24 12:43:24 +08:00
d32b96eb98
Setup: Add Test - Add Codecov ( #9 )
...
Add code coverage configuration.
2021-02-04 10:43:43 +08:00
b1a42c38af
Setup: Add Feature - Add contribute rules ( #8 )
...
* Setup: Add contribute rules
2021-02-03 11:05:51 +08:00
3f19685fd9
Docs - Initialize README ( #6 )
...
Initialize README.md and update SUPPORT.md, update
* project description
* installation
* usage
* developer guide
* add dependencies version requirement
2021-02-01 20:21:12 +08:00
a897738699
Setup: Revision - Update lint rules ( #7 )
...
Update some lint rules, including:
* change max line length from 79 to 120, following [pytorch]
* add dedent_closing_brackets in yapf
* remove typed def requirements in mypy
Fix return code bug in setup.py, when lint/test command return 1,
`os.system` will return 256 and `sys.exit(256)` will get return code 0.
[pytorch]: https://github.com/pytorch/pytorch/blob/d1dcd5f/.flake8#L3
2021-02-01 14:12:02 +08:00
8ae0138004
Setup: template - Add template for PR, bug report and enhancement request ( #5 )
...
Add template for PR, bug report and enhancement request
2021-01-29 18:29:26 +08:00
5be32481b1
Setup: Init - Initialize setup.py and basic configs ( #4 )
...
Initialize setup.py and basic configurations for this project.
Major revisions:
- initialize setup.py for Python package
- add gitignore and dockerignore
- add editorconfig for editors
- configure yapf for auto formating
- configure mypy for type hint
- configure flake8 for lint, including quotes and docstrings
- add pre-commit check for `git commit`
- add spelling check in GitHub Actions
- format existing files according to configured rules
Example usage:
# install dependencies
$ python3 -m pip install -e .[dev,test]
$ pre-commit install
# format code automatically
$ python3 setup.py format
# lint code
$ python3 setup.py lint
# test code
$ python3 setup.py test
2021-01-28 21:01:28 +08:00
a0a145a855
Setup: Reviewers - Add default reviewers of the repo ( #3 )
...
* Setup: Reviewers - Add default reviewers of the repo
**Description**
Add default reviewers of the repo
**Major Revision**
- Add default reviewers of the development
- Add default reviewers for the docs
2021-01-28 10:11:23 +08:00
1429bf423d
CI: Initialization - Add Azure Pipelines for checking format and running pytest ( #2 )
...
**Description**
Init Azure Pipelines for checking format and running pytest.
**Major Revision**
- Add azure-pipelines.yml for running Azure Pipelines.
- Add Dockerfile and test/test_example.py for checking format and running pytest.
2021-01-26 10:42:51 +08:00
dc79112326
Initial SUPPORT.md commit
2020-12-16 18:22:31 -08:00
0d07231739
Initial SECURITY.md commit
2020-12-16 18:22:29 -08:00
a4dcec74ba
Updating README.md to template content
2020-12-16 18:22:27 -08:00
bf5762fe4f
Initial LICENSE commit
2020-12-16 18:22:25 -08:00
2b5675b297
Initial CODE_OF_CONDUCT.md commit
2020-12-16 18:22:21 -08:00
8bd6afdb8d
Initial commit
2020-12-17 10:02:57 +08:00
guoshzhao
Yifan Xiong
TobeyQin
Peng Cheng
Microsoft Open Source