Граф коммитов

920 Коммитов

Автор SHA1 Сообщение Дата
Zhenhua Han 94054cb6dc
Documentation for CGO execution engine (#4267) 2021-10-22 18:51:13 +08:00
Panacea 99c0f9380c
Fix unused hyperlink in doc (#4240) 2021-10-21 19:38:39 +08:00
Lijiaoa 379f9a0f67
New emoticons release (#4223) 2021-10-21 14:07:57 +08:00
Yuge Zhang 131302bc93
NAS benchmark docs update and backward-compat (#4256) 2021-10-21 14:06:33 +08:00
chenbohua3 c9cd53aa45
support dtype&scheme customization for QAT quantizer (#4137) 2021-10-13 15:17:55 +08:00
SparkSnail 3064363858
Support frameworkcontroller reuse mode (#4104) 2021-10-13 13:17:00 +08:00
J-shang 87001025a4
Update shared storage doc (#4217) 2021-09-28 10:14:32 +08:00
QuanluZhang 382286df27
improve NAS quickstart (#4094) 2021-09-10 16:29:09 +08:00
SparkSnail bf18854aeb
Add ServiceAccount description in doc (#4150) 2021-09-06 15:04:11 +08:00
J-shang 31fa1811a5
Update Experiment Config doc (#4131) 2021-09-06 09:45:45 +08:00
Weidan Kong e9c21fd3e8
HPO: Alibaba DSW+DLC support (#4055) 2021-08-23 19:45:05 +08:00
Yuge Zhang 5d0251fc49
Remove NAS UI (#4088) 2021-08-23 17:29:28 +08:00
QuanluZhang aff7f839c7
release note for v2.4 (#4058) 2021-08-11 20:56:44 +08:00
Jiahang Xu 26c58399d3
Refine the doc of Hardware-aware NAS (#4033) 2021-08-10 09:46:04 +08:00
J-shang 9cd42f61fb
fix shared storage (#4042) 2021-08-09 11:29:37 +08:00
liuzhe-lz a9ebcf4bd6
Update docs of building from source (#4004) 2021-08-03 22:22:16 +08:00
Bill Wu e5b4bf1a93
Fix transformer pruning example (#4002) 2021-08-03 18:50:41 +08:00
Jiahang Xu 40942f29b0
refactor nn-Meter multi-trial to adapt new structure of nn-Meter (#3987) 2021-07-30 19:58:12 +08:00
Bill Wu aa2cc9223e
Transformer Head Pruner (#3884) 2021-07-28 09:02:45 +08:00
J-shang 3f1e4f55b7
[Model Compression] fix compression doc and update a notebook example (#3955) 2021-07-28 09:01:01 +08:00
Ningxin Zheng 30361a2e87
update compression speedup documentation (#3979) 2021-07-27 17:14:54 +08:00
Yuge Zhang a7846135a8
Enable `fixed_arch` on Retiarii (#3972) 2021-07-27 17:14:01 +08:00
Yuge Zhang 08fe2924f5
Merge pull request #3938 from microsoft/nn-meter
[DO NOT SQUASH] Support nn-Meter in Retiarii framework
2021-07-27 13:51:26 +08:00
Yuge Zhang 5e04d56c51
Replace example_inputs with dummy_input (#3983) 2021-07-26 22:17:21 +08:00
SparkSnail ef9e27b9b3
Support kubeflow reuse mode (#3919) 2021-07-26 14:15:40 +08:00
liuzhe-lz deef0c424b
Update docs to v2 config (#3966) 2021-07-26 10:16:43 +08:00
Bill Wu 5bf2cb192a
HPO Benchmark Fixes and New Features (#3925) 2021-07-26 10:09:16 +08:00
chenbohua3 7fc5af0702
Add batch normalization folding to QAT quantizer (#3911) 2021-07-26 09:56:02 +08:00
Yuge Zhang 7d101f8371
Use python 3.9 on pipeline (#3881) 2021-07-23 17:08:21 +08:00
lin bin d8127e0284
[Model Compression] Add global sort for taylor pruner (#3896) 2021-07-20 14:23:51 +08:00
kvartet 7205cff578
Update Python API doc (#3885) 2021-07-16 17:31:32 +08:00
Ningxin Zheng 30df69bf5b
Fix integration test on speedup examples (#3945) 2021-07-16 14:06:58 +08:00
Yuge Zhang 403195f0eb
Merge branch 'master' into nn-meter 2021-07-15 16:02:47 +08:00
kalineid 99aa8226c6
[Retiarii]: Add info required by nn-meter to graph ir (#3910)
* Fix mutable default

* LayerChoice:forward now will default run the first candidate to support trace (#3910)

* New GraphConverter to parse shape info required by nn-meter (#3910)

* Support model filter in Random strategy

* Support latency aware search in SPOS multi-trial example

* Fix for review (#3910)

* Add doc for hardware-aware NAS

* Fix lint python & Add nn_meter to sphinx mock

* Add comments

* Move LatencyFilter to examples

* Move example inputs into configs

* Support nested layer choice

Co-authored-by: Jianyu Wei <v-wjiany@microsoft.com>
Co-authored-by: kalineid <nnob@mail.ustc.edu.cn>
Co-authored-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Yuge Zhang <Yuge.Zhang@microsoft.com>
2021-07-15 16:01:16 +08:00
QuanluZhang 5eb43ea781
[Retiarii] support hypermodule: autoactivation (#3868) 2021-07-15 13:42:28 +08:00
QuanluZhang 5fe245006a
[retiarii] support torch 1.8 and 1.9 (#3937) 2021-07-14 17:15:23 +08:00
Ningxin Zheng 7eedec46aa
Model Speedup Refactor (#3462) 2021-07-14 14:24:40 +08:00
Bill Wu 994a2d2363
[Example] Conditional GAN in pytorch (#3687) 2021-07-14 11:17:37 +08:00
kvartet fb3c596bce
Update Quickstart and remove autoCompletion in the doc (#3861) 2021-07-12 19:44:01 +08:00
Tab Zhang b29163aa76
add recommend type for selector (#3914) 2021-07-12 15:43:57 +08:00
Yuge Zhang 1bd17a025b
[Retiarii] Visualization (#3878) 2021-07-12 13:41:45 +08:00
SparkSnail 4b38e64ff4
Support view/resume experiment from external folder (#3870) 2021-07-12 13:09:30 +08:00
Ni Hao dde4d862ab
Add maxTrialDuration (#3863) 2021-07-11 14:11:13 +08:00
kvartet 3943239074
Update Chinese documentation (#3886) 2021-07-09 15:30:29 +08:00
lin bin a4760ce814
[Quantization speedup]support TensorRT8.0.0 (#3866) 2021-07-09 15:10:13 +08:00
lin bin 27e123df1e
fix data device type bug (#3856) 2021-06-22 13:33:24 +08:00
QuanluZhang 84507248cc
update readme (#3827)
Co-authored-by: Scarlett Li <39592018+scarlett2018@users.noreply.github.com>
Co-authored-by: kvartet <48014605+kvartet@users.noreply.github.com>
Co-authored-by: --help <xyru1999@gmail.com>
2021-06-15 21:08:42 +08:00
kvartet cf95cfc07c
Add release note and update versions to v2.3 (#3738)
Co-authored-by: Scarlett Li <39592018+scarlett2018@users.noreply.github.com>
Co-authored-by: Yuge Zhang <Yuge.Zhang@microsoft.com>
2021-06-15 18:19:35 +08:00
QuanluZhang 4146c71523
[Retiarii] refactor of NAS doc and make python engine default (#3785)
Co-authored-by: Scarlett Li <39592018+scarlett2018@users.noreply.github.com>
Co-authored-by: kvartet <48014605+kvartet@users.noreply.github.com>
2021-06-13 11:31:38 +08:00
gxiaotian 95f4c863fd
Adapt system auto tuning examples to NNI V2 (#3784) 2021-06-11 13:03:59 +08:00
Amit Shtober 54a89dd0e6
Update QuickStart.rst (#3732) 2021-06-10 19:48:18 +08:00
Lijiaoa 70f0b6a41e
update README webui img to gif (#3735)
Co-authored-by: Lijiao <Lijiaoa@outlook.com>
Co-authored-by: kvartet <48014605+kvartet@users.noreply.github.com>
2021-06-09 11:17:23 +08:00
kvartet d1b1e7b311
Update config v2 doc (#3711)
Co-authored-by: QuanluZhang <z.quanluzhang@gmail.com>
2021-06-08 13:56:58 +08:00
Lijiaoa d9dd29f322
[webui] update search doc (#3723)
Co-authored-by: Lijiao <Lijiaoa@outlook.com>
Co-authored-by: Yuge Zhang <scottyugochang@gmail.com>
2021-06-04 17:51:40 +08:00
J-shang b4da4a7b3b
fix typo in compression (#3727) 2021-06-04 16:55:18 +08:00
Yuge Zhang a284f71d11
Fix a few bugs in Retiarii and upgrade Dockerfile (#3713) 2021-06-03 14:48:56 +08:00
kvartet ed401808f9
Fix typo in nni/experiment/launcher.py (#3701) 2021-06-03 13:38:15 +08:00
Bill Wu e269db6dfe
Add benchmark support for DNGOTuner (#3720) 2021-06-03 13:36:38 +08:00
Yuge Zhang b955ac99a4
Use PyYAML instead of ruamel.yaml (#3702) 2021-06-01 10:38:46 +08:00
Bill Wu a7a3ef9474
HPO Benchmark doc and setup script fix (#3689) 2021-05-28 12:01:53 +08:00
Erfandarzi 5e3352073a
Documentation typo fix in DoReFa compression (#3693)
Co-authored-by: Darzidehkalani <BehDarzidehkaE@umcg.nl>
Co-authored-by: ErfanDarzi <Erfandarzi@gmail.com>
2021-05-28 12:01:26 +08:00
J-shang a8879dd62a
[Model Compression] auto compression (#3631) 2021-05-28 09:19:55 +08:00
98may 580c59791a
DNGO tuner (#3479)
Co-authored-by: Yuge Zhang <Yuge.Zhang@microsoft.com>
2021-05-28 09:19:21 +08:00
J-shang 9b0bc37891
[#3507 follow up] update doc (#3688) 2021-05-27 20:48:44 +08:00
Bill Wu 4c49db1223
HPO Benchmark (#3644) 2021-05-26 16:18:42 +08:00
Yuge Zhang 5df75c33cb
[Retiarii] New API: Repeat and Cell (#3481)
Co-authored-by: quzha <Quanlu.Zhang@microsoft.com>
2021-05-26 10:32:15 +08:00
Yuge Zhang 2f3c3951cf
[Retiarii] Pure-python execution engine (#3605) 2021-05-25 20:19:54 +08:00
Yuge Zhang 122b5b890e
[Retiarii] Policy-based RL Strategy (#3650) 2021-05-25 20:19:08 +08:00
colorjam 92f6754e6e
[Model Compression] Update api of iterative pruners (#3507) 2021-05-25 17:00:34 +08:00
Yiwu Yao ac14b9e413
New NAS algorithm: Blockwise DNAS FBNet (#3532) 2021-05-21 17:44:45 +08:00
chenbohua3 af929fdb84
Add LSQ quantizer (#3503) 2021-05-18 11:08:10 +08:00
Scarlett Li dddf0b9efa
Update retiarii_index.rst (#3639) 2021-05-14 13:42:49 +08:00
SparkSnail b7f374cebc
delete tensorboard on nnictl (#3613) 2021-05-10 17:19:20 +08:00
Yuge Zhang 2ca227f814
Support sphinx v4 (#3622) 2021-05-10 15:20:38 +08:00
SparkSnail 9b845fca09
Fix Hybrid mode doc (#3600) 2021-05-10 13:45:13 +08:00
BUPTLYH 3725c8fcc6
modify the config bug about Automatic Model Pruning using NNI Tuners (#3541) 2021-04-28 10:56:28 +08:00
SparkSnail e1295888eb
Fix release note (#3579) 2021-04-26 09:33:20 +08:00
SparkSnail 1e0a04c5d6
Change version from v2.1 to v2.2 (#3578) 2021-04-26 09:05:46 +08:00
kvartet 25dea8f552
Add release note for v2.2 (#3539) 2021-04-26 00:15:25 +08:00
liuzhe-lz d965808e56
Fix k8s and hybrid config (#3563) 2021-04-22 20:05:43 +08:00
J-shang 1418a366bc
add tensorboard doc (#3531) 2021-04-16 17:18:59 +08:00
J-shang 5d51637bb0
add doc and fix bug in experiment resume/view (#3524) 2021-04-16 16:43:47 +08:00
QuanluZhang 6aaca5f7ad
refactor of nas examples (#3513) 2021-04-09 16:35:40 +08:00
lin bin 26207d15ca
update doc for pr #3488(quantization speedup tool) (#3512) 2021-04-09 16:08:57 +08:00
QuanluZhang 200a1086b4
[Retiarii] support debug mode for easy debuggability (#3476) 2021-04-06 22:24:59 +08:00
colorjam 0494cae10f
Update readme doc link (#3482) 2021-04-03 22:54:46 +08:00
Markus Bauer fbffbc7c70
[WIP] Enable optional Pod Spec for FrameworkController platform (#3379) 2021-04-01 11:24:04 +08:00
lin bin 192e29d55f
Add doc for quantizer export_model() (#3473) 2021-03-29 11:26:11 +08:00
Bingqi Shang 86d63a076c
Fix typos in doc (#3448) 2021-03-26 17:00:41 +08:00
J-shang a0ae02e6c5
change v2.0 to v2.1 (#3443) 2021-03-10 19:24:28 +08:00
Ni Hao 62af469ba7
add how to monitor a job from aml studio. (#3436) 2021-03-10 17:06:06 +08:00
kvartet a45c6671ff
Add release note for v2.1 (#3433) 2021-03-10 17:05:42 +08:00
QuanluZhang 5afc83ecdd
[retiarii] doc update (#3432) 2021-03-10 11:30:53 +08:00
J-shang 4fc34df7be
Fix sharedstorage bug (#3426) 2021-03-08 16:47:37 +08:00
liuzhe-lz bc55eec660
Align `nni.experiment` tuner behavior with nnictl (#3419) 2021-03-08 12:32:32 +08:00
Ni Hao f897829772
rename preCommand to pythonPath (#3410) 2021-03-05 21:05:50 +08:00
kvartet 346721be81
Update Chinese translation (#3413) 2021-03-03 14:09:07 +08:00
kvartet 969f0d99d3
Fix bugs in doc (#3414) 2021-03-03 12:20:15 +08:00
J-shang 569c35e0ba
move ipython required to develop (#3411) 2021-03-03 12:19:50 +08:00
Yuge Zhang cae4308fce
[Retiarii] Rename APIs and refine documentation (#3404) 2021-03-03 12:19:11 +08:00
J-shang 79d3c49262
update sklearn version to 0.24.1 (#3407) 2021-03-03 12:14:58 +08:00
J-shang 464e33fea1
add python api example and update doc (#3396) 2021-02-25 18:36:20 +08:00
colorjam a8f0557968
Refactor Compression Doc (#3371) 2021-02-25 17:47:32 +08:00
J-shang 1338c512f4
support shared storage for reusable mode (#3354) 2021-02-25 15:08:22 +08:00
Scarlett Li 0d37a64a9e
Update community_sharings.rst (#3397) 2021-02-25 09:13:58 +08:00
Yuge Zhang aea82d7154
[Retiarii] Use ValueChoice inline in a serializable instance (#3382) 2021-02-24 16:41:31 +08:00
Yuge Zhang fddc8adc87
[Retiarii] Grid search, random and evolution strategy (#3377) 2021-02-24 15:37:40 +08:00
Ni Hao 06e5aa7878
Change command lines as serial. (#3367) 2021-02-23 15:00:34 +08:00
Yuge Zhang 445e7e0b74
[Retiarii] Rewrite trainer with PyTorch Lightning (#3359) 2021-02-14 22:34:48 +08:00
J-shang b698806284
migrate nnicli (#3334) 2021-02-05 17:20:10 +08:00
colorjam a9dcc00670
Refactor model compression examples (#3326) 2021-02-04 16:47:33 +08:00
Yuge Zhang 8c8db3746c
[Retiarii] Improve high-level API interface and add implementation of ValueChoice (#3349) 2021-02-03 10:54:42 +08:00
kvartet 8134be6269
Update wrong date and section headers in ChangeLog (#3314)
* date error

* section headers

* changelog
2021-01-20 11:21:50 +08:00
liuzhe 349ead4167 Merge branch 'v2.0' into master 2021-01-14 14:00:46 +08:00
kvartet 649ee5975b
Add release note for v2.0 (#3291) 2021-01-14 13:04:13 +08:00
Scarlett Li 66305ea67b
Update Readme and community_sharings.rst for 2.0 release (#3297) 2021-01-14 00:45:33 +08:00
Houwen Peng 04728c4555
Update Overview.rst (#3300) 2021-01-13 19:33:15 +08:00
Ningxin Zheng 57b1afabfd
update the compression doc (#3293) 2021-01-13 19:32:57 +08:00
Yuge Zhang 3fdfb3345d
Hot-fix for experiment APIs on readthedocs (#3290) 2021-01-13 15:51:38 +08:00
QuanluZhang 92ae65e916
[retiarii] add doc: customizing a new exploration strategy (#3287) 2021-01-13 15:44:38 +08:00
Lijiaoa 06001775d5
fix click row bug and update experiment id color (#3289) 2021-01-13 15:44:08 +08:00
Yuge Zhang 23874919f4
Customize trainer document (#3282) 2021-01-08 18:38:56 +08:00
liuzhe-lz dfbe5a1a0d
update version number, copyright year, class name (#3285) 2021-01-08 18:04:34 +08:00
Lijiaoa 796da2174b
Update webui doc in quickStart.rst file (#3277)
Co-authored-by: Lijiao <Lijiaoa@outlook.com>
2021-01-08 17:07:58 +08:00
Yuge Zhang 067db4e2ed
Add new and upgrade dependencies for docs (#3281) 2021-01-08 16:47:24 +08:00
liuzhe-lz 64e2860b7a
Change quick start example to pytorch and update install from source doc (#3266) 2021-01-07 14:32:18 +08:00
liuzhe-lz 76003a7551
Experiment config doc (#3222) 2021-01-07 07:24:01 +08:00
colorjam 5882039607
Remove useless files in model compression examples (#3242) 2021-01-06 09:55:43 +08:00
J-shang 7a1f09d985
update customized algos doc (#3241) 2021-01-05 21:25:01 +08:00
SparkSnail c702241ec4
Rename heterogeneous to hybrid (#3252) 2021-01-05 13:08:39 +08:00
J-shang b4f0d321dc
add launch from python code doc (#3217) 2021-01-05 12:50:56 +08:00
SparkSnail 8a08fab6f6
Remove paiYarn doc and add reuse config in remote doc (#3253) 2021-01-05 11:27:58 +08:00
kvartet 25db55caee
Update Chinese documents (#3243) 2021-01-05 11:25:14 +08:00
J-shang fce6ab4d41
modify customized tuner doc and fix typo in training service doc (#3234)
* fix typo in training service doc

* modify local mode doc

* modify customized tuner doc

* fix lint

* fix typo

* remove indent

* remove install customized tuner doc

* fix typo

* fix typo
2021-01-05 09:00:36 +08:00
Houwen Peng 53b565e481
Request for Updating Cream NAS algorithm (#3228) 2021-01-04 18:39:42 +08:00
Lijiaoa bdb2826e49
Update webui doc image and add experiments management module (#3229) 2021-01-04 17:41:54 +08:00
QuanluZhang fdd22cba91
[retiarii] document (#3221) 2021-01-04 10:39:07 +08:00
J-shang 9e5e0e3c3f
fix pruner doc typo and example bug (#3223) 2020-12-25 17:20:11 +08:00
lin bin cc58a81dc8
Add quantized model export description (#3192) 2020-12-25 11:23:22 +08:00
kvartet 1e439e4519
Fix bug in document conversion (#3203) 2020-12-25 11:22:50 +08:00
liuzhe-lz a1016a6ca0
New experiment config (#3138) 2020-12-21 05:35:02 +08:00
Yuge Zhang f8424a9fe6
Prune archive directories (#3194) 2020-12-16 11:09:34 +08:00
Yuge Zhang 12a5e3de1c
Refactor HPO tuner code hierarchy (#3187)
Co-authored-by: liuzhe <liuzhe.cs@pku.edu.cn>
2020-12-15 13:44:48 +08:00
SparkSnail 872554f1cc
Support heterogeneous environment service (#3097) 2020-12-15 09:59:37 +08:00
hao-howard-zhang af19888828
Support Custom Kubernetes Namespace in AdaptDL Mode (#3176) 2020-12-14 05:39:57 +08:00
J-shang c1e926b994
fix generate parameter format (#3175) 2020-12-12 02:35:30 +08:00
chicm-ms 0d3f13a3e2
Refactor builtin/customized tuner installation (#3134) 2020-12-12 01:53:48 +08:00
98may 697c60ec2e
new feature : NAS-NLP-benchmark (#3140) 2020-12-12 00:56:29 +08:00
Yuge Zhang 5bf5e46c69
Port markdown docs to rst and introduce "githublink" (#3107) 2020-12-10 13:38:16 +08:00
hao-howard-zhang dbb2434f5d
Fix AdaptDL Intergration (#3153) 2020-12-09 12:00:12 +08:00
Andrew Hundt 1a999d705c
Update EfficientNet.md to clarify repo versions (#3158) 2020-12-09 10:44:54 +08:00
QuanluZhang 2dc8a0deec
list our research works in doc (#3150) 2020-12-03 15:36:58 +08:00
Houwen Peng 604f8431d1
Request for Integrating the new NAS algorithm: Cream (#2705) 2020-11-27 16:42:41 +08:00
SparkSnail 055885d9a7
Merge dev-adl2 into Master (#3117) 2020-11-25 14:57:49 +08:00
98may e9c62bac79
Optimized layout of PaiMode.md (#3085) 2020-11-24 09:21:38 +08:00
colorjam b6233e524b
Refactor flops counter (#3048) 2020-11-23 10:21:13 +08:00
J-shang 26b71c40e3
Hyperband Refector (#3040) 2020-11-13 16:38:50 +08:00
colorjam d2605ca27c
Update NAS examples & doc (#3074)
* update title level

* Update examples & reproduction results of darts

Co-authored-by: colorjam <im.cqyan@google.com>
2020-11-09 10:43:24 +08:00
liuzhe-lz bc0f8f338b
Refactor code hierarchy part 3: Unit test (#3037) 2020-10-30 12:39:34 +08:00
liuzhe 3b90b9d9b7 Merge branch 'master' into v2.0-merge 2020-10-26 23:37:44 +08:00
liuzhe-lz e21a6984cc
[v2.0] Refactor code hierarchy (part 2) (#2987) 2020-10-26 23:21:59 +08:00
QuanluZhang e353cedbbe
release note for v1.9 (#3019) 2020-10-22 18:48:41 +08:00
Lijiaoa e099557436
[doc-v1.9] update webui document (#2985) 2020-10-22 14:07:13 +08:00
QuanluZhang b5e4d15dab
change v1.8 to v1.9 (#3017) 2020-10-22 14:03:14 +08:00
Yuge Zhang eda4805757
Change all master links to v1.9 (#3005) 2020-10-21 16:25:51 +08:00
liuzhe-lz f98ee6721a
[v2.0] Refactor code hierarchy (part 1) (#2962) 2020-10-20 06:57:09 +08:00
chicm-ms d5036857bb
Fix amc example (#2976) 2020-10-19 14:52:02 +08:00
SparkSnail 143b5e2df9
Fix aml doc (#2965) 2020-10-19 14:22:47 +08:00
Anshu Trivedi f793d85a15
Typo mistake in Overview.md (#2977) 2020-10-19 12:14:09 +08:00
colorjam 2750d1a51a
update title level (#2969)
Co-authored-by: liuzhe-lz <40699903+liuzhe-lz@users.noreply.github.com>
Co-authored-by: colorjam <im.cqyan@google.com>
2020-10-19 12:13:20 +08:00
chicm-ms 6126960c57
AMC supports resnet (#2876) 2020-10-10 16:40:58 +08:00
SparkSnail 392e55f392
Support remote training service use reuse mode (#2923) 2020-10-10 15:10:41 +08:00
chicm-ms 1ae8a0db98
Refactoring model compression doc (#2919) 2020-10-10 13:31:20 +08:00
Tab Zhang 8d3f444ab1
[tuner] Regularized Evolution (#2802) 2020-10-10 09:46:00 +08:00
Ningxin Zheng 986d58c15b
put the image on a new line (#2920) 2020-09-24 10:47:34 +08:00
Tab Zhang 77bc0e3383
Search Space Zoo nas bench 201 (#2766) 2020-09-23 10:34:19 +08:00
Ningxin Zheng ec5af41fdc
Constraint-aware one-shot pruners (#2657) 2020-09-21 23:57:03 +08:00
J-shang a480208306
fix experiment import bug and add it cases: experiment import (#2878) 2020-09-21 18:48:13 +08:00
J-shang f892ed67aa
Add preCommand option to support configuring experimental environment by user (#2875) 2020-09-21 18:38:33 +08:00
SparkSnail 6e967f507d
Support saving search space in experiment load&save command (#2886) 2020-09-21 10:35:05 +08:00
Yuge Zhang 0e40187514
Add pygments as dependency (#2909) 2020-09-19 21:56:20 +08:00
Junwei Sun 0e49e6591a
Update Chinese Translation (#2871)
* New Crowdin translations by Github Action

* remove removed files in en_US

Co-authored-by: Crowdin Bot <support+bot@crowdin.com>
2020-09-18 17:11:52 +08:00
Junwei Sun 98a49b188a
Update bash-completion (#2857) 2020-09-14 18:23:01 +08:00
lin bin bc71a0d640
Update QuickStart.md (#2884) 2020-09-14 13:33:44 +08:00
QuanluZhang e51aca428b
update the NNI architecture figure (#2805) 2020-09-07 11:05:00 +08:00
Scarlett Li 195b7f9e21
Update BuiltinTuner.md (#2814) 2020-09-03 18:32:06 +08:00
Yuge Zhang bf8be1e705
Merge pull request #2837 from microsoft/v1.8
Merge v1.8 back to master
2020-08-28 11:37:48 +08:00
Yuge Zhang e06a9ddafc
Release note v1.8 (#2829)
* Replace all v1.7 with v1.8

* Add v1.8 release note

* Change PAI into OpenPAI

* Update Release.md

* Refine relase note

* Update date of release

Co-authored-by: QuanluZhang <z.quanluzhang@gmail.com>
2020-08-27 16:21:50 +08:00
Junwei Sun 320407b1e2
update image of aml doc (#2836) 2020-08-27 16:00:43 +08:00
Guoxin 9f44d54a75
use doc in master branch instead of release branch (#2826) 2020-08-26 15:31:23 +08:00
Guoxin 4f70fb3074
fix broken link in compression benchmark doc (#2823)
* fix broken link in compression benchmark doc

* use v1.8 link in doc
2020-08-25 16:14:10 +08:00
Yuge Zhang 8c6a64070e
Refine NAS benchmark docs and examples (#2800)
* Refine NAS benchmark docs and examples

* Improve docs of NAS benchmark
2020-08-24 16:21:02 +08:00
tblanchart 71403bf1c0
Update GradientFeatureSelector.md (#2803)
Typo correction.
2020-08-21 17:43:24 +08:00
chicm-ms 07cb73b190
Update python version requirements to 3.6 (#2790) 2020-08-13 19:13:57 +08:00
Junwei Sun 6ec2adeed3
update experiment dir (#2753) 2020-08-13 19:12:08 +08:00
chicm-ms e9f3cddf95
AutoML for model compression (#2573) 2020-08-12 20:00:43 +08:00
Junwei Sun f82ef623c1
update nnicli (#2713) 2020-08-12 19:58:51 +08:00
Tab Zhang 44954e0caa
add nnictl command to list trial results with highest/lowest metric (#2747) 2020-08-12 18:10:29 +08:00
liuzhe-lz 5623dbf329
Compression for Tensorflow (#2755) 2020-08-12 14:02:58 +08:00
Tab Zhang d654eff441
feature: export experiment results (#2706) 2020-08-12 13:30:13 +08:00
lin bin bcefce6a81
Add supporting sklearn=0.23.2 for nni (#2777) 2020-08-12 10:53:01 +08:00
SparkSnail d5072a29f5
Support save and open experiments (#2750) 2020-08-12 09:31:42 +08:00
Ningxin Zheng 8961d7a5d3
Sensitivity pruner (#2684) 2020-08-11 19:33:30 +08:00
SparkSnail 995f625963
Enable gpu scheduler in AML mode (#2769) 2020-08-11 18:06:41 +08:00
Guoxin accb40f9d9
compression benchmark (#2742) 2020-08-11 11:32:41 +08:00
Guoxin 41312de5dc
Compression doc structure refactor (#2676)
* init sapruner

* seperate sapruners from other one-shot pruners

* update

* fix model params issue

* make the process runnable

* show evaluation result in example

* sort the sparsities and scale it

* fix rescale issue

* fix scale issue; add pruning history

* record the actual total sparsity

* fix sparsity 0/1 problem

* revert useless modif

* revert useless modif

* fix 0 pruning weights problem

* save pruning history in csv file

* fix typo

* remove check perm in Makefile

* use os path

* save config list in json format

* update analyze py; update docker

* update

* update analyze

* update log info in compressor

* init NetAdapt Pruner

* refine examples

* update

* fine tune

* update

* fix quote issue

* add code for imagenet  integrity

* update

* use datasets.ImageNet

* update

* update

* add channel pruning in SAPruner; refine example

* update net_adapt pruner; add dependency constraint in sapruner(beta)

* update

* update

* update

* fix zero division problem

* fix typo

* update

* fix naive issue of NetAdaptPruner

* fix data issue for no-dependency modules

* add cifar10 vgg16 examplel

* update

* update

* fix folder creation issue; change lr for vgg exp

* update

* add save model arg

* fix model copy issue

* init related weights calc

* update analyze file

* NetAdaptPruner: use fine-tuned weights after each iteration; fix modules_wrapper iteration issue

* consider channel/filter cross pruning

* NetAdapt: consider previous op when calc total sparsity

* update

* use customized vgg

* add performances comparison plt

* fix netadaptPruner mask copy issue

* add resnet18 example

* fix example issue

* update experiment data

* fix bool arg parsing issue

* update

* init ADMMPruner

* ADMMPruner: update

* ADMMPruner: finish v1.0

* ADMMPruner: refine

* update

* AutoCompress init

* AutoCompress: update

* AutoCompressPruner: fix issues:

* add test for auto pruners

* add doc for auto pruners

* fix link in md

* remove irrelevant files

* Clean code

* code clean

* fix pylint issue

* fix pylint issue

* rename admm & autoCompress param

* use abs link in doc

* reorder import to fix import issue: autocompress relies on speedup

* refine doc

* NetAdaptPruner: decay pruning step

* take changes from testing branch

* refine

* fix typo

* ADMMPruenr: check base_algo together with config schema

* fix broken link

* doc refine

* ADMM:refine

* refine doc

* refine doc

* refince doc

* refine doc

* refine doc

* refine doc

* update

* update

* refactor AGP doc

* update

* fix optimizer issue

* fix comments: typo, rename AGP_Pruner

* fix torch.nn.Module issue; refine SA docstring

* fix typo

Co-authored-by: Yuge Zhang <scottyugochang@gmail.com>
2020-07-31 20:22:15 +08:00
Yuge Zhang 717877d0ea
Add API to query intermediate results in NAS benchmark (#2728) 2020-07-31 13:50:05 +08:00
Junwei Sun 98e86841ce
update package version of docker doc (#2720) 2020-07-29 10:54:08 +08:00
Tab Zhang eb9b72a3a3
ENAS and DRATS search space zoo (#2589) 2020-07-27 10:39:49 +08:00
Junwei Sun 66f2777fec
add tutorial for colab support (#2700) 2020-07-24 17:08:57 +08:00
Yuge Zhang 754b0043cf
Add WebUI mock server and improve hyper-parameter parallel coordinates chart (#2691) 2020-07-24 12:59:24 +08:00
Lijiaoa 0f33bc7e40
fix typo "vv1.7" (#2687) 2020-07-17 17:27:42 +08:00
chicm-ms fa6a23cf70
Update nni exp dir (#2686) 2020-07-17 16:46:49 +08:00
QuanluZhang 3a2b24846c
update doc of community sharing (#2640) 2020-07-16 21:59:48 +08:00
SparkSnail a16db11bbf
Update doc for PAI (#2685) 2020-07-16 15:12:21 +08:00
chicm-ms f80f30dfd8
update version number (#2665) 2020-07-08 22:43:49 +08:00
chicm-ms 755e313f14
Merge pull request #2664 from microsoft/v1.7
V1.7 merge back to master
2020-07-08 22:43:21 +08:00
SparkSnail 51aebf18ec
Fix aml doc (#2631) 2020-07-08 21:25:02 +08:00
chicm-ms 954800e31a
V1.7 release note (#2662) 2020-07-08 21:03:37 +08:00
Yuge Zhang 47b75d8931
Add nniignore example link in training service docs (#2660) 2020-07-08 16:27:36 +08:00
Junwei Sun 79228750ed
specific branch version of `git clone` (#2659) 2020-07-08 16:13:43 +08:00
Tom Rochette 688feedbde
Typo fixes in the documentation (#2638) 2020-07-08 14:34:45 +08:00
Junwei Sun c4fd7151e7
Update docs for aml and nasbenchmark, re-submit from #2647 (#2651) 2020-07-08 12:39:27 +08:00
Tom Rochette a77f52ec9e
Update search space documentation (#2637) 2020-07-08 10:49:41 +08:00
Yuge Zhang fe6111d3e1
Eject docker usages in NAS benchmarks (#2645) 2020-07-08 00:18:34 +08:00
gxiaotian 4a76b68cb2
refine opevo doc (#2646) 2020-07-07 17:14:56 +08:00
colorjam c52556695f
FLOPs/Params counter refinement (#2632) 2020-07-07 16:30:33 +08:00
SparkSnail 3cffe34030
remove gupNum in accessor (#2641) 2020-07-07 16:17:12 +08:00
chicm-ms c9f70a6ad4
Fix customized tuner doc (#2628) 2020-07-07 14:33:22 +08:00
Chi Song c5ac923afc
Chinese translation (#2458) 2020-07-01 14:55:14 +08:00
SparkSnail 93f96d4f74
Support aml (#2615) 2020-07-01 10:13:03 +08:00
Guoxin f5caa19316
Auto pruners (#2490) 2020-06-30 22:50:48 +08:00
colorjam a3b0bd7d27
Add flops and params counter (#2535) 2020-06-30 22:49:05 +08:00
chicm-ms 19eabd6966
Refactor model compression documentation (#2612) 2020-06-30 14:25:37 +08:00
Chi Song 0b9d6ce6d1
Reuse OpenPAI jobs to run multiple trials (#2521)
Designed new interface to support reusable training service, currently only applies to OpenPAI, and default disabled.

Replace trial_keeper.py to trial_runner.py, trial_runner holds an environment, and receives commands from nni manager to run or stop an trial, and return events to nni manager.
Add trial dispatcher, which inherits from original trianing service interface. It uses to share as many as possible code of all training service, and isolate with training services.
Add EnvironmentService interface to manage environment, including start/stop an environment, refresh status of environments.
Add command channel on both nni manager and trial runner parts, it supports different ways to pass messages between them. Current supported channels are file, web sockets. and supported commands from nni manager are start, kill trial, send new parameters; from runner are initialized(support some channel doesn't know which runner connected), trial end, stdout ((new type), including metric like before), version check (new type), gpu info (new type).
Add storage service to wrapper a storage to standard file operations, like NFS, azure storage and so on.
Partial support run multiple trials in parallel on runner side, but not supported by trial dispatcher side.
Other minor changes,

Add log_level to TS UT, so that UT can show debug level log.
Expose platform to start info.
Add RouterTrainingService to keep origianl OpenPAI training service, and support dynamic IOC binding.
Add more GPU info for future usage, including GPU mem total/free/used, gpu type.
Make some license information consistence.
Fix async/await problems on Array.forEach, this method doesn't support async actually.
Fix IT errors on download data, which causes by my #2484 .
Accelerate some run loop pattern by reducing sleep seconds.
2020-06-30 12:54:35 +08:00
gxiaotian 6de15707c1
Add OpEvo example (#2549) 2020-06-30 10:55:19 +08:00
Yuge Zhang 25c4c3b5fa
Add docs for nniignore and improve docs of training service (#2561)
* Improve docs

* All using # to start

* uploaded -> excluded

* Set versionCheck default to true

* Add .nniignore example

* Rename training service docs

* Update training service docs

* Fix step numbering

* Resolve comments

* Fix typo

* Resolve comments

* Fix broken link
2020-06-29 19:09:10 +08:00
QuanluZhang 3d57dd7370
Refactor doc of NNI model compression (#2595) 2020-06-29 17:40:33 +08:00
Tab Zhang 813e41156a
format tuner and accessor README (#2588) 2020-06-29 11:11:44 +08:00
Tab Zhang ab6406340c
add description about update_search_space (#2597) 2020-06-29 11:08:01 +08:00
Tab Zhang 5a805e36bf
format nnictl tutorial (#2599) 2020-06-29 11:06:14 +08:00
Yuge Zhang b91aba399b
NAS Benchmark (#2578)
* Adding NAS Benchmark (201)

* Add missing endline

* Update script

* Draft for NAS-Bench-101

* Update NAS-Bench-101

* Update constants

* Add API

* Update API

* Fix typo

* Draft for NDS

* Fix issues in storing loss

* Fix cell_spec problem

* Finalize NDS

* Update time consumption

* Add nds query function

* Update documentation for NAS-Bench-101

* Reformat generators

* Add NAS-Bench-201 docs

* Unite constant names

* Update docstring

* Update docstring

* Update rst

* Update scripts

* Add git as dependency

* Apt update

* Update installation scripts

* Fix dependency for pipeline

* Fix NDS script

* Fix NAS-Bench-201 installation

* Add example notebook

* Correct latency dimension

* shortcuts -> query

* Change run -> trial, ComputedStats -> TrialStats

* ipynb needs re-generation

* Fix NAS rst

* Fix documentation and pylint

* Fix pylint

* Add pandoc as dependency

* Update pandoc dependency

* Fix documentation broken link
2020-06-29 10:31:34 +08:00
QuanluZhang 9a1fb17bd4
support tf2 NAS with non-weight-sharing mode (#2541) 2020-06-27 12:39:31 +08:00
Ningxin Zheng eee2f532c1
Add schema and tesorboard into the doc building dependency. (#2594) 2020-06-27 10:46:29 +08:00
Ningxin Zheng e6817d22d4
Support the Resnet/Squeezenet/Mobilenet for speedup (#2579) 2020-06-24 11:39:18 +08:00
chicm-ms a576401673
Install builtin tuners (#2439) 2020-06-23 13:27:41 +08:00
Yuge Zhang 10e5656078
Add shortcut to merge parameter into base setup (#2540) 2020-06-19 17:11:37 +08:00
colorjam 1a6cc41441
add taylorfoweight into supported algo (#2551) 2020-06-17 18:07:31 +08:00
Ningxin Zheng c3d7b4c579
Analysis utils (#2435) 2020-06-16 14:16:56 +08:00
Lijiaoa ba42b6a44d
add link for 'NNI on Windows' (#2547)
* fix link

* sync release version

Co-authored-by: Lijiao <15910218274@163.com>
2020-06-12 18:02:11 +08:00