Граф коммитов

475 Коммитов

Автор SHA1 Сообщение Дата
Yuge Zhang 19cb631537
Mutable shortcut and enhancements (#5336) 2023-02-15 10:38:42 +08:00
Yuge Zhang 1160fa734c
Refactor nas.nn (Stage 2) - Choices (#5280) 2023-02-13 10:37:13 +08:00
liuzhe-lz 9e1a8e8ff7
Local Training Service V3 (#5243) 2023-02-08 07:20:28 +08:00
Yuge Zhang 48f2df5706
Refactor nas.nn (Stage 1) - MutableModule (#5279) 2023-02-07 09:41:52 +08:00
Yuge Zhang 74f13f31a4
Refactor graph-based model space (#5270) 2023-02-05 10:07:38 +08:00
J-shang 6f5dd231ae
[Compression] v2.5 stage 1: add setting & test (#5292) 2023-02-02 10:27:03 +08:00
Yuge Zhang f33e8e5f88
NAS executable model space (#5269) 2023-01-18 14:21:00 +08:00
Louis-J d9be0e6b14
fix(speedup): fix the error on jit translation of 'aten::to.dtype_layout' in pytorch <= 1.10 (#5315) 2023-01-16 21:15:12 +08:00
Louis-J 8418f8021e
feat(speedup): add the concrete_trace_utils, to extend the torch.fx feature to trace more models into fx.graph (#5121) 2023-01-16 13:01:51 +08:00
Yuge Zhang 13c0b3d6ee
NAS evaluator V3 (#5268) 2023-01-16 00:15:06 +08:00
Yuge Zhang 8bcd9ed23f
Rerun flaky tests (#5316) 2023-01-13 10:40:34 +08:00
Yuge Zhang e43272a972
[Serializer] `_load`, `_dump` and `_unwrap_parameter` (#5267) 2023-01-04 13:43:23 +08:00
Yuge Zhang 7f1495c8b3
Trial command channel (#5254) 2022-12-23 19:26:10 +08:00
Yuge Zhang 2e3a777062
Mutable V3 (Stage 7) - Test and Docs (#5200) 2022-12-19 10:32:06 +08:00
J-shang 9f2a9123dc
[Compression] pruning speedup replace transformer attention layers (#5238) 2022-12-07 10:38:18 +08:00
Yuge Zhang a67180283b
Mutable equal, frozen context, new labels (#5247) 2022-12-05 10:33:15 +08:00
Yuge Zhang cd3adb37b6
Remove HPO annotation (#5249) 2022-12-02 17:53:31 +08:00
Yuge Zhang 449546a5ff
Support torchmetrics 0.11.0 (#5256) 2022-12-02 17:52:31 +08:00
J-shang 9c19236902
[Compression] update distillation utils (#5215) 2022-12-02 10:22:17 +08:00
Louis-J 9a289ec21a
fix(speedup): support for a special torchscript op 'aten::to.layout' with no corresponding torch.to (#5178) 2022-11-22 15:40:50 +08:00
J-shang d68c786ff8
[Compression] remove pruning v1 & refactor directory (#5228) 2022-11-21 09:51:56 +08:00
Yuge Zhang 8f454f3bf2
Mutable V3 (Stage 2) - Symbolic execution engine (#5195) 2022-11-14 19:57:22 +08:00
Yuge Zhang 6641d309ac
Mutable V3 (Stage 1) - Label namespace and utilities (#5194) 2022-11-11 16:58:33 +08:00
Louis-J c53be96370
fix(speedup): re-write aten schema parser to support pytorch versions < 1.9.0 (#5138) 2022-10-18 18:31:48 +08:00
Louis-J f4d1c828b0
fix(speedup): make the tensor contiguous before randomizing (#5141) 2022-10-14 17:20:52 +08:00
Yuge Zhang aa98462da6
Dedup for evolution search (#5092) 2022-10-12 10:38:02 +08:00
QuanluZhang bcc640c4e5
[nas] fix issue introduced by the trial recovery feature (#5109) 2022-10-12 10:36:57 +08:00
J-shang 7811307c24
[Test] fix compression ut (#5129)
* fix test often failed

* update

* fix lint
2022-09-19 10:39:35 +08:00
Louis-J 55158b78f5
fix(bugbash): bugs in compression and speedup (#5108) 2022-09-06 08:11:22 +08:00
Maze e9ea18530a
Add official pretrained weights for Autoformer (#5100) 2022-09-01 13:21:23 +08:00
QuanluZhang d3e190c7c8
fix bug and add doc (#5088) 2022-08-30 08:27:12 +08:00
Maze 9e2a069d0f
One-shot sub state dict implementation (#5054) 2022-08-29 15:21:32 +08:00
Louis-J 0058fbc274
test(speedup): add tests for aten::split and aten::leaky_relu (#5070) 2022-08-24 10:55:09 +08:00
Yuge Zhang bddaf36d75
Tutorial of searching in DARTS space (#5053) 2022-08-23 13:42:46 +08:00
Louis-J 588f299b3f
feat(speedup): automatically convert op asts to callables (#4996) 2022-08-16 23:04:15 +08:00
J-shang b2c31ca27b
[Compression] Transformer pruning example (#5017) 2022-08-16 21:22:15 +08:00
J-shang 5f57132790
[Compression] Evaluator - step 3 Tutorial (#5016) 2022-08-16 09:40:31 +08:00
Yuge Zhang f77db747d0
Enhancement of one-shot NAS (v2.9) (#5049) 2022-08-15 15:59:34 +08:00
Yuge Zhang 81c9b9389d
Fix VM image builder on 1ES (#5060) 2022-08-15 09:49:31 +08:00
Yuge Zhang 802650ff30
Miscellaneous fixes of NAS (v2.9) (#5051) 2022-08-12 16:56:54 +08:00
Weidan Kong d03c411c8e
[FEAT]: resume waiting/running, dedup on tuner side (TPE-only) (#4931) 2022-08-10 20:13:24 +08:00
QuanluZhang 2baae4d053
[Retiarii] support experiment view and resume (#4985) 2022-08-10 15:36:30 +08:00
J-shang 75e5d5b51f
rm useless file (#5044) 2022-08-05 13:33:52 +08:00
J-shang 60e1e01f62
rm useless file (#5042) 2022-08-03 10:05:57 +08:00
Yuge Zhang a0fd003671
Merge pull request #5036 from microsoft/promote-retiarii-to-nas
[DO NOT SQUASH] Promote retiarii to NAS
2022-08-01 15:21:43 +08:00
Yuge Zhang bc6d8796d2
Promote Retiarii to NAS (step 2) - update imports (#5025) 2022-08-01 10:32:27 +08:00
J-shang ed455174db
[Compression] evaluator - step2 (#4992) 2022-07-28 12:13:13 +08:00
Maze 481aa29299
Fix Autoformer to compatible with RandomOneShot strategy (#4987) 2022-07-14 17:35:15 +08:00
J-shang 5a3d82e842
[Compression] lightning & legacy evaluator - step 1 (#4950) 2022-07-14 14:04:08 +08:00
Yuge Zhang 0a57438bb6
Fix unintended modification of trace symbol after dump (#4993) 2022-07-13 10:44:08 +08:00
Yuge Zhang baf6075816
Prepare for multi-framework support in NAS (#4976) 2022-07-13 10:39:47 +08:00
Yuge Zhang 4e71ed6211
Migrate pipeline to 1ES (#4986) 2022-07-08 11:13:41 +08:00
J-shang f24dc27b95
[Compression] block sparse refactor (#4932) 2022-06-30 09:43:15 +08:00
J-shang 45af1d6b79
[UT] mv compression ut to full test (#4936) 2022-06-20 14:39:43 +08:00
Yuge Zhang b99e268332
Migration of NAS tests (#4933) 2022-06-17 16:36:36 +08:00
Yuge Zhang 2815fb1f22
Make models in search space hub work with one-shot (#4921) 2022-06-13 10:17:50 +08:00
Yuge Zhang 993109bb3f
One-shot documentation (more imprv.) (#4924) 2022-06-10 16:31:45 +08:00
QuanluZhang 2bc984412c
[retiarii] fix experiment does not exit after done (#4916) 2022-06-10 13:55:56 +08:00
Yuge Zhang 0064e40ebe
Refactor integration test (step 10) - miscellaneous docs and help messages (#4901) 2022-06-05 17:18:02 +08:00
Yuge Zhang 8cc29b3773
Refactor integration test (step 8) - pipeline updates (windows part) (#4899) 2022-06-05 12:14:20 +08:00
Yuge Zhang 496f653bc1
Refactor integration test (step 7) - pipeline updates (linux part) (#4898) 2022-06-05 12:14:00 +08:00
Yuge Zhang 75ea211731
Refactor integration test (step 5) - VM image builder (#4896) 2022-06-05 08:48:05 +08:00
Yuge Zhang a8f86a782a
Refactor integration test (step 4) - refactor test file tree structure (#4895) 2022-06-05 08:47:42 +08:00
Yuge Zhang 73687a660f
Refactor integration test (step 1) - wait for kill (#4892) 2022-06-05 08:46:47 +08:00
QuanluZhang 2fc4724771
[retiarii] refactor of nas experiment (#4841) 2022-05-24 09:18:45 +08:00
Yuge Zhang c80bda297e
Support Repeat and Cell in One-shot NAS (#4835) 2022-05-23 22:23:49 +08:00
Frandium 39ec21ca11
Multi-GPU support of one-shot NAS (#4603) 2022-05-20 16:34:03 +08:00
liuzhe-lz b4559f6095
Fix issue 4810 (#4866) 2022-05-20 12:30:31 +08:00
nbl97 570bce7760
Autoformer search space (#4551) 2022-05-19 20:32:17 +08:00
Yuge Zhang c8d1ed9d41
Disable pytest-azurepipelines (#4857) 2022-05-16 10:39:36 +08:00
liuzhe-lz 98c1a77f61
Support multiple HPO experiments in one process (#4855) 2022-05-14 02:02:56 +08:00
Yuge Zhang e8dc45620f
Searched model zoo in NAS space hub (#4831) 2022-05-13 16:34:10 +08:00
Zhenhua Han fe89e5af63
Update CGO to support pytorch-lightning 1.6.1 (#4814) 2022-05-11 20:42:53 +08:00
Yuge Zhang cd38789940
Fix a corrupted test in serializer (#4845) 2022-05-11 10:44:04 +08:00
Yuge Zhang 1246a58264
Split full test into HPO, NAS and Compression (#4846) 2022-05-10 08:51:41 +08:00
Yuge Zhang f84647fd04
Remove Generic from SerializableObject typings (#4844) 2022-05-07 00:00:37 +08:00
Yuge Zhang f6ec539457
Check copyright header (#4599) 2022-05-06 19:01:09 +08:00
liuzhe-lz f60d3d5e29
WebSocket (step 1) - Python client (#4806) 2022-04-29 14:47:22 +08:00
Yuge Zhang 05c7d6e924
Typehint for oneshot NAS (#4811) 2022-04-28 18:20:47 +08:00
liuzhe-lz d49864ce28
Show duration of each UT case (#4809) 2022-04-27 13:14:10 +08:00
Yuge Zhang 1896212902
Add license header and typehints for NAS (#4774) 2022-04-25 15:33:04 +08:00
liuzhe-lz f24c8380cf
Use "tuner" to config advisor (#4773) 2022-04-24 23:56:23 +08:00
Yuge Zhang a911b85617
Resolve conflicts for #4760 (#4762) 2022-04-21 00:49:27 +08:00
Frandium 14d2966b9e
Valuechoice oneshot lightning (#4602) 2022-03-29 18:57:44 +08:00
Yuge Zhang 5b7dac5c40
Wrap one-shot algorithms as strategies (#4571) 2022-03-02 17:02:11 +08:00
v-fangdong 8b2eb42527
Lightning implementation for retiarii oneshot nas (#4479) 2022-02-18 14:36:43 +08:00
J-shang 99818fba9a
update ut & extend fast test windows timeout (#4558) 2022-02-17 16:15:19 +08:00
Yuge Zhang a36dc07e8d
Composition of `ValueChoice` (#4435) 2022-02-17 12:00:56 +08:00
cruiseliu eaad98528c
Fix a bug that new TPE does not support dict metrics (#4531) 2022-02-11 17:32:52 +08:00
lin bin e483aa0101
[Model Compression] Add bank pruning for level pruner (#4481) 2022-02-11 16:35:53 +08:00
Yuge Zhang b8b7ed0e3e
Add loose-end support for Cell API (#4411) 2022-02-11 15:52:49 +08:00
Yuge Zhang 53ae92cc2b
Support hyper-parameter tuning in Retiarii (#4399) 2022-02-11 14:18:10 +08:00
Yuge Zhang 763f2c87de
Fix serializer for complex kinds of arguments (#4487) 2022-01-27 12:32:33 +08:00
liuzhe-lz efd0e40e87
[pipeline] More aggressive cache (#4495) 2022-01-24 15:51:34 +08:00
J-shang fd8fb7830a
fix total sparsity in sa & auto compress pruner bug (#4474) 2022-01-18 17:54:45 +08:00
J-shang 6b8efe3e95
align nni.trace (#4464) 2022-01-17 15:13:27 +08:00
Yuge Zhang 90f96ef553
Add support for generator in serializer (#4465) 2022-01-17 12:14:25 +08:00
Yuge Zhang c02f4922b5
Fix model type in lightning (#4451) 2022-01-12 11:33:33 +08:00
liuzhe-lz 31f11f5124
Fix search space compatibility with JSON (#4455) 2022-01-11 01:24:22 +08:00
QuanluZhang 100b95fef4
Fix integration test of importing data (#4448) 2022-01-06 10:50:30 +08:00