Debadeepta Dey
|
999460c787
|
Fixed bug where batch size in configuration file for naswot score method was not getting utilized. So scoring mechanism was using 96 batch size which is used for regular training.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
ef84386e87
|
Getting ready to run naswot conditional training.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
8791e1bc38
|
Found good parameters for cell13 onwards receiving gradients on natsbench.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
6085cdf0fa
|
Modified analysis_aggregate.py to load logs in distributed mode.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
1fd43a76c6
|
Parameter hunt with cell13 onwards getting gradients.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
993ba13a72
|
Parallelized analysis script for natsbench experiments.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
8ebc640b88
|
Fixed a checkpoint bug in freeze training.
|
2022-12-16 16:53:46 -03:00 |
Debadeepta Dey
|
6eac185832
|
Found good parameters for freeze training.
|
2022-12-16 16:53:41 -03:00 |
Debadeepta Dey
|
a2f30a6268
|
Prepared analysis of freeze training experiments.
|
2022-12-16 16:53:29 -03:00 |
Debadeepta Dey
|
b649ce7e38
|
Added nats_bench to setup.py
|
2022-12-16 16:53:29 -03:00 |
Debadeepta Dey
|
efbe25cb79
|
Added functionality for natsbench to be properly installed and path specified in jobs.
|
2022-12-16 16:53:29 -03:00 |
Debadeepta Dey
|
be44bd1e41
|
Refactored freeze training code and made things cleaner.
|
2022-12-16 16:53:29 -03:00 |
Debadeepta Dey
|
27e25f672d
|
Freeze training on proxynas search space is working properly.
|
2022-12-16 16:53:29 -03:00 |
Debadeepta Dey
|
2dd7cb63db
|
Refactored freeze training to be two independent trainers. Interface is much cleaner now.
|
2022-12-16 16:53:28 -03:00 |
Debadeepta Dey
|
1a7616dca0
|
Refactored experiment report scripts to account for new ranking metrics.
|
2022-12-16 16:53:24 -03:00 |
Debadeepta Dey
|
409b778e89
|
Added natsbench for rapid evaluation of architecture ranking proxies.
|
2022-12-16 16:53:11 -03:00 |
Debadeepta Dey
|
69f162ec61
|
Reverted changes to gitignore.
|
2022-12-16 16:53:11 -03:00 |
Debadeepta Dey
|
984482d595
|
Added natsbench compiler code to repo.
|
2022-12-16 16:53:11 -03:00 |
Debadeepta Dey
|
2f2aaf7208
|
Starting to play with natsbench api.
|
2022-12-16 16:53:11 -03:00 |
Debadeepta Dey
|
3c73c09052
|
Made freeze trainer go by module name instead of parameter name. Suspect some parameters are not getting exposed as named parameters.
|
2022-12-16 16:53:11 -03:00 |
Debadeepta Dey
|
bea4d2631f
|
Integrated Trainingless NAS score into archai.
|
2022-12-16 16:52:59 -03:00 |
Debadeepta Dey
|
d61e33b753
|
Added naswotrain_evaluator.py.
|
2022-12-16 16:52:59 -03:00 |
Debadeepta Dey
|
17875f60be
|
Started adding implementation of nas without training.
|
2022-12-16 16:52:59 -03:00 |
Debadeepta Dey
|
d267bb4faa
|
Conf changes in proxynas.yaml only for running experiments.
|
2022-12-16 16:52:53 -03:00 |
Debadeepta Dey
|
2453524ca6
|
Refactoring experiment analysis script.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
0d8930aa70
|
Current version seems to produce stable freeze trainng results. Undergoing more testing runs.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
9a54ffb594
|
Added new algo manual_freeze which can train a handcrafted network with freezetrainer.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
4efc420bbe
|
Getting ready for another run on cluster.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
79052e3287
|
Fixed typo.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
bb80965127
|
Added lots of sanity checks but freeze training is still degrading perf!
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
e5bf0312e5
|
Still having the issue with freeze training where training error is going up after freeze!
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
a1b07dc151
|
Initial test job running.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
3cfc771f46
|
Fixed exprep script to report results report correctly.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
7e99526376
|
More progress on freeze training. Testing and debugging underway.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
08e4d75ab6
|
Train and freeze all but last layer implemented. To be tested.
|
2022-12-16 16:52:40 -03:00 |
Debadeepta Dey
|
82a65ad075
|
Changed path to local directory for nasbench 101 dataset.
|
2022-12-16 16:52:40 -03:00 |
Gustavo Rosa
|
b5215afd3d
|
chore(root): Bumps version for PyPI release.
|
2022-12-16 16:52:40 -03:00 |
Gustavo Rosa
|
77bf2acbd1
|
chore(root): Moves azure out of tools and remove xt folder.
|
2022-12-16 16:52:40 -03:00 |
Gustavo Rosa
|
5e0d11ec00
|
fix(root): Aesthetic fixes.
|
2022-12-16 16:52:40 -03:00 |
Gustavo Rosa
|
9691abcaf6
|
chore(docker): Replaces non-working docker files with a working one.
|
2022-12-16 16:52:40 -03:00 |
Gustavo Rosa
|
d77ebf9a72
|
chore(root): Adds requirements.txt and fixes order of packages in setup.py.
fix(root): Fixes the order of packages in setup.py.
|
2022-12-16 16:52:40 -03:00 |
Gustavo Rosa
|
e5cad0a03b
|
fix(root): Fixes README documentation urls.
|
2022-12-16 16:52:36 -03:00 |
Gustavo Rosa
|
c4821dffb9
|
chore(root): Adds missing headers and updates version to 0.6.6.
|
2022-12-16 16:52:15 -03:00 |
Gustavo Rosa
|
f12936d889
|
fix(root): Fixes duplicates in setup.py and adds versions for faster install.
|
2022-12-16 16:51:59 -03:00 |
Gustavo Rosa
|
305e45b8a5
|
chore(root): Updates minimum Python version to 3.7, as 3.6 has been deprecated.
|
2022-12-16 16:51:40 -03:00 |
Gustavo Rosa
|
fdc9d9296e
|
fix(root): Improves gitignore files.
|
2022-12-16 16:51:36 -03:00 |
Gustavo Rosa
|
112083664a
|
chore(github): Fixes wrong labeling and unused comments.
|
2022-12-16 16:51:21 -03:00 |
Gustavo Rosa
|
8761385958
|
fix(hf_opt): Uses better bounds for search configuration.
|
2022-12-16 16:51:21 -03:00 |
Gustavo Rosa
|
853af076ba
|
chore(hf_opt): Adjusts default parameters to OPT-350M.
|
2022-12-16 16:51:21 -03:00 |
Gustavo Rosa
|
9c65ca9ae4
|
chore(root): Bumps version for release.
|
2022-12-16 16:51:13 -03:00 |