Граф коммитов

1029 Коммитов

Автор SHA1 Сообщение Дата
Debadeepta Dey 999460c787 Fixed bug where batch size in configuration file for naswot score method was not getting utilized. So scoring mechanism was using 96 batch size which is used for regular training. 2022-12-16 16:53:46 -03:00
Debadeepta Dey ef84386e87 Getting ready to run naswot conditional training. 2022-12-16 16:53:46 -03:00
Debadeepta Dey 8791e1bc38 Found good parameters for cell13 onwards receiving gradients on natsbench. 2022-12-16 16:53:46 -03:00
Debadeepta Dey 6085cdf0fa Modified analysis_aggregate.py to load logs in distributed mode. 2022-12-16 16:53:46 -03:00
Debadeepta Dey 1fd43a76c6 Parameter hunt with cell13 onwards getting gradients. 2022-12-16 16:53:46 -03:00
Debadeepta Dey 993ba13a72 Parallelized analysis script for natsbench experiments. 2022-12-16 16:53:46 -03:00
Debadeepta Dey 8ebc640b88 Fixed a checkpoint bug in freeze training. 2022-12-16 16:53:46 -03:00
Debadeepta Dey 6eac185832 Found good parameters for freeze training. 2022-12-16 16:53:41 -03:00
Debadeepta Dey a2f30a6268 Prepared analysis of freeze training experiments. 2022-12-16 16:53:29 -03:00
Debadeepta Dey b649ce7e38 Added nats_bench to setup.py 2022-12-16 16:53:29 -03:00
Debadeepta Dey efbe25cb79 Added functionality for natsbench to be properly installed and path specified in jobs. 2022-12-16 16:53:29 -03:00
Debadeepta Dey be44bd1e41 Refactored freeze training code and made things cleaner. 2022-12-16 16:53:29 -03:00
Debadeepta Dey 27e25f672d Freeze training on proxynas search space is working properly. 2022-12-16 16:53:29 -03:00
Debadeepta Dey 2dd7cb63db Refactored freeze training to be two independent trainers. Interface is much cleaner now. 2022-12-16 16:53:28 -03:00
Debadeepta Dey 1a7616dca0 Refactored experiment report scripts to account for new ranking metrics. 2022-12-16 16:53:24 -03:00
Debadeepta Dey 409b778e89 Added natsbench for rapid evaluation of architecture ranking proxies. 2022-12-16 16:53:11 -03:00
Debadeepta Dey 69f162ec61 Reverted changes to gitignore. 2022-12-16 16:53:11 -03:00
Debadeepta Dey 984482d595 Added natsbench compiler code to repo. 2022-12-16 16:53:11 -03:00
Debadeepta Dey 2f2aaf7208 Starting to play with natsbench api. 2022-12-16 16:53:11 -03:00
Debadeepta Dey 3c73c09052 Made freeze trainer go by module name instead of parameter name. Suspect some parameters are not getting exposed as named parameters. 2022-12-16 16:53:11 -03:00
Debadeepta Dey bea4d2631f Integrated Trainingless NAS score into archai. 2022-12-16 16:52:59 -03:00
Debadeepta Dey d61e33b753 Added naswotrain_evaluator.py. 2022-12-16 16:52:59 -03:00
Debadeepta Dey 17875f60be Started adding implementation of nas without training. 2022-12-16 16:52:59 -03:00
Debadeepta Dey d267bb4faa Conf changes in proxynas.yaml only for running experiments. 2022-12-16 16:52:53 -03:00
Debadeepta Dey 2453524ca6 Refactoring experiment analysis script. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 0d8930aa70 Current version seems to produce stable freeze trainng results. Undergoing more testing runs. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 9a54ffb594 Added new algo manual_freeze which can train a handcrafted network with freezetrainer. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 4efc420bbe Getting ready for another run on cluster. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 79052e3287 Fixed typo. 2022-12-16 16:52:40 -03:00
Debadeepta Dey bb80965127 Added lots of sanity checks but freeze training is still degrading perf! 2022-12-16 16:52:40 -03:00
Debadeepta Dey e5bf0312e5 Still having the issue with freeze training where training error is going up after freeze! 2022-12-16 16:52:40 -03:00
Debadeepta Dey a1b07dc151 Initial test job running. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 3cfc771f46 Fixed exprep script to report results report correctly. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 7e99526376 More progress on freeze training. Testing and debugging underway. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 08e4d75ab6 Train and freeze all but last layer implemented. To be tested. 2022-12-16 16:52:40 -03:00
Debadeepta Dey 82a65ad075 Changed path to local directory for nasbench 101 dataset. 2022-12-16 16:52:40 -03:00
Gustavo Rosa b5215afd3d chore(root): Bumps version for PyPI release. 2022-12-16 16:52:40 -03:00
Gustavo Rosa 77bf2acbd1 chore(root): Moves azure out of tools and remove xt folder. 2022-12-16 16:52:40 -03:00
Gustavo Rosa 5e0d11ec00 fix(root): Aesthetic fixes. 2022-12-16 16:52:40 -03:00
Gustavo Rosa 9691abcaf6 chore(docker): Replaces non-working docker files with a working one. 2022-12-16 16:52:40 -03:00
Gustavo Rosa d77ebf9a72 chore(root): Adds requirements.txt and fixes order of packages in setup.py.
fix(root): Fixes the order of packages in setup.py.
2022-12-16 16:52:40 -03:00
Gustavo Rosa e5cad0a03b fix(root): Fixes README documentation urls. 2022-12-16 16:52:36 -03:00
Gustavo Rosa c4821dffb9 chore(root): Adds missing headers and updates version to 0.6.6. 2022-12-16 16:52:15 -03:00
Gustavo Rosa f12936d889 fix(root): Fixes duplicates in setup.py and adds versions for faster install. 2022-12-16 16:51:59 -03:00
Gustavo Rosa 305e45b8a5 chore(root): Updates minimum Python version to 3.7, as 3.6 has been deprecated. 2022-12-16 16:51:40 -03:00
Gustavo Rosa fdc9d9296e fix(root): Improves gitignore files. 2022-12-16 16:51:36 -03:00
Gustavo Rosa 112083664a chore(github): Fixes wrong labeling and unused comments. 2022-12-16 16:51:21 -03:00
Gustavo Rosa 8761385958 fix(hf_opt): Uses better bounds for search configuration. 2022-12-16 16:51:21 -03:00
Gustavo Rosa 853af076ba chore(hf_opt): Adjusts default parameters to OPT-350M. 2022-12-16 16:51:21 -03:00
Gustavo Rosa 9c65ca9ae4 chore(root): Bumps version for release. 2022-12-16 16:51:13 -03:00