Граф коммитов

1151 Коммитов

Автор SHA1 Сообщение Дата
Debadeepta Dey fd9fe4cc36 Updated analysis scripts to take into account non benchmark datasets and zero-cost proxy measures. 2022-12-16 18:22:12 -03:00
Debadeepta Dey f7ed8c886f Added analysis script for comparing synflow with synthetic dataset. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 59e8414e4e Zero cost ranking measures nominally integrated into archai. Requires thorough testing. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 98c5cdf5f8 Imported core of zero cost measures from external repo to integrate with archai. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c77e332042 Minor changes to get synthetic dataset generation back to more complicated functions now that scaling issue is fixed. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c0cb30bdab Fixed spurious init py. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 3c3cb7eb47 Added init py files. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 19d148554d Changed over synthetic data generation to save to pt files. 2022-12-16 18:21:59 -03:00
Debadeepta Dey f9197dfcaa Fixed path. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 7c2d6293e8 Moved synthetic dataset generation scripts to scripts folder. 2022-12-16 18:21:59 -03:00
Debadeepta Dey e1f335cfb3 Synthetic cifar10 dataset now integrated and tested with natsbench tss architectures. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 6401efb810 Added synthetic cifar10 dataset provider. 2022-12-16 18:21:59 -03:00
Debadeepta Dey a8a20bcdcf Fixed bug in flower102_provider.py and made find_mean_std.py robust to default_dataroot not expanding. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 556c70d080 Starter code for generating synthetic dataset. 2022-12-16 18:21:59 -03:00
Debadeepta Dey dc46a01b1d Natsbench size search space test is working properly. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c4a4155466 Added scripts to test natsbench size space. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c50ff878b6 Added nasbench101 rmsprop regular training experiment to plots. 2022-12-16 18:21:56 -03:00
Debadeepta Dey 8009911fb4 Refactored hog + small neural network classification pipeline. 2022-12-16 18:21:40 -03:00
Debadeepta Dey e5ec907259 Added plotting code to display distribution of architectures. 2022-12-16 18:21:40 -03:00
Debadeepta Dey a652c3bcfc More analysis of experiments on nasbench101. 2022-12-16 18:21:39 -03:00
Debadeepta Dey 16a8b37ef5 Make freezeaddon able to take in different layer activations of nasbench101 as features. 2022-12-16 18:21:39 -03:00
Debadeepta Dey 87c6e61abd Nominal implementation of freezetrain network idea. 2022-12-16 18:21:39 -03:00
Debadeepta Dey ab0926b932 Disabled model saving and checkpointing for nasbench101 experiments to save downloads. 2022-12-16 18:21:39 -03:00
Debadeepta Dey ca64dc4156 Modified analysis scripts to deal with nb101 as well. 2022-12-16 18:21:36 -03:00
Debadeepta Dey b09c30de01 Verified that analysis script for regular natsbench also works on nb101 reglar eval. 2022-12-16 18:21:24 -03:00
Debadeepta Dey 7d09b95ac5 Changed nasbench101 loading on cluster to use pt_install machinery. 2022-12-16 18:21:24 -03:00
Debadeepta Dey cea8607763 Added main wrapper for nasbench101 2022-12-16 18:21:24 -03:00
Debadeepta Dey 5186db3e28 Created regular nasbench101 evaluation pipeline. 2022-12-16 18:21:24 -03:00
Debadeepta Dey 366e1a858d Updated imagenet16 results with more experiments. 2022-12-16 18:21:24 -03:00
Debadeepta Dey 7171aeeb7c Linear network with hog features working now. 2022-12-16 18:21:24 -03:00
Debadeepta Dey 5ba069d3c2 Tested skimage hog feature extractor. Starting code for hog + linear nn. 2022-12-16 18:21:23 -03:00
Debadeepta Dey 1091be9b11 Updated with ImageNet16-120 preliminary results. 2022-12-16 18:21:23 -03:00
Debadeepta Dey f7de1a13dc ImageNet16-120 provider tested now. 2022-12-16 18:21:23 -03:00
Debadeepta Dey b5aac7a6b8 Testing imagenet16 dataloader integration. 2022-12-16 18:21:23 -03:00
Debadeepta Dey e32a99b323 Renaming of Imagenet16-120 to be consistent with conf files. 2022-12-16 18:21:23 -03:00
Debadeepta Dey 9034f46bdd Added imagenet16 provider classes. 2022-12-16 18:21:23 -03:00
Debadeepta Dey 4c1df14922 Refactored cross experiment plots script. 2022-12-16 18:21:23 -03:00
Debadeepta Dey 4bf2e26eb4 Moved another plot over to plotly. 2022-12-16 18:21:23 -03:00
Debadeepta Dey cf4c9f91fc Started changing over various complicated plots to plotly! 2022-12-16 18:21:23 -03:00
Debadeepta Dey 9d9c612f45 cifar100 results look good! 2022-12-16 18:21:23 -03:00
Debadeepta Dey e56cce2613 Phased freeze training code is tested now. 2022-12-16 18:21:20 -03:00
Debadeepta Dey 6e47ce94c9 cifar100 now works! 2022-12-16 18:21:10 -03:00
Debadeepta Dey 7603941b16 Getting error with running cifar100. 2022-12-16 18:21:07 -03:00
Debadeepta Dey 4bab19610b Updated plots to include common coverage at top percent plots of various ranking methods. 2022-12-16 18:20:56 -03:00
Debadeepta Dey c6396d3ec6 Added ratio of common architectures for ranking. 2022-12-16 18:20:53 -03:00
Debadeepta Dey 8511d25699 Improved plotting of aggregate plots. 2022-12-16 18:20:42 -03:00
Debadeepta Dey 6a53ce5b67 Got aggregate plots to be decent. 2022-12-16 18:20:42 -03:00
Debadeepta Dey cef6b78175 Creating aggregate experimental plots! 2022-12-16 18:20:42 -03:00
Debadeepta Dey 5835e0d608 Creating scripts for aggregate analysis of experiments. 2022-12-16 18:20:42 -03:00
Debadeepta Dey ddfbfc2a08 Added dumping timing information to regular natsbench evaluation analysis scripts. 2022-12-16 18:20:42 -03:00