Debadeepta Dey
|
fd9fe4cc36
|
Updated analysis scripts to take into account non benchmark datasets and zero-cost proxy measures.
|
2022-12-16 18:22:12 -03:00 |
Debadeepta Dey
|
f7ed8c886f
|
Added analysis script for comparing synflow with synthetic dataset.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
59e8414e4e
|
Zero cost ranking measures nominally integrated into archai. Requires thorough testing.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
98c5cdf5f8
|
Imported core of zero cost measures from external repo to integrate with archai.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c77e332042
|
Minor changes to get synthetic dataset generation back to more complicated functions now that scaling issue is fixed.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c0cb30bdab
|
Fixed spurious init py.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
3c3cb7eb47
|
Added init py files.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
19d148554d
|
Changed over synthetic data generation to save to pt files.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
f9197dfcaa
|
Fixed path.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
7c2d6293e8
|
Moved synthetic dataset generation scripts to scripts folder.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
e1f335cfb3
|
Synthetic cifar10 dataset now integrated and tested with natsbench tss architectures.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
6401efb810
|
Added synthetic cifar10 dataset provider.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
a8a20bcdcf
|
Fixed bug in flower102_provider.py and made find_mean_std.py robust to default_dataroot not expanding.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
556c70d080
|
Starter code for generating synthetic dataset.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
dc46a01b1d
|
Natsbench size search space test is working properly.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c4a4155466
|
Added scripts to test natsbench size space.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c50ff878b6
|
Added nasbench101 rmsprop regular training experiment to plots.
|
2022-12-16 18:21:56 -03:00 |
Debadeepta Dey
|
8009911fb4
|
Refactored hog + small neural network classification pipeline.
|
2022-12-16 18:21:40 -03:00 |
Debadeepta Dey
|
e5ec907259
|
Added plotting code to display distribution of architectures.
|
2022-12-16 18:21:40 -03:00 |
Debadeepta Dey
|
a652c3bcfc
|
More analysis of experiments on nasbench101.
|
2022-12-16 18:21:39 -03:00 |
Debadeepta Dey
|
16a8b37ef5
|
Make freezeaddon able to take in different layer activations of nasbench101 as features.
|
2022-12-16 18:21:39 -03:00 |
Debadeepta Dey
|
87c6e61abd
|
Nominal implementation of freezetrain network idea.
|
2022-12-16 18:21:39 -03:00 |
Debadeepta Dey
|
ab0926b932
|
Disabled model saving and checkpointing for nasbench101 experiments to save downloads.
|
2022-12-16 18:21:39 -03:00 |
Debadeepta Dey
|
ca64dc4156
|
Modified analysis scripts to deal with nb101 as well.
|
2022-12-16 18:21:36 -03:00 |
Debadeepta Dey
|
b09c30de01
|
Verified that analysis script for regular natsbench also works on nb101 reglar eval.
|
2022-12-16 18:21:24 -03:00 |
Debadeepta Dey
|
7d09b95ac5
|
Changed nasbench101 loading on cluster to use pt_install machinery.
|
2022-12-16 18:21:24 -03:00 |
Debadeepta Dey
|
cea8607763
|
Added main wrapper for nasbench101
|
2022-12-16 18:21:24 -03:00 |
Debadeepta Dey
|
5186db3e28
|
Created regular nasbench101 evaluation pipeline.
|
2022-12-16 18:21:24 -03:00 |
Debadeepta Dey
|
366e1a858d
|
Updated imagenet16 results with more experiments.
|
2022-12-16 18:21:24 -03:00 |
Debadeepta Dey
|
7171aeeb7c
|
Linear network with hog features working now.
|
2022-12-16 18:21:24 -03:00 |
Debadeepta Dey
|
5ba069d3c2
|
Tested skimage hog feature extractor. Starting code for hog + linear nn.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
1091be9b11
|
Updated with ImageNet16-120 preliminary results.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
f7de1a13dc
|
ImageNet16-120 provider tested now.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
b5aac7a6b8
|
Testing imagenet16 dataloader integration.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
e32a99b323
|
Renaming of Imagenet16-120 to be consistent with conf files.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
9034f46bdd
|
Added imagenet16 provider classes.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
4c1df14922
|
Refactored cross experiment plots script.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
4bf2e26eb4
|
Moved another plot over to plotly.
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
cf4c9f91fc
|
Started changing over various complicated plots to plotly!
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
9d9c612f45
|
cifar100 results look good!
|
2022-12-16 18:21:23 -03:00 |
Debadeepta Dey
|
e56cce2613
|
Phased freeze training code is tested now.
|
2022-12-16 18:21:20 -03:00 |
Debadeepta Dey
|
6e47ce94c9
|
cifar100 now works!
|
2022-12-16 18:21:10 -03:00 |
Debadeepta Dey
|
7603941b16
|
Getting error with running cifar100.
|
2022-12-16 18:21:07 -03:00 |
Debadeepta Dey
|
4bab19610b
|
Updated plots to include common coverage at top percent plots of various ranking methods.
|
2022-12-16 18:20:56 -03:00 |
Debadeepta Dey
|
c6396d3ec6
|
Added ratio of common architectures for ranking.
|
2022-12-16 18:20:53 -03:00 |
Debadeepta Dey
|
8511d25699
|
Improved plotting of aggregate plots.
|
2022-12-16 18:20:42 -03:00 |
Debadeepta Dey
|
6a53ce5b67
|
Got aggregate plots to be decent.
|
2022-12-16 18:20:42 -03:00 |
Debadeepta Dey
|
cef6b78175
|
Creating aggregate experimental plots!
|
2022-12-16 18:20:42 -03:00 |
Debadeepta Dey
|
5835e0d608
|
Creating scripts for aggregate analysis of experiments.
|
2022-12-16 18:20:42 -03:00 |
Debadeepta Dey
|
ddfbfc2a08
|
Added dumping timing information to regular natsbench evaluation analysis scripts.
|
2022-12-16 18:20:42 -03:00 |