Debadeepta Dey
|
10232c241a
|
Sanity checked zero cost on synthetic cifar10.
|
2022-12-16 18:23:59 -03:00 |
Debadeepta Dey
|
c638a21fc2
|
Added some more experiments for Imagenet16-120.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
49b819c4fb
|
Updated cross experiment random search plotting scripts.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
990eae48a0
|
Added plotting scripts for random search experiments with FastArchRank.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
c6ffdab700
|
Added analysis script for random search with regular evaluation on natsbench tss.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
80fdb8cf21
|
Added random search using regular evaluation on natsbench tss space.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
5e440cc95c
|
Fixed analysis script for random search in FastArchRank.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
098a8d7891
|
Added analysis script for random search via fastarchrank.
|
2022-12-16 18:23:51 -03:00 |
Debadeepta Dey
|
8492392604
|
Renaming of plots.
|
2022-12-16 18:23:50 -03:00 |
Debadeepta Dey
|
1a8f11a87d
|
Random search with FastArchRank runs through.
|
2022-12-16 18:23:50 -03:00 |
Debadeepta Dey
|
a7e87ff6f6
|
Working on random search using FastArchRank.
|
2022-12-16 18:23:50 -03:00 |
Debadeepta Dey
|
715f04b6bb
|
Updated conditional trainer class everywhere.
|
2022-12-16 18:23:50 -03:00 |
Debadeepta Dey
|
0562f2c09d
|
cifar10 results after finding speed diff on clusters.
|
2022-12-16 18:23:47 -03:00 |
Debadeepta Dey
|
e768a2810d
|
Added std error reporting to natsbench space regular analysis script.
|
2022-12-16 18:23:36 -03:00 |
Debadeepta Dey
|
4d3f9376c4
|
Incorporated stderr reporting in analysis_freeze_natsbench_space_new.py script.
|
2022-12-16 18:23:36 -03:00 |
Debadeepta Dey
|
3fe88bed0b
|
Switched over more experiments in cross exp plots to dictionary format.
|
2022-12-16 18:23:33 -03:00 |
Debadeepta Dey
|
9310a5ec64
|
Switching over experimental plots to use a dictionary in configuration for more flexibility.
|
2022-12-16 18:23:22 -03:00 |
Debadeepta Dey
|
cd076edf06
|
Added script that generates benchmark files (arch_id, test_accuracy) for datasets not in natsbench/nasbench101.
|
2022-12-16 18:22:53 -03:00 |
Debadeepta Dey
|
3d03f14ccf
|
Changed natsbench model creation function calls from archai to be num class agnostic.
|
2022-12-16 18:22:41 -03:00 |
Debadeepta Dey
|
1e11e7dcc1
|
Added intel image classification dataset provider.
|
2022-12-16 18:22:22 -03:00 |
Debadeepta Dey
|
bea1a0f789
|
Added analysis script for freezetrain on natsbench and nb101 that uses the val or train depending on option set.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
9078c3b3af
|
Running jobs with ImageNet16-120 with validation error threshold.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
407c02871c
|
Changed proxynas natsbench space to optionally use train or val error thresholds.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
d7c4b382e6
|
Analysis script for hog features pipeline experiments is done.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
83d437f109
|
Added scripts to plot ecdfs of natsbench benchmarks.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
3a23e2d3a4
|
Updated natsbench error cdf plotting script.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
dff428402e
|
Added functionality to plot search space error cdfs. Organized some test scripts.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
195e830cb6
|
Fixed bug.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
5f8a6023e2
|
Added zerocost measures experiment runner.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
325d44b3d4
|
Refactored an analysis script.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
f598ba3a35
|
Cleaned up analysis code.
|
2022-12-16 18:22:15 -03:00 |
Debadeepta Dey
|
fd9fe4cc36
|
Updated analysis scripts to take into account non benchmark datasets and zero-cost proxy measures.
|
2022-12-16 18:22:12 -03:00 |
Debadeepta Dey
|
f7ed8c886f
|
Added analysis script for comparing synflow with synthetic dataset.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
59e8414e4e
|
Zero cost ranking measures nominally integrated into archai. Requires thorough testing.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
98c5cdf5f8
|
Imported core of zero cost measures from external repo to integrate with archai.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c77e332042
|
Minor changes to get synthetic dataset generation back to more complicated functions now that scaling issue is fixed.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c0cb30bdab
|
Fixed spurious init py.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
3c3cb7eb47
|
Added init py files.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
19d148554d
|
Changed over synthetic data generation to save to pt files.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
f9197dfcaa
|
Fixed path.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
7c2d6293e8
|
Moved synthetic dataset generation scripts to scripts folder.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
e1f335cfb3
|
Synthetic cifar10 dataset now integrated and tested with natsbench tss architectures.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
6401efb810
|
Added synthetic cifar10 dataset provider.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
a8a20bcdcf
|
Fixed bug in flower102_provider.py and made find_mean_std.py robust to default_dataroot not expanding.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
556c70d080
|
Starter code for generating synthetic dataset.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
dc46a01b1d
|
Natsbench size search space test is working properly.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c4a4155466
|
Added scripts to test natsbench size space.
|
2022-12-16 18:21:59 -03:00 |
Debadeepta Dey
|
c50ff878b6
|
Added nasbench101 rmsprop regular training experiment to plots.
|
2022-12-16 18:21:56 -03:00 |
Debadeepta Dey
|
8009911fb4
|
Refactored hog + small neural network classification pipeline.
|
2022-12-16 18:21:40 -03:00 |
Debadeepta Dey
|
e5ec907259
|
Added plotting code to display distribution of architectures.
|
2022-12-16 18:21:40 -03:00 |