Граф коммитов

1132 Коммитов

Автор SHA1 Сообщение Дата
Debadeepta Dey 10232c241a Sanity checked zero cost on synthetic cifar10. 2022-12-16 18:23:59 -03:00
Debadeepta Dey c638a21fc2 Added some more experiments for Imagenet16-120. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 49b819c4fb Updated cross experiment random search plotting scripts. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 990eae48a0 Added plotting scripts for random search experiments with FastArchRank. 2022-12-16 18:23:51 -03:00
Debadeepta Dey c6ffdab700 Added analysis script for random search with regular evaluation on natsbench tss. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 80fdb8cf21 Added random search using regular evaluation on natsbench tss space. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 5e440cc95c Fixed analysis script for random search in FastArchRank. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 098a8d7891 Added analysis script for random search via fastarchrank. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 8492392604 Renaming of plots. 2022-12-16 18:23:50 -03:00
Debadeepta Dey 1a8f11a87d Random search with FastArchRank runs through. 2022-12-16 18:23:50 -03:00
Debadeepta Dey a7e87ff6f6 Working on random search using FastArchRank. 2022-12-16 18:23:50 -03:00
Debadeepta Dey 715f04b6bb Updated conditional trainer class everywhere. 2022-12-16 18:23:50 -03:00
Debadeepta Dey 0562f2c09d cifar10 results after finding speed diff on clusters. 2022-12-16 18:23:47 -03:00
Debadeepta Dey e768a2810d Added std error reporting to natsbench space regular analysis script. 2022-12-16 18:23:36 -03:00
Debadeepta Dey 4d3f9376c4 Incorporated stderr reporting in analysis_freeze_natsbench_space_new.py script. 2022-12-16 18:23:36 -03:00
Debadeepta Dey 3fe88bed0b Switched over more experiments in cross exp plots to dictionary format. 2022-12-16 18:23:33 -03:00
Debadeepta Dey 9310a5ec64 Switching over experimental plots to use a dictionary in configuration for more flexibility. 2022-12-16 18:23:22 -03:00
Debadeepta Dey cd076edf06 Added script that generates benchmark files (arch_id, test_accuracy) for datasets not in natsbench/nasbench101. 2022-12-16 18:22:53 -03:00
Debadeepta Dey 3d03f14ccf Changed natsbench model creation function calls from archai to be num class agnostic. 2022-12-16 18:22:41 -03:00
Debadeepta Dey 1e11e7dcc1 Added intel image classification dataset provider. 2022-12-16 18:22:22 -03:00
Debadeepta Dey bea1a0f789 Added analysis script for freezetrain on natsbench and nb101 that uses the val or train depending on option set. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 9078c3b3af Running jobs with ImageNet16-120 with validation error threshold. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 407c02871c Changed proxynas natsbench space to optionally use train or val error thresholds. 2022-12-16 18:22:15 -03:00
Debadeepta Dey d7c4b382e6 Analysis script for hog features pipeline experiments is done. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 83d437f109 Added scripts to plot ecdfs of natsbench benchmarks. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 3a23e2d3a4 Updated natsbench error cdf plotting script. 2022-12-16 18:22:15 -03:00
Debadeepta Dey dff428402e Added functionality to plot search space error cdfs. Organized some test scripts. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 195e830cb6 Fixed bug. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 5f8a6023e2 Added zerocost measures experiment runner. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 325d44b3d4 Refactored an analysis script. 2022-12-16 18:22:15 -03:00
Debadeepta Dey f598ba3a35 Cleaned up analysis code. 2022-12-16 18:22:15 -03:00
Debadeepta Dey fd9fe4cc36 Updated analysis scripts to take into account non benchmark datasets and zero-cost proxy measures. 2022-12-16 18:22:12 -03:00
Debadeepta Dey f7ed8c886f Added analysis script for comparing synflow with synthetic dataset. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 59e8414e4e Zero cost ranking measures nominally integrated into archai. Requires thorough testing. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 98c5cdf5f8 Imported core of zero cost measures from external repo to integrate with archai. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c77e332042 Minor changes to get synthetic dataset generation back to more complicated functions now that scaling issue is fixed. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c0cb30bdab Fixed spurious init py. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 3c3cb7eb47 Added init py files. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 19d148554d Changed over synthetic data generation to save to pt files. 2022-12-16 18:21:59 -03:00
Debadeepta Dey f9197dfcaa Fixed path. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 7c2d6293e8 Moved synthetic dataset generation scripts to scripts folder. 2022-12-16 18:21:59 -03:00
Debadeepta Dey e1f335cfb3 Synthetic cifar10 dataset now integrated and tested with natsbench tss architectures. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 6401efb810 Added synthetic cifar10 dataset provider. 2022-12-16 18:21:59 -03:00
Debadeepta Dey a8a20bcdcf Fixed bug in flower102_provider.py and made find_mean_std.py robust to default_dataroot not expanding. 2022-12-16 18:21:59 -03:00
Debadeepta Dey 556c70d080 Starter code for generating synthetic dataset. 2022-12-16 18:21:59 -03:00
Debadeepta Dey dc46a01b1d Natsbench size search space test is working properly. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c4a4155466 Added scripts to test natsbench size space. 2022-12-16 18:21:59 -03:00
Debadeepta Dey c50ff878b6 Added nasbench101 rmsprop regular training experiment to plots. 2022-12-16 18:21:56 -03:00
Debadeepta Dey 8009911fb4 Refactored hog + small neural network classification pipeline. 2022-12-16 18:21:40 -03:00
Debadeepta Dey e5ec907259 Added plotting code to display distribution of architectures. 2022-12-16 18:21:40 -03:00