microsoft
/
archai
зеркало из https://github.com/microsoft/archai.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
1 151 коммит 9 Ветки 12 Теги 57 MiB
Граф коммитов

1151 Коммитов

Автор SHA1 Сообщение Дата
Debadeepta Dey 97511a0c51 Further documenting reproduction of ranking experiments. 2022-12-16 18:25:21 -03:00
Debadeepta Dey 5c5d6a3094 Started writing instructions for reproducing results in FEAR. 2022-12-16 18:25:07 -03:00
Debadeepta Dey 57cc6014af Refactored analysis scripts. 2022-12-16 18:25:02 -03:00
Debadeepta Dey 4c79ba0c78 Last commit before starting to cleanup. 2022-12-16 18:24:52 -03:00
Debadeepta Dey ff1faa3045 Tested local search with FastArchRank on natsbench. 2022-12-16 18:24:46 -03:00
Debadeepta Dey bfd3e9be33 Progress on local search on natsbench tss space with FastArchRank. 2022-12-16 18:24:46 -03:00
Debadeepta Dey 1b840bc467 Started local search implementation on natsbench tss. 2022-12-16 18:24:46 -03:00
Debadeepta Dey 622b5970ff Fixed the dataloader caching issue which causes OOM error on long discrete searcher jobs. 2022-12-16 18:24:43 -03:00
Debadeepta Dey 4fbde670b0 Fixed bugs in far post searcher. 2022-12-16 18:24:33 -03:00
Debadeepta Dey 8f5199d9c3 Added code for random search with post training of the top ones. 2022-12-16 18:24:33 -03:00
Debadeepta Dey a4e9573bee Added script to analyze zero-cost performance as a function of number of epochs. 2022-12-16 18:24:33 -03:00
Debadeepta Dey e0bf51b45e Generated time to threshold vs. test accuracy plots for paper. 2022-12-16 18:24:29 -03:00
Debadeepta Dey 5ddf9127e5 Generated (hopefully) final versions of pareto curves for FastArchRank. 2022-12-16 18:24:18 -03:00
Debadeepta Dey 3476247efd Processed more random search experiments. 2022-12-16 18:24:18 -03:00
Debadeepta Dey 3d9b54fd7e Various updates related to random search on natsbench. 2022-12-16 18:24:18 -03:00
Debadeepta Dey 99c7c0941f Launched a bunch of new random search experiments. 2022-12-16 18:24:14 -03:00
Debadeepta Dey 41cc82cf07 Added functionality to take run zero-cost measures after every epoch of regular training. 2022-12-16 18:24:03 -03:00
Debadeepta Dey 5b7c3cad48 Updated imagenet16-120 results with fastarchrank! 2022-12-16 18:24:03 -03:00
Debadeepta Dey 238c218c9a Analyzed more imagenet16 experiments. 2022-12-16 18:24:03 -03:00
Debadeepta Dey 10232c241a Sanity checked zero cost on synthetic cifar10. 2022-12-16 18:23:59 -03:00
Debadeepta Dey c638a21fc2 Added some more experiments for Imagenet16-120. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 49b819c4fb Updated cross experiment random search plotting scripts. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 990eae48a0 Added plotting scripts for random search experiments with FastArchRank. 2022-12-16 18:23:51 -03:00
Debadeepta Dey c6ffdab700 Added analysis script for random search with regular evaluation on natsbench tss. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 80fdb8cf21 Added random search using regular evaluation on natsbench tss space. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 5e440cc95c Fixed analysis script for random search in FastArchRank. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 098a8d7891 Added analysis script for random search via fastarchrank. 2022-12-16 18:23:51 -03:00
Debadeepta Dey 8492392604 Renaming of plots. 2022-12-16 18:23:50 -03:00
Debadeepta Dey 1a8f11a87d Random search with FastArchRank runs through. 2022-12-16 18:23:50 -03:00
Debadeepta Dey a7e87ff6f6 Working on random search using FastArchRank. 2022-12-16 18:23:50 -03:00
Debadeepta Dey 715f04b6bb Updated conditional trainer class everywhere. 2022-12-16 18:23:50 -03:00
Debadeepta Dey 0562f2c09d cifar10 results after finding speed diff on clusters. 2022-12-16 18:23:47 -03:00
Debadeepta Dey e768a2810d Added std error reporting to natsbench space regular analysis script. 2022-12-16 18:23:36 -03:00
Debadeepta Dey 4d3f9376c4 Incorporated stderr reporting in analysis_freeze_natsbench_space_new.py script. 2022-12-16 18:23:36 -03:00
Debadeepta Dey 3fe88bed0b Switched over more experiments in cross exp plots to dictionary format. 2022-12-16 18:23:33 -03:00
Debadeepta Dey 9310a5ec64 Switching over experimental plots to use a dictionary in configuration for more flexibility. 2022-12-16 18:23:22 -03:00
Debadeepta Dey cd076edf06 Added script that generates benchmark files (arch_id, test_accuracy) for datasets not in natsbench/nasbench101. 2022-12-16 18:22:53 -03:00
Debadeepta Dey 3d03f14ccf Changed natsbench model creation function calls from archai to be num class agnostic. 2022-12-16 18:22:41 -03:00
Debadeepta Dey 1e11e7dcc1 Added intel image classification dataset provider. 2022-12-16 18:22:22 -03:00
Debadeepta Dey bea1a0f789 Added analysis script for freezetrain on natsbench and nb101 that uses the val or train depending on option set. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 9078c3b3af Running jobs with ImageNet16-120 with validation error threshold. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 407c02871c Changed proxynas natsbench space to optionally use train or val error thresholds. 2022-12-16 18:22:15 -03:00
Debadeepta Dey d7c4b382e6 Analysis script for hog features pipeline experiments is done. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 83d437f109 Added scripts to plot ecdfs of natsbench benchmarks. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 3a23e2d3a4 Updated natsbench error cdf plotting script. 2022-12-16 18:22:15 -03:00
Debadeepta Dey dff428402e Added functionality to plot search space error cdfs. Organized some test scripts. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 195e830cb6 Fixed bug. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 5f8a6023e2 Added zerocost measures experiment runner. 2022-12-16 18:22:15 -03:00
Debadeepta Dey 325d44b3d4 Refactored an analysis script. 2022-12-16 18:22:15 -03:00
Debadeepta Dey f598ba3a35 Cleaned up analysis code. 2022-12-16 18:22:15 -03:00