Azure
/
fast_retraining
зеркало из https://github.com/Azure/fast_retraining.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность

changed order table

This commit is contained in:
Miguel Fierro 2017-07-11 16:37:07 +01:00
Родитель c5180e873a
Коммит 12f1227519
1 изменённых файлов: 7 добавлений и 6 удалений
Показать статистику Скачать Patch файл Скачать Diff файл Показать все файлы Свернуть все файлы

13
README.md
Просмотреть файл

@ -25,23 +25,24 @@ In the following table there are summarized the time results (in seconds) and th
| Dataset | Experiment | Data size | Features | xgb time: <br/> CPU (GPU) | xgb_hist time: <br/> CPU (GPU) | lgb time: <br/>CPU (GPU) | ratio xgb/lgb: <br/> CPU (GPU) | ratio xgb_hist/lgb: <br/> CPU <br/> (GPU) |
| --- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| Airline | [Link CPU](./experiments/01_airline.ipynb) <br/> [Link GPU](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 4428.49 (-) | 384.74 (432.14) | 258.62 (210.92) | 17.12 <br/> (-) | 1.48 <br/>(2.04) |
| BCI | [Link CPU](./experiments/02_BCI.ipynb)<br/> [Link GPU](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 11.51 (12.93) | 41.84 (42.69) | 7.31 (2.76)| 1.57 <br/> (4.67) | 5.72 <br/>(15.43) |
| Football | [Link CPU](./experiments/03_football.ipynb)<br/> [Link GPU](./experiments/03_football_GPU.ipynb) | 19673 | 46 | 1.78 (7.09) | 3.57 (4.58) | 0.64 (0.97) | 2.75 <br/> (7.26) | 5.51 <br/>(4.69) |
| Planet Kaggle | [Link CPU](./experiments/04_PlanetKaggle.ipynb)<br/> [Link GPU](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 313.89 (-) | 2115.28 (2028.43) | 194.57 (317.68)| 1.61 <br/> (-) | 10.87 <br/>(6.38) |
| Fraud Detection | [Link CPU](./experiments/05_FraudDetection.ipynb)<br/> [Link GPU](./experiments/05_FraudDetection_GPU.ipynb) | 284807 | 30 | 4.34 (5.80) | 2.01 (1.64) | 0.66 (0.29) | 6.58 <br/>(19.74) | 3.04 <br/> (5.58) |
| BCI | [Link CPU](./experiments/02_BCI.ipynb)<br/> [Link GPU](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 11.51 (12.93) | 41.84 (42.69) | 7.31 (2.76)| 1.57 <br/> (4.67) | 5.72 <br/>(15.43) |
| Planet Kaggle | [Link CPU](./experiments/04_PlanetKaggle.ipynb)<br/> [Link GPU](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 313.89 (-) | 2115.28 (2028.43) | 194.57 (317.68)| 1.61 <br/> (-) | 10.87 <br/>(6.38) |
| HIGGS | [Link CPU](./experiments/06_HIGGS.ipynb)<br/> [Link GPU](./experiments/06_HIGGS_GPU.ipynb) | 11000000 | 28 | 653.45 (-) | 74.42 (79.26) | 63.32 (55.90) | 10.31 <br/>(-) | 1.17 <br/> (1.41) |
| Airline | [Link CPU](./experiments/01_airline.ipynb) <br/> [Link GPU](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 4428.49 (-) | 384.74 (432.14) | 258.62 (210.92) | 17.12 <br/> (-) | 1.48 <br/>(2.04) |
In the next table we summarize the performance results using the [F1-Score](https://en.wikipedia.org/wiki/F1_score).
| Dataset | Experiment | Data size | Features | xgb F1: <br/> CPU (GPU) | xgb_hist F1: <br/> CPU (GPU) | lgb F1: <br/> CPU (GPU) |
| --- | :---: | :---: | :---: | :---: | :---: | :---: |
| Airline | [Link](./experiments/01_airline.ipynb) <br/> [Link](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 0.697 (-) | 0.716 (0.718) | 0.694 (0.717) |
| BCI | [Link](./experiments/02_BCI.ipynb) <br/> [Link](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 0.110 (0.093) | 0.142 (0.120) | 0.137 (0.138) |
| Football | [Link](./experiments/03_football.ipynb) <br/> [Link](./experiments/03_football_GPU.ipynb) | 19673 | 46 | 0.458 (0.470) | 0.460 (0.472) | 0.459 (0.470)|
| Planet Kaggle | [Link](./experiments/04_PlanetKaggle.ipynb) <br/> [Link](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 0.805 (-) | 0.822 (0.822) | 0.822 (0.821)|
| Fraud Detection | [Link](./experiments/05_FraudDetection.ipynb) <br/> [Link](./experiments/05_FraudDetection_GPU.ipynb) | 284807 | 30 | 0.824 (0.821) | 0.802 (0.814) | 0.813 (0.811) |
| BCI | [Link](./experiments/02_BCI.ipynb) <br/> [Link](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 0.110 (0.093) | 0.142 (0.120) | 0.137 (0.138) |
| Planet Kaggle | [Link](./experiments/04_PlanetKaggle.ipynb) <br/> [Link](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 0.805 (-) | 0.822 (0.822) | 0.822 (0.821)|
| HIGGS | [Link](./experiments/06_HIGGS.ipynb) <br/> [Link](./experiments/06_HIGGS_GPU.ipynb) | 11000000 | 28 | 0.757 (-) | 0.761 (0.761) | 0.761 (0.761) |
| Airline | [Link](./experiments/01_airline.ipynb) <br/> [Link](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 0.697 (-) | 0.716 (0.718) | 0.694 (0.717) |
The experiments were run on an Azure NV24 VM with 24 cores and 224 GB memory. The machine has 4 NVIDIA M60 GPUs. In both cases we used Ubuntu 16.04.