From 12f1227519ec75aa56d5979d163d12401cc80a05 Mon Sep 17 00:00:00 2001 From: Miguel Fierro Date: Tue, 11 Jul 2017 16:37:07 +0100 Subject: [PATCH] changed order table --- README.md | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 3eb92c8..fb72eb3 100755 --- a/README.md +++ b/README.md @@ -25,23 +25,24 @@ In the following table there are summarized the time results (in seconds) and th | Dataset | Experiment | Data size | Features | xgb time:
CPU (GPU) | xgb_hist time:
CPU (GPU) | lgb time:
CPU (GPU) | ratio xgb/lgb:
CPU (GPU) | ratio xgb_hist/lgb:
CPU
(GPU) | | --- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | -| Airline | [Link CPU](./experiments/01_airline.ipynb)
[Link GPU](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 4428.49 (-) | 384.74 (432.14) | 258.62 (210.92) | 17.12
(-) | 1.48
(2.04) | -| BCI | [Link CPU](./experiments/02_BCI.ipynb)
[Link GPU](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 11.51 (12.93) | 41.84 (42.69) | 7.31 (2.76)| 1.57
(4.67) | 5.72
(15.43) | | Football | [Link CPU](./experiments/03_football.ipynb)
[Link GPU](./experiments/03_football_GPU.ipynb) | 19673 | 46 | 1.78 (7.09) | 3.57 (4.58) | 0.64 (0.97) | 2.75
(7.26) | 5.51
(4.69) | -| Planet Kaggle | [Link CPU](./experiments/04_PlanetKaggle.ipynb)
[Link GPU](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 313.89 (-) | 2115.28 (2028.43) | 194.57 (317.68)| 1.61
(-) | 10.87
(6.38) | | Fraud Detection | [Link CPU](./experiments/05_FraudDetection.ipynb)
[Link GPU](./experiments/05_FraudDetection_GPU.ipynb) | 284807 | 30 | 4.34 (5.80) | 2.01 (1.64) | 0.66 (0.29) | 6.58
(19.74) | 3.04
(5.58) | +| BCI | [Link CPU](./experiments/02_BCI.ipynb)
[Link GPU](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 11.51 (12.93) | 41.84 (42.69) | 7.31 (2.76)| 1.57
(4.67) | 5.72
(15.43) | +| Planet Kaggle | [Link CPU](./experiments/04_PlanetKaggle.ipynb)
[Link GPU](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 313.89 (-) | 2115.28 (2028.43) | 194.57 (317.68)| 1.61
(-) | 10.87
(6.38) | | HIGGS | [Link CPU](./experiments/06_HIGGS.ipynb)
[Link GPU](./experiments/06_HIGGS_GPU.ipynb) | 11000000 | 28 | 653.45 (-) | 74.42 (79.26) | 63.32 (55.90) | 10.31
(-) | 1.17
(1.41) | +| Airline | [Link CPU](./experiments/01_airline.ipynb)
[Link GPU](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 4428.49 (-) | 384.74 (432.14) | 258.62 (210.92) | 17.12
(-) | 1.48
(2.04) | + In the next table we summarize the performance results using the [F1-Score](https://en.wikipedia.org/wiki/F1_score). | Dataset | Experiment | Data size | Features | xgb F1:
CPU (GPU) | xgb_hist F1:
CPU (GPU) | lgb F1:
CPU (GPU) | | --- | :---: | :---: | :---: | :---: | :---: | :---: | -| Airline | [Link](./experiments/01_airline.ipynb)
[Link](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 0.697 (-) | 0.716 (0.718) | 0.694 (0.717) | -| BCI | [Link](./experiments/02_BCI.ipynb)
[Link](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 0.110 (0.093) | 0.142 (0.120) | 0.137 (0.138) | | Football | [Link](./experiments/03_football.ipynb)
[Link](./experiments/03_football_GPU.ipynb) | 19673 | 46 | 0.458 (0.470) | 0.460 (0.472) | 0.459 (0.470)| -| Planet Kaggle | [Link](./experiments/04_PlanetKaggle.ipynb)
[Link](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 0.805 (-) | 0.822 (0.822) | 0.822 (0.821)| | Fraud Detection | [Link](./experiments/05_FraudDetection.ipynb)
[Link](./experiments/05_FraudDetection_GPU.ipynb) | 284807 | 30 | 0.824 (0.821) | 0.802 (0.814) | 0.813 (0.811) | +| BCI | [Link](./experiments/02_BCI.ipynb)
[Link](./experiments/02_BCI_GPU.ipynb) | 20497 | 2048 | 0.110 (0.093) | 0.142 (0.120) | 0.137 (0.138) | +| Planet Kaggle | [Link](./experiments/04_PlanetKaggle.ipynb)
[Link](./experiments/04_PlanetKaggle_GPU.ipynb) | 40479 | 2048 | 0.805 (-) | 0.822 (0.822) | 0.822 (0.821)| | HIGGS | [Link](./experiments/06_HIGGS.ipynb)
[Link](./experiments/06_HIGGS_GPU.ipynb) | 11000000 | 28 | 0.757 (-) | 0.761 (0.761) | 0.761 (0.761) | +| Airline | [Link](./experiments/01_airline.ipynb)
[Link](./experiments/01_airline_GPU.ipynb) | 115069017 | 13 | 0.697 (-) | 0.716 (0.718) | 0.694 (0.717) | The experiments were run on an Azure NV24 VM with 24 cores and 224 GB memory. The machine has 4 NVIDIA M60 GPUs. In both cases we used Ubuntu 16.04.