A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
Перейти к файлу
Nikita Titov 2959d2224a
Update IntegratedOpenCL.cmake
2024-08-10 17:17:48 +03:00
.ci Merge branch 'master' into ci/libboost 2024-08-07 22:04:21 +03:00
.github [ci] Require CMake 3.28 and replace `FetchContent_Populate` with `FetchContent_MakeAvailable` (#6550) 2024-08-02 15:33:41 +03:00
R-package [R-package] [cmake] simplify CMake-based R builds (#6591) 2024-08-06 21:25:44 +03:00
cmake Update IntegratedOpenCL.cmake 2024-08-10 17:17:48 +03:00
docker upgrade CMake in dockerfile-cli (fixes #6420) (#6426) 2024-04-30 11:31:00 -05:00
docs [ci] place all CI helpers under the .ci folder and use - instead of _ in their names (#6581) 2024-07-31 08:36:20 -05:00
examples [python-package] remove uses of deprecated NumPy random number generation APIs, require 'numpy>=1.17.0' (#6468) 2024-06-03 20:17:40 -05:00
external_libs update to fmt 10.1.1, fast_double_parser 0.7.0 (#6074) 2023-09-12 13:40:41 -05:00
include/LightGBM release v4.5.0 (#6538) 2024-07-25 09:51:01 -05:00
python-package [ci] Require CMake 3.28 and replace `FetchContent_Populate` with `FetchContent_MakeAvailable` (#6550) 2024-08-02 15:33:41 +03:00
src [ci] place all CI helpers under the .ci folder and use - instead of _ in their names (#6581) 2024-07-31 08:36:20 -05:00
swig [ci] prevent trailing whitespace, ensure files end with newline (#6373) 2024-03-18 23:24:14 -05:00
tests [ci] prevent `categorical.model` and `model.txt` files being left behind after testing (#6590) 2024-08-05 20:21:04 -05:00
windows [ci] prevent trailing whitespace, ensure files end with newline (#6373) 2024-03-18 23:24:14 -05:00
.appveyor.yml [ci] place all CI helpers under the .ci folder and use - instead of _ in their names (#6581) 2024-07-31 08:36:20 -05:00
.editorconfig [ci][python] run isort in CI linting job (#3990) 2021-02-16 20:09:13 +03:00
.git-blame-ignore-revs [ci] ignore ruff-format changes in git blame (fixes #6304) (#6345) 2024-02-28 23:30:27 -06:00
.gitignore [python-package] remove uses of deprecated NumPy random number generation APIs, require 'numpy>=1.17.0' (#6468) 2024-06-03 20:17:40 -05:00
.gitmodules Move compute and eigen libraries to external_libs folder (#3809) 2021-01-22 17:45:43 +03:00
.pre-commit-config.yaml [ci] upgrade linters to latest version (#6472) 2024-06-02 22:33:53 -05:00
.readthedocs.yaml [ci][docs] use miniforge for readthedocs builds (fixes #4954) (#4957) 2022-02-19 06:29:56 +03:00
.vsts-ci.yml Update .vsts-ci.yml 2024-08-10 17:00:40 +03:00
CMakeLists.txt [cmake] stop using file(GLOB) (#6588) 2024-08-06 18:30:33 +03:00
CODE_OF_CONDUCT.md Create CODE_OF_CONDUCT.md (#803) 2017-08-18 19:01:47 +08:00
CONTRIBUTING.md [docs] remove link to Roadmap (fixes #6556) (#6557) 2024-07-18 21:13:06 -05:00
LICENSE added editorconfig (#2403) 2019-09-16 14:38:26 +03:00
README.md [docs] add conda version badge (#6576) 2024-07-29 16:38:17 -05:00
SECURITY.md [ci] prevent trailing whitespace, ensure files end with newline (#6373) 2024-03-18 23:24:14 -05:00
VERSION.txt bump development version to 4.5.0.99 (#6575) 2024-07-29 12:26:14 -05:00
build-cran-package.sh [ci] [R-package] use --no-xattrs when re-tarring CRAN-style package (#6540) 2024-07-14 09:52:10 -07:00
build-python.sh [ci] ask pip to always install local artifact but not download package from PyPI (#6574) 2024-07-29 09:45:55 -05:00
build_r.R [R-package] always name the shared library 'lightgbm', not 'lib_lightgbm' (#6432) 2024-05-01 12:55:33 -05:00

README.md

Light Gradient Boosting Machine

Python-package GitHub Actions Build Status R-package GitHub Actions Build Status CUDA Version GitHub Actions Build Status Static Analysis GitHub Actions Build Status Azure Pipelines Build Status Appveyor Build Status Documentation Status Link checks License Python Versions PyPI Version conda Version CRAN Version NuGet Version

LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed and efficient with the following advantages:

  • Faster training speed and higher efficiency.
  • Lower memory usage.
  • Better accuracy.
  • Support of parallel, distributed, and GPU learning.
  • Capable of handling large-scale data.

For further details, please refer to Features.

Benefiting from these advantages, LightGBM is being widely-used in many winning solutions of machine learning competitions.

Comparison experiments on public datasets show that LightGBM can outperform existing boosting frameworks on both efficiency and accuracy, with significantly lower memory consumption. What's more, distributed learning experiments show that LightGBM can achieve a linear speed-up by using multiple machines for training in specific settings.

Get Started and Documentation

Our primary documentation is at https://lightgbm.readthedocs.io/ and is generated from this repository. If you are new to LightGBM, follow the installation instructions on that site.

Next you may want to read:

Documentation for contributors:

News

Please refer to changelogs at GitHub releases page.

External (Unofficial) Repositories

Projects listed here offer alternative ways to use LightGBM. They are not maintained or officially endorsed by the LightGBM development team.

LightGBMLSS (An extension of LightGBM to probabilistic modelling from which prediction intervals and quantiles can be derived): https://github.com/StatMixedML/LightGBMLSS

FLAML (AutoML library for hyperparameter optimization): https://github.com/microsoft/FLAML

Optuna (hyperparameter optimization framework): https://github.com/optuna/optuna

Julia-package: https://github.com/IQVIA-ML/LightGBM.jl

JPMML (Java PMML converter): https://github.com/jpmml/jpmml-lightgbm

Nyoka (Python PMML converter): https://github.com/SoftwareAG/nyoka

Treelite (model compiler for efficient deployment): https://github.com/dmlc/treelite

lleaves (LLVM-based model compiler for efficient inference): https://github.com/siboehm/lleaves

Hummingbird (model compiler into tensor computations): https://github.com/microsoft/hummingbird

cuML Forest Inference Library (GPU-accelerated inference): https://github.com/rapidsai/cuml

daal4py (Intel CPU-accelerated inference): https://github.com/intel/scikit-learn-intelex/tree/master/daal4py

m2cgen (model appliers for various languages): https://github.com/BayesWitnesses/m2cgen

leaves (Go model applier): https://github.com/dmitryikh/leaves

ONNXMLTools (ONNX converter): https://github.com/onnx/onnxmltools

SHAP (model output explainer): https://github.com/slundberg/shap

Shapash (model visualization and interpretation): https://github.com/MAIF/shapash

dtreeviz (decision tree visualization and model interpretation): https://github.com/parrt/dtreeviz

SynapseML (LightGBM on Spark): https://github.com/microsoft/SynapseML

Kubeflow Fairing (LightGBM on Kubernetes): https://github.com/kubeflow/fairing

Kubeflow Operator (LightGBM on Kubernetes): https://github.com/kubeflow/xgboost-operator

lightgbm_ray (LightGBM on Ray): https://github.com/ray-project/lightgbm_ray

Mars (LightGBM on Mars): https://github.com/mars-project/mars

ML.NET (.NET/C#-package): https://github.com/dotnet/machinelearning

LightGBM.NET (.NET/C#-package): https://github.com/rca22/LightGBM.Net

Ruby gem: https://github.com/ankane/lightgbm-ruby

LightGBM4j (Java high-level binding): https://github.com/metarank/lightgbm4j

lightgbm-rs (Rust binding): https://github.com/vaaaaanquish/lightgbm-rs

MLflow (experiment tracking, model monitoring framework): https://github.com/mlflow/mlflow

{bonsai} (R {parsnip}-compliant interface): https://github.com/tidymodels/bonsai

{mlr3extralearners} (R {mlr3}-compliant interface): https://github.com/mlr-org/mlr3extralearners

lightgbm-transform (feature transformation binding): https://github.com/microsoft/lightgbm-transform

postgresml (LightGBM training and prediction in SQL, via a Postgres extension): https://github.com/postgresml/postgresml

vaex-ml (Python DataFrame library with its own interface to LightGBM): https://github.com/vaexio/vaex

Support

How to Contribute

Check CONTRIBUTING page.

Microsoft Open Source Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Reference Papers

Yu Shi, Guolin Ke, Zhuoming Chen, Shuxin Zheng, Tie-Yan Liu. "Quantized Training of Gradient Boosting Decision Trees" (link). Advances in Neural Information Processing Systems 35 (NeurIPS 2022), pp. 18822-18833.

Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, Tie-Yan Liu. "LightGBM: A Highly Efficient Gradient Boosting Decision Tree". Advances in Neural Information Processing Systems 30 (NIPS 2017), pp. 3149-3157.

Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu. "A Communication-Efficient Parallel Algorithm for Decision Tree". Advances in Neural Information Processing Systems 29 (NIPS 2016), pp. 1279-1287.

Huan Zhang, Si Si and Cho-Jui Hsieh. "GPU Acceleration for Large-scale Tree Boosting". SysML Conference, 2018.

License

This project is licensed under the terms of the MIT license. See LICENSE for additional details.