Light Gradient Boosting Machine
LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed and efficient with the following advantages:
- Faster training speed and higher efficiency.
- Lower memory usage.
- Better accuracy.
- Support of parallel, distributed, and GPU learning.
- Capable of handling large-scale data.
For further details, please refer to Features.
Benefitting from these advantages, LightGBM is being widely-used in many winning solutions of machine learning competitions.
Comparison experiments on public datasets show that LightGBM can outperform existing boosting frameworks on both efficiency and accuracy, with significantly lower memory consumption. What's more, distributed learning experiments show that LightGBM can achieve a linear speed-up by using multiple machines for training in specific settings.
Get Started and Documentation
Our primary documentation is at https://lightgbm.readthedocs.io/ and is generated from this repository. If you are new to LightGBM, follow the installation instructions on that site.
Next you may want to read:
- Examples showing command line usage of common tasks.
- Features and algorithms supported by LightGBM.
- Parameters is an exhaustive list of customization you can make.
- Distributed Learning and GPU Learning can speed up computation.
- Laurae++ interactive documentation is a detailed guide for hyperparameters.
- FLAML provides automated tuning for LightGBM (code examples).
- Optuna Hyperparameter Tuner provides automated tuning for LightGBM hyperparameters (code examples).
Documentation for contributors:
- How we update readthedocs.io.
- Check out the Development Guide.
News
Please refer to changelogs at GitHub releases page.
Some old update logs are available at Key Events page.
External (Unofficial) Repositories
FLAML (AutoML library for hyperparameter optimization): https://github.com/microsoft/FLAML
Optuna (hyperparameter optimization framework): https://github.com/optuna/optuna
Julia-package: https://github.com/IQVIA-ML/LightGBM.jl
JPMML (Java PMML converter): https://github.com/jpmml/jpmml-lightgbm
Treelite (model compiler for efficient deployment): https://github.com/dmlc/treelite
cuML Forest Inference Library (GPU-accelerated inference): https://github.com/rapidsai/cuml
daal4py (Intel CPU-accelerated inference): https://github.com/IntelPython/daal4py
m2cgen (model appliers for various languages): https://github.com/BayesWitnesses/m2cgen
leaves (Go model applier): https://github.com/dmitryikh/leaves
ONNXMLTools (ONNX converter): https://github.com/onnx/onnxmltools
SHAP (model output explainer): https://github.com/slundberg/shap
MMLSpark (LightGBM on Spark): https://github.com/Azure/mmlspark
Kubeflow Fairing (LightGBM on Kubernetes): https://github.com/kubeflow/fairing
Kubeflow Operator (LightGBM on Kubernetes): https://github.com/kubeflow/xgboost-operator
ML.NET (.NET/C#-package): https://github.com/dotnet/machinelearning
LightGBM.NET (.NET/C#-package): https://github.com/rca22/LightGBM.Net
Ruby gem: https://github.com/ankane/lightgbm
LightGBM4j (Java high-level binding): https://github.com/metarank/lightgbm4j
lightgbm-rs (Rust binding): https://github.com/vaaaaanquish/lightgbm-rs
MLflow (experiment tracking, model monitoring framework): https://github.com/mlflow/mlflow
{treesnip} (R {parsnip}-compliant interface): https://github.com/curso-r/treesnip
{mlr3learners.lightgbm} (R {mlr3}-compliant interface): https://github.com/mlr3learners/mlr3learners.lightgbm
Support
- Ask a question on Stack Overflow with the
lightgbmtag, we monitor this for new questions. - Open bug reports and feature requests (not questions) on GitHub issues.
How to Contribute
Check CONTRIBUTING page.
Microsoft Open Source Code of Conduct
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.
Reference Papers
Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, Tie-Yan Liu. "LightGBM: A Highly Efficient Gradient Boosting Decision Tree". Advances in Neural Information Processing Systems 30 (NIPS 2017), pp. 3149-3157.
Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu. "A Communication-Efficient Parallel Algorithm for Decision Tree". Advances in Neural Information Processing Systems 29 (NIPS 2016), pp. 1279-1287.
Huan Zhang, Si Si and Cho-Jui Hsieh. "GPU Acceleration for Large-scale Tree Boosting". SysML Conference, 2018.
Note: If you use LightGBM in your GitHub projects, please add lightgbm in the requirements.txt.
License
This project is licensed under the terms of the MIT license. See LICENSE for additional details.
![[R-package] miscellaneous changes to comply with CRAN requirements](https://avatars.githubusercontent.com/u/7608904?v=4)
![[python] [setup] improving installation](https://avatars.githubusercontent.com/u/25141164?v=4)
![[python] Bug fix for first_metric_only on earlystopping.](https://avatars.githubusercontent.com/u/7313648?v=4)
![[R-Package] CRAN issues](https://avatars.githubusercontent.com/u/9083669?v=4)
6.9k Jan 5, 2023
126 Dec 28, 2022
538 Jan 1, 2023
84 Nov 25, 2022
3.3k Dec 28, 2022
1 Jan 1, 2022
2 Jul 19, 2022
1 Dec 22, 2021
1 Jan 19, 2022
92 Dec 14, 2022
1.6k Dec 31, 2022
55 Dec 27, 2022
2 Jun 26, 2022
3k Jan 8, 2023
174 Dec 7, 2022
164 Jan 4, 2023
31 Dec 16, 2022
4.9k Jan 5, 2023
73 Dec 1, 2022