Transformation library for LightGBM
Перейти к файлу
Ubuntu 2d9dfd1acc upgrade publish package and CI process to adapt to changes in LightGBM about finding libpath 2023-11-23 14:07:19 +00:00
.ci upgrade publish package and CI process to adapt to changes in LightGBM about finding libpath 2023-11-23 14:07:19 +00:00
.github Update issue templates 2022-08-09 10:41:56 +08:00
azureml update transform pkg version 2021-11-23 11:39:48 +00:00
docs Add auto-generate query column of transform for scripts and doc (#15) 2022-03-08 18:53:06 +08:00
examples update freeform2 parser and add python tests 2021-11-08 09:17:43 +00:00
external_libs lightgbm version update (#26) 2023-11-15 16:19:54 +08:00
scripts upgrade publish package and CI process to adapt to changes in LightGBM about finding libpath 2023-11-23 14:07:19 +00:00
src clean test data 2022-09-02 04:13:48 +00:00
tests clean test data (#23) 2022-09-02 00:25:13 +08:00
.gitignore update publish python package script 2021-11-23 11:37:18 +00:00
.gitmodules add submodule LightGBM 2021-11-16 07:22:25 +00:00
CMakeLists.txt update cmake list for better organization 2021-11-05 14:59:44 +00:00
CODE_OF_CONDUCT.md CODE_OF_CONDUCT.md committed 2021-10-31 23:23:13 -07:00
LICENSE LICENSE committed 2021-10-31 23:23:14 -07:00
README.md add doc links to get started 2021-11-16 07:48:53 +00:00
SECURITY.md SECURITY.md committed 2021-10-31 23:23:15 -07:00
SUPPORT.md SUPPORT.md committed 2021-10-31 23:23:16 -07:00
VERSION.txt lightgbm version update (#26) 2023-11-15 16:19:54 +08:00

README.md

LightGBM Transformation Library

The LightGBM transformation library aims at providing a flexible and automatic way to do feature transformation when using LightGBM. Compared to separate transformation. this way has several pros:

  • More efficient. Data preprocessing can go with parsing each line, and take advantage of multi-processing designed by lightgbm naturally. No need to store whole transformed data in file/memory.
  • More convenient for development and iteration. Built-in transformation could keep offline and online consistent well by saved/loaded along with model.

In the repo, user could learn about:

  • How to customize favorite parser by playing with LightGBM Parser interface.
  • How to use FreeForm2Parser, a powerful and efficient tool built in the repo, in model training. Instead of handling data yourself, user just need to prepare a feature spec which contains feature name, transform type and expression, and make slight changes in experiment iterations.

Get Started and Documentation

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.