LightGBM/R-package
James Lamb 9478e52f9f
[R-package] fix R examples and lgb.plot.interpretation() (#3002)
* [R-package] fix R examples and lgb.plot.interpretation

* remove space in gitignore

* try data.table from conda-forge

* update FAQ

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>
2020-04-21 13:47:23 -05:00
..
R [R-package] fix R examples and lgb.plot.interpretation() (#3002) 2020-04-21 13:47:23 -05:00
data [R-package] Add more examples and bank dataset (#887) 2017-09-04 18:21:15 +08:00
demo [R-package] [ci] added more linters (#2803) 2020-03-17 23:33:29 +03:00
inst/bin [R-package] CRAN fixes (#1499) 2018-08-29 13:31:42 +09:00
man [R-package] fix R examples and lgb.plot.interpretation() (#3002) 2020-04-21 13:47:23 -05:00
pkgdown added JS file (#2387) 2019-09-07 12:43:01 -05:00
src [R-package] adding routine registration in R package (fixes #1910) (#2911) 2020-04-01 11:18:52 -05:00
tests Support UTF-8 characters in feature name again (#2976) 2020-04-10 12:54:01 +09:00
.Rbuildignore [R-package] adding routine registration in R package (fixes #1910) (#2911) 2020-04-01 11:18:52 -05:00
DESCRIPTION [R-package] fix R examples and lgb.plot.interpretation() (#3002) 2020-04-21 13:47:23 -05:00
LICENSE added editorconfig (#2403) 2019-09-16 14:38:26 +03:00
NAMESPACE [R-package][docs] made roxygen2 tags explicit and cleaned up documentation (#2688) 2020-01-20 22:35:49 +03:00
README.md [R-package] Added unit tests on creating Booster from file or string (#2945) 2020-04-08 14:40:26 -05:00

README.md

LightGBM R-package

Contents

Installation

Preparation

You need to install git and CMake first.

Note: 32-bit R/Rtools is not supported.

Windows Preparation

Installing Rtools is mandatory, and only support the 64-bit version. It requires to add to PATH the Rtools MinGW64 folder, if it was not done automatically during installation.

The default compiler is Visual Studio (or VS Build Tools) in Windows, with an automatic fallback to Rtools or any MinGW64 (x86_64-posix-seh) available (this means if you have only Rtools and CMake, it will compile fine).

To force the usage of Rtools / MinGW, you can set use_mingw to TRUE in R-package/src/install.libs.R.

For users who wants to install online with GPU or want to choose a specific compiler, please check the end of this document for installation using a helper package (Laurae2/lgbdl).

Warning for Windows users: it is recommended to use Visual Studio for its better multi-threading efficiency in Windows for many core systems. For very simple systems (dual core computers or worse), MinGW64 is recommended for maximum performance. If you do not know what to choose, it is recommended to use Visual Studio, the default compiler. Do not try using MinGW in Windows on many core systems. It may result in 10x slower results than Visual Studio.

Mac OS Preparation

You can perform installation either with Apple Clang or gcc. In case you prefer Apple Clang, you should install OpenMP (details for installation can be found in Installation Guide) first and CMake version 3.16 or higher is required. In case you prefer gcc, you need to install it (details for installation can be found in Installation Guide) and set some environment variables to tell R to use gcc and g++. If you install these from Homebrew, your versions of g++ and gcc are most likely in /usr/local/bin, as shown below.

# replace 8 with version of gcc installed on your machine
export CXX=/usr/local/bin/g++-8 CC=/usr/local/bin/gcc-8

Install

Build and install R-package with the following commands:

git clone --recursive https://github.com/microsoft/LightGBM
cd LightGBM
Rscript build_r.R

The build_r.R script builds the package in a temporary directory called lightgbm_r. It will destroy and recreate that directory each time you run the script.

Note: for the build with Visual Studio/VS Build Tools in Windows, you should use the Windows CMD or Powershell.

Windows users may need to run with administrator rights (either R or the command prompt, depending on the way you are installing this package). Linux users might require the appropriate user write permissions for packages.

Set use_gpu to TRUE in R-package/src/install.libs.R to enable the build with GPU support. You will need to install Boost and OpenCL first: details for installation can be found in Installation-Guide.

If you are using a precompiled dll/lib locally, you can move the dll/lib into LightGBM root folder, modify LightGBM/R-package/src/install.libs.R's 2nd line (change use_precompile <- FALSE to use_precompile <- TRUE), and install R-package as usual. NOTE: If your R version is not smaller than 3.5.0, you should set DUSE_R35=ON in cmake options when build precompiled dll/lib.

When your package installation is done, you can check quickly if your LightGBM R-package is working by running the following:

library(lightgbm)
data(agaricus.train, package='lightgbm')
train <- agaricus.train
dtrain <- lgb.Dataset(train$data, label=train$label)
params <- list(objective="regression", metric="l2")
model <- lgb.cv(params, dtrain, 10, nfold=5, min_data=1, learning_rate=1, early_stopping_rounds=10)

Installation with Precompiled dll/lib from R Using GitHub

You can install LightGBM R-package from GitHub with devtools thanks to a helper package for LightGBM.

Prerequisites

You will need:

  • Precompiled LightGBM dll/lib
  • MinGW / Visual Studio / gcc (depending on your OS and your needs) with make in PATH environment variable
  • git in PATH environment variable
  • CMake in PATH environment variable
  • lgbdl R-package, which can be installed using devtools::install_github("Laurae2/lgbdl")
  • Rtools if using Windows

In addition, if you are using a Visual Studio precompiled DLL, assuming you do not have Visual Studio installed (if you have it installed, ignore the warnings below):

  • Visual Studio 2015/2017/2019 precompiled DLL: download and install Visual Studio Runtime for 2015/2017/2019 (you will get an error about MSVCP140.dll missing otherwise)

Once you have all this setup, you can use lgb.dl from lgbdl package to install LightGBM from repository.

For instance, you can install the R-package from LightGBM master commit of GitHub with Visual Studio using the following from R:

lgb.dl(commit = "master",
       compiler = "vs",
       repo = "https://github.com/microsoft/LightGBM")

You may also install using a precompiled dll/lib using the following from R:

lgb.dl(commit = "master",
       libdll = "C:\\LightGBM\\windows\\x64\\DLL\\lib_lightgbm.dll", # YOUR PRECOMPILED DLL
       repo = "https://github.com/microsoft/LightGBM")

You may also install online using a LightGBM with proper GPU support using Visual Studio (as an example here) using the following from R:

lgb.dl(commit = "master",
       compiler = "vs", # Remove this for MinGW + GPU installation
       repo = "https://github.com/microsoft/LightGBM",
       use_gpu = TRUE)

For more details about options, please check Laurae2/lgbdl R-package.

You may also read Microsoft/LightGBM#912 for a visual example for LightGBM installation in Windows with Visual Studio.

Examples

Please visit demo:

Testing

The R package's unit tests are run automatically on every commit, via integrations like Travis CI and Azure DevOps. Adding new tests in R-package/tests/testthat is a valuable way to improve the reliability of the R package.

When adding tests, you may want to use test coverage to identify untested areas and to check if the tests you've added are covering all branches of the intended code.

The example below shows how to generate code coverage for the R package on a macOS or Linux setup, using gcc-8 to compile LightGBM. To adjust for your environment, swap out the 'Install' step with the relevant code from the instructions above.

# Install
export CXX=/usr/local/bin/g++-8
export CC=/usr/local/bin/gcc-8
Rscript build_r.R

# Get coverage
Rscript -e " \
    coverage  <- covr::package_coverage('./lightgbm_r', quiet=FALSE);
    print(coverage);
    covr::report(coverage, file = file.path(getwd(), 'coverage.html'), browse = TRUE);
    "

External (Unofficial) Repositories

Projects listed here are not maintained or endorsed by the LightGBM development team, but may offer some features currently missing from the main R package.

  • lightgbm.py: This R package offers a wrapper built with reticulate, a package used to call Python code from R. If you are comfortable with the added installation complexity of installing lightgbm's Python package and the performance cost of passing data between R and Python, you might find that this package offers some features that are not yet available in the native lightgbm R package.

Known Issues

For information about known issues with the R package, see the R-package section of LightGBM's main FAQ page.