Граф коммитов

7 Коммитов

Автор SHA1 Сообщение Дата
masahi 71c951d31c
Introduce BatchContainer for batch by batch prediction use case (#377)
* introducing BatchContainer

* BatchContainer basic functionality done

* pass test_input to _convert

* introduce convert_batch API

* use convert_batch in the benchmark

* store _batch_size attribute

* test working

* run black, add concat output option, fix benchmark

* fix getattr

* fix operator benchmark

* support transform and decision function

* make sure input is tuple not list

* fix torch backend prediction

* begin fixing tests

* squeeze and ravel on onnx regression output

* all tests in test_extra_conf.py working

* restore BATCH_SIZE and k neighbor test

* fix onnxml test

* run black on test_extra_conf.py

* fix test_sklearn_normalizer_converter.py

* fix test_lightgbm_converter.py

* fixing more onnxml tests

* fixed remaining onnxml tests

* use format, fix pylint

* fix typo

* add document

* add missing doc

* fix typo

* doc update, remove unused stuff
2020-12-14 14:09:37 -08:00
masahi f631a4df05
[Benchmark] Add batch_benchmark option to do benchmark on a single batch (not on a whole data) (#369)
* add xgb gpu support

* clean up predict

* fix setting predict_fn

* fix corner cases

* run black

* restore xgb batching

* fix max depth option ignored

* avoid allocating prediction array for xgb when batch bench

* fix onnx ml backend for batch benchmark

* create session once in onnxml backend

Co-authored-by: Masahiro Masuda <masahi@129@gmail.com>
2020-12-03 14:23:03 -08:00
Matteo Interlandi 409c09a937
Add TVM backend (#236)
* add containers for onnx models

* add tvm_installed, initial work on topology

* add containers
add tvm backend to supported
add few tests

* fix type error in TVM
tree_trav and perf_tree_trav now work

* Add TVM_MAX_FUSE_DEPTH option
Add BATCH_SIZE option
Tree trav generate indexes based on batch size (if available)
TVM takes the max fuse detph configuration if set
2020-11-03 13:21:02 -08:00
Matteo Interlandi 6e5f439083
Fix few issues with the benchmars (#354)
* fix score scripts

* pandas datasets -> numpy
2020-10-30 08:35:40 -07:00
Matteo Interlandi 0e969857f8
Add pipeline benchmark (#331)
* add benchmark code for trees

* add pipeline benchmark scripts
add readme for all benchmarks
2020-10-27 09:35:31 -07:00
Matteo Interlandi 0a34f53856
Add scripts for the operators bench (#330)
* add benchmark code for trees

* device can be added directly to convert

* add code for tvm

* refactoring of the tree benchmark files

* add operators scripts
few fixes in the tree bench
2020-10-23 15:40:46 -07:00
Matteo Interlandi cb05a38fc8
Add benchmark scripts for trees (#328)
* add benchmark code for trees

* device can be added directly to convert

* add code for tvm

* refactoring of the tree benchmark files
2020-10-22 15:06:13 -07:00