microsoft
/
onnxruntime-extensions
зеркало из https://github.com/microsoft/onnxruntime-extensions.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
onnxruntime-extensions/tutorials/ortx_api
История
Wenbing Li c58c930739
Ignore all streaming output of invalid utf-8 string (#704) 
* Ignore all streaming output of invalid utf-8 string

* Update bpe_streaming.hpp

* add the phi-3 tokenizer test

* add a streaming test for phi-3 model

* fix the utf-8 validation

* fix the utf-8 validation 2

* fix the utf-8 validation 3

* fix the utf-8 validation 4
 		2024-05-06 16:46:55 -07:00
..
src A tutorial of build ort-extensions from source as a static library (#703) 2024-05-01 13:46:27 -07:00
CMakeLists.txt Ignore all streaming output of invalid utf-8 string (#704) 2024-05-06 16:46:55 -07:00
README.md A tutorial of build ort-extensions from source as a static library (#703) 2024-05-01 13:46:27 -07:00

README.md

Running the Demo

To run this demo, you'll need a developer tool like Visual Studio Code or a command line tool that supports CMake to configure the project. Once configured, compile the C++ project ortx_api_test to build the test program, and then run it.