* Unify the image operations in extensions library
* fix the build configuration issue
* More build fixings
* Fix the native image codec
* fix encode_image
* Add bgr/rgb conversion for encoding image
* parity check
* build break
* update PNG encoding parameters
* build break on Linux
* using MSE to compare images
* fix the discrependency between Linux and Windows
* final code refinement
* one more change
* fix the C++ warnings
---------
Co-authored-by: Sayan Shaw <52221015+sayanshaw24@users.noreply.github.com>
* Remove OpenCV dependency from C_API model
* fix build on Windows
* switch ci build flag
* try to fix the macOS build issue
* more fixing
* fix the macOS build issue
* list jpeg source
* verified on MacOS
* update the pp_api too
* avoid the codecs library conflicts
* Add the unit tests
* move the codec test
* add the missing dl lib for extensions test
* refine the code
* a smaller fixing for Windows Python
* initial api for tokenizer
* More fixings and test data refinement
* add a simple wrapper for pre-processing APIs
* fix the test issues
* test if the tokenizer is spm based
* fix the failed test cases
* json pointer does not work
* dd "-allow-unsupported-compiler" flags to Windows CUDA flags
inspired by this PR: https://github.com/microsoft/onnxruntime/pull/21004
* switch to cmake command line
* handle the issues caused by the latest MSVC release
* correct the typo
* correct the parameter
* try one dash again
* use the installed cmake
* use cmake standalone installation firstly
* use the standalone cmake in win32 python too
* fix it more
* one more try
* fix the MacOS pipeline issue
* fix the pip command line
* the new tokenizer API
* set the api cmake option off
* fix the pipeline
* more pipelines fixing
* fix the ci pipeline of macOS Python
* added token supporting
* fix the simdjson issue on gcc
* undo tfmtok
* remove the simdjson
* add an experimental CUDA python unit test pipeline
* typo
* in ci.yml?
* winpycuda
* move it in optional
* enable cuda pytest in linuxbuild
* build in docker
* add the cuda pytest for windows
* cuda flag fixing
* minor fixing
* typo
---------
Co-authored-by: Yi Zhang <zhanyi@microsoft.com>
Wenbing Li
cao lei