* fix the build for mobile packaging
* update the cmake file as well
* more fixing on dlib related ops
* release the iOS cmake version constraint
* upgrade cmake in Linux CUDA build
* Update Dockerfile.ubuntu_cuda11_8_tensorrt8_6 for typo
* Update ios_packaging.yml for Azure Pipelines
* update the dlib versoin
* update all cases of cmake version
* update the comment for dlb cmake
* initial commit
* Ugm vocab loaded is good
* test passed
* fixes unit test on win32
* finish the parity check
* code refinement
* code refinement for review
* reimplement resize cpu kernel for image processing
* accuracy fixing and code refinement
* fix the build issues
* fix Linux build issue
* more fixings
* Fix the pipeline issue
* fix the ci script
* try to fix CUDA machine pool
* switch cmake cmp0169 flag to new
* the missing spm code.
* more refinement on cmake build targets
* Update ci.yml
* Update ci.yml
* update the jpg files after using libjpeg instead of libjpeg-turbo
* exclude cutlass too
* upgrade the protobuf library to be consistent with ORT
* update the protoc generated files
* use the right patch name
* Update cutlass.cmake
* dd "-allow-unsupported-compiler" flags to Windows CUDA flags
inspired by this PR: https://github.com/microsoft/onnxruntime/pull/21004
* switch to cmake command line
* handle the issues caused by the latest MSVC release
* correct the typo
* correct the parameter
* try one dash again
* use the installed cmake
* use cmake standalone installation firstly
* use the standalone cmake in win32 python too
* fix it more
* one more try
* fix the MacOS pipeline issue
* fix the pip command line
- update protobuf version being used by sentencepiece and the java tests
- ignore unused language bindings from protobuf and triton
- specify the CG config file with ignored directories where required
Fix cgmanifest.json
- 'git' entries require a commit hash not version
- use 'other' for opencv third party code that is included directly in the opencv repo
- the path isn't a valid repositoryUrl value to be provided as a 'git' entry
- update version numbers/commit hashes to match the latest code
Co-authored-by: Sayan Shaw <52221015+sayanshaw24@users.noreply.github.com>
* only keep the image decoder from opencv
* initial build
* refine the code
* Add clear functions
* Update CMakeLists.txt
* Update opencv.cmake
* change the output type to float
* get the result
* align image-process with original Python
* move the LoadRawImages into library
* fix the calculation error
* fix the pipeline build issue
* fix the build breaks in ci pipeline
* support json configuration file and refactor the code.
* initial checkins
* fix the selectedops build failures
* add the tokenization implementation
* update the windows DEF file for c abi in cmake file
* fix the build on linux
* fix some warnings and remove the unused code
* initial import of unit tests from tfmtok
* add streaming API support
* fix the merges loading issues
* complete export from tfmtok - needs input id fixing
* fix the unit test failures.
* fix all unit test failure
* refactor streaming code
* remove the unused code
---------
Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
* refactor the header file in include folder
* fix the basic-token eager unit test case
* a more flexible way to handle string tensor shape.
* fix the unit test path issue
* remove the multi-inherits to avoid issue during pointer casting
* add api cmake build support
* undo some temporary changes
* code refinement
* fix variadic arg
* only expose the context for ort version >= 17
* fix a shape bug
* fix the cuda build issue
* change ifdef condition of GetAllocator
* finalize the ort c abi wrapper file name
* fix the iOS build break
* align gtest version with triton
* Update ext_apple_framework.cmake for iOS header files
---------
Co-authored-by: Cheng Tang <chenta@a100.crj0ad2y1kku1j4yxl4sj10o4e.gx.internal.cloudapp.net>
* doc ops (#529)
* Try and make CIs pass with Azure ops enabled by default.
Misc. other cleanups
* Fix some CI issues.
Cleanups some bits and pieces.
* Fix a couple of issues.
* Fix arg to build.bat
* Increase warning in triton client build to make binskim happy (hopefully).
* Try patching the warning level in the triton grpc branch as well. Shouldn't matter but...
* Run triton patch command for windows as well.
* Add patch.exe directly so windows builds work.
* override auth gen for AOAI
* fix build
* switch to windows-static
* update model for azure chat
* document triton invoker
* doc chat endpoint
* document triton invoker
* format
* format
* format
---------
Co-authored-by: Scott McKay <Scott.McKay@microsoft.com>
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
* address comments
* move doc sect
* typo
* typo
---------
Co-authored-by: Scott McKay <Scott.McKay@microsoft.com>
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
* Build fixes
- zlib needs to come from vcpkg if azures ops are being built and opencv isn't enabled
- set the IR version to 8 for some of the azure ops test models so they can be tested when ORT 1.14 is used
- pass through new ort version value so that a consistent version is used to a) pull the ORT package for the c++ unit tests and b) disable azure ops if ORT version is too old.
* Update to automatically chain package to avoid build errors during the install if cmake runs commands in parallel
* Define simplified ORT_FILE for older ORT versions
* Fix LNK4098 warning from sentencepiece forcibly changing the build flags.
> LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
* Use CMAKE_MSVC_RUNTIME_LIBRARY to determine whether /MT should be used.
* Refactor setup for Azure ops to try and make common things more re-usable, and for the actual ops to simply layer in the specific input/output constraints for that type of request.
Currently builds on Linux, Windows (x64 only) and Android
Android requires a manual pre-build of openssl and curl.
Linux requires a manual pre-install of openssl.
Windows currently only works for x64. Other targets need the triplet adjusted.
* Address PR comments
* Fix could of android build warnings.
* Update .gitignore to remove old path
* Fix build break from merge
* release the dependency package version
* upgrade the dependency versions
* more fixing for 3.11
* Update ci.yml
* upgrade torch version in MacOS
* fix torch version in MacOS
* upgrade Python support versions
* pybind11 switch URL mode
* more URL modes
* evaluate the audio decoder library
* MP3 Decoder
* rename it to test_audio_codec
* add the audio decoder to whisper model
* whisper end-to-end draft
* fix the mp3 decoder
* Running with ONNX models
* Add more audio format supports
* refine the end-to-end script
* Update operators/audio/audio_decoder.hpp
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
* Update operators/audio/audio_decoder.hpp
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
* Update operators/audio/audio_decoder.hpp
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
* some fixings of comments and more test cases.
* changes for review comments.
* Update audio_decoder.hpp
* Update audio_decoder.hpp
* code refinement
* Update operators/audio/audio_decoder.hpp
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
---------
Co-authored-by: Sayan Shaw <52221015+sayanshaw24@users.noreply.github.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
* add a stft-norm custom op for log-mel spectrum.
* undo the debug change
* Support ONNX standard STFT op signature.
* Add a unit test onnx STFT compatible mode.
* add whisper pre-/post- processing example
* Update dlib.cmake
* undo test code changes
* Update setup.cfg
* update the end2end example with STFT op
* initial PR
* add the attributes for op
* cmake update
* add the missing symbol
* add a unit test case
* fix the unit test
* fix some corner case.
* format Python code with autopep8
* security warning of sentencepiece
* update cmake option policy
* option set
* revert abseil change
* wrong patch name
* upgrade protobuf to 3.20.2, align with ORT 1.14
* weird patch issue
* code refinement
* typo
* Update version.txt
* undo version change
* doc refinement
* one more missing
* is ==
* disaable some case running under ort 1.13
* Update cmake/externals/sentencepieceproject.cmake
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
* Update cmake/externals/sentencepieceproject.cmake
Co-authored-by: Scott McKay <skottmckay@gmail.com>
* Update cmake/externals/sentencepieceproject.cmake
Co-authored-by: Scott McKay <skottmckay@gmail.com>
* Update cmake/externals/sentencepieceproject.cmake
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
* review update
* set default warning level 3 to meet some requirement
---------
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
Co-authored-by: Scott McKay <skottmckay@gmail.com>
* Combined ORT + ort-ext build for Android fails due to protobuf mismatch. Move the setting of SPM_USE_BUILTIN_PROTOBUF to before the populate to fix.
* Set CACHE INTERNAL as well to avoid issue with CMP0077.
* Separate ops in operators/cv2 that do and do not require codecs so they're easier to include/exclude from a build.
Remove jpeg2000 from opencv file formats. It costs 1MB and is (afaict) not a common format.
Add ability to enable/disable cv2 ops to gen_selectedops.py.
* Remove super resolution pre/post process ops that are no longer needed.
* Replace super resolution e2e tutorial
Co-authored-by: Wenbing Li <10278425+wenbingl@users.noreply.github.com>
Initial changes for adding an iOS package.
Add infrastructure to build iOS static framework, xcframework, and CocoaPods package.
Add test project that uses package.
Add package build and test to CI pipeline.
* Initial changes for supporting mobilenet and superresolution.
- Script to update model with pre/post processing
- custom ops for decode/encode
- user just has to provide jpg or png bytes
- superresolution can return the updated image in jpg or png
- models for testing
Updated cmake setup to enable building of the vision pre/post processing ops
- opencv2 is treated as an internal dependency rather than the mechansim for selecting which operators to include.
* Add extra check in decode.
* Add two opencv operators as ONNX custom ops.
* update the git apply command line
* adjust the difference threshold
* do not break the build on binskim issue
* Make ImageReader be optional
* try to fix some potential build break
* undo the debug flag in setup.cfg
* integrate opencv
* small fixing
* Add the opencv includes and libs
* refine a little bit
* standardize the output folder.
* fix ctest on Linux
* fix setup.py on output folder change.
* more fixings for CI pipeline
* more fixing 1
* more fixing 2
* more fixing 3
* ci pipeline fixing 1
* ci pipeline fixing 2
* a silly typo...
* ci pipeline fixing 3
* fixing the file copy issue.
* last fixing.
* re-test the fullpath in build_ext.
* One more try
* extent timeout
* mshost.yml indent
* Update mshost.yaml for Azure Pipelines
* cibuild build python versions
* Update wheels.yml
* only build python 3.8/3.9
* Update wheels.yml for Azure Pipelines
* seperate the ci pipeline
Wenbing Li
Scott McKay
cao lei
Rachel Guo
RandySheriffH
JiCheng
Edward Chen
Sayan Shaw
shaahji
Guenther Schmuelling