Граф коммитов

522 Коммитов

Автор SHA1 Сообщение Дата
Wenbing Li b603c0283a
fixing the universal2 python package for macOS (#448) 2023-05-21 21:40:11 -07:00
Edward Chen 15dfd70338
Add explicit 'set +x' before printing a vso[] command to avoid output getting parsed again with a trailing quote. (#443) 2023-05-18 17:46:36 -07:00
Scott McKay 4d652011a8
Minor cmake updates (#432)
* Update minimum cmake version to 3.25
  * Resolve issue with CMAKE_FIND_FRAMEWORK
  * Change to use pool with VS2022 for win32 wheel build so it has cmake 3.25
* Update ext_ortlib.cmake so it doesn't break when cross-compiling for Android on Windows by defaulting to a build even though it can't be used with Android. Need to address the unit testing gap for Android/iOS separately.
2023-05-17 08:02:42 +10:00
Sayan Shaw 2cedfa9fdf
Update nuget version to beta (#441)
* Update nuget version to beta

* small change

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-15 14:53:49 -07:00
Sayan Shaw 239febe4c3
Update cgmanifest.json and ThirdPartyNotices.txt (#438)
* Update cgmanifest.json and ThirdPartyNotices.txt

* add gsl and dr_libs

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-15 13:11:05 -07:00
Sayan Shaw 56b978233d
Fix OneBranch Official pipeline CodeQL issue (#437)
Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-15 10:34:07 -07:00
JiCheng 598dfcbfc7
overflow (#439) 2023-05-15 10:47:15 +08:00
Scott McKay 64f20828ce
Handle ONNX 1.14 in test scripts (#435)
* Calculate and specify ir_version so we use the oldest possible for maximum compatibility

* Don't use `ignore_unknown` in call to `find_min_ir_version_for` as it's only supported in the most recent ONNX release.
2023-05-12 07:13:37 +10:00
Vishal Jain 03b96c822c
Fix ReadMe : Example usage of the PrePostProcessor.md (#436)
- Small typo fix in "Add post-processing steps"
2023-05-11 18:36:14 +10:00
Sayan Shaw edac207dc3
Add nuget.org publish version option (#426)
* Add nuget.org publish version option

* typo

* small fix

* typo

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-08 13:44:19 -07:00
Wenbing Li 43994eb34a
Fix the unit test failure with ONNX 1.14 package. (#428)
* Fix the unit test failure with ONNX 1.14 package.

* more tests

* Update whisper_e2e.py
2023-05-08 11:37:54 -07:00
JiCheng b7b8816dab
build for mac M1 (#430) 2023-05-07 09:15:55 +08:00
Scott McKay 6eddd2f03f
Fix Android AAR in nuget package. Requires libortextensions.so. (#429) 2023-05-06 17:32:08 +10:00
Wenbing Li 46efcb9051
PyOp attribute supports int and float data type (#425) 2023-05-05 19:35:59 -07:00
Wenbing Li 9cbd2ada18
Revert "Pin onnx version to 1.13.1" (#423)
* Revert "fix onnx version to 1.13.1 (#422)"

This reverts commit eb29d225a7.

* Update requirements.txt
2023-05-05 13:32:42 -07:00
Scott McKay 7b21d9b215
Add new required pre/post processing ops to Android and iOS packages. (#415) 2023-05-05 22:42:54 +10:00
JiCheng 571512aca4
[NuGet] All platform package pipeline (#408)
* nuget ci package
* disable macos arm64 build for err

* Get the iOS xcframework build working with the split build/pack approach. (#416)

* refine build_xcframework.py
Cleanup/clarify various things
- naming of parameters and files
- consistency
Make handling of additional build args more generic
Update the artifact download dir/extract dir to more intuitive names
Update scripts
- make usage from CI pipeline clearer (e.g. don't hide directory names inside script)
- keep comments in nuspec
- remove unused args
- make additional arg handling more
Co-authored-by: Scott McKay <skottmckay@gmail.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
2023-05-05 18:22:54 +08:00
JiCheng eb29d225a7
fix onnx version to 1.13.1 (#422) 2023-05-05 17:32:04 +08:00
Sayan Shaw 288439a35d
Fix Secure Supply Chain Analysis Warning in PR pipeline (#414)
* remove package sources

* remove NuGet.config

* add .sscignore for cfs0011

* change sscignore

* add CFS0013 to sscignore

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-04 16:29:21 -07:00
Wenbing Li 2fa0b710ea
Adding down-sampling and stereo mixing features for AudioDecoder (#420)
* initial draft

* second

* third

* polishing

* fix the M_PI name in LINUX platform

* fix bessel function issue

* add a unit test case

* fix the unit test name
2023-05-04 13:30:10 -07:00
Sayan Shaw ad0fd98221
Fix OneBranch PR pipeline CodeQL issue (#413)
* test codeql 3000

* switch codeql from compiled to python

* switch back to compiled

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-02 13:25:41 -07:00
Sayan Shaw 9170b4ab41
Update macos wheel timeout to 180 min (#390)
* Update ci timeout to 120 min

* Only update WindowsPython job timeout

* Update ci timeout to 90 min

* update macos wheel timeout to 180 min

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-05-01 13:59:01 -07:00
kunal-vaishnavi f12270b068
Make Whisper E2E script more portable (#412)
This PR makes the Whisper E2E script more portable for other environments.
2023-04-28 10:17:56 -07:00
Wenbing Li 0e2d6c03e4
Add an C# demo project for NuGet package (#407)
* Add a nuget test app

* remove unused file

* Compatible with onnxruntime-gpu package (#410)

* be compatible without onnxruntime-gpu version

* some fixing

* turn it as a .net demo project

---------

Co-authored-by: Sayan Shaw <52221015+sayanshaw24@users.noreply.github.com>
2023-04-27 14:29:58 -07:00
Sayan Shaw 79a348d2e8
Add nuget README and remove ort lib references from props (#409)
* Add nuget README and remove ort lib references from props

* replace commit id in nuspec dynamically

* remove $ sign for commit id token

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
Co-authored-by: Wenbing Li <10278425+wenbingl@users.noreply.github.com>
2023-04-27 09:42:03 -07:00
Wenbing Li 0f45fef2d9
Compatible with onnxruntime-gpu package (#410)
* be compatible without onnxruntime-gpu version

* some fixing
2023-04-26 17:17:23 -07:00
Sayan Shaw 4f481d23ac
Add initial NuGet pipeline for Windows x64 build (#406)
* initial nuget pipeline

* Update nuget.yml for Azure Pipelines

* update nuget.yml for extensions specific packaging

TODO: add certain template yml files

* added component governance template yaml

* change template yaml path

* remove RoslynAnalyzers

* Add packDestination to nuget pack task (change from default)

* fix nuspec path

* Update nuget.yml for Azure Pipelines

* Update nuget.yml for Azure Pipelines

* Update nuget.yml for Azure Pipelines

* Update 2 nuget.yml for Azure Pipelines

* Update NativeNuget.nuspec

* Update nuget.yml for Azure Pipelines

* update nuspec

* Update 3 nuget.yml for Azure Pipelines

* Update 4 nuget.yml for Azure Pipelines

* Update 7 nuget.yml for Azure Pipelines

* Remove unnecessary nupkg file and update nuspec (#405)

* Add nuget pack to build.bat and small nuget changes for demo

* Temporarily adding nuget.exe to build package until we can add to CI machine

* Switch back from Release to RelWithDebInfo

* Remove unnecessary changes

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>

* Update 8 nuget.yml for Azure Pipelines

* Update 9 nuget.yml for Azure Pipelines

* add DLL signing

* Update nuget.yml for Azure Pipelines

* fix indendation

* Update 11 nuget.yml for Azure Pipelines

* Update 12 nuget.yml for Azure Pipelines

* Update 12 nuget.yml for Azure Pipelines

* Revert some unneccesary changes on nuget.yml

* clean up nuget.yml and update nuspec release notes

* small changes

* update commit id and release notes

---------

Co-authored-by: Wenbing Li <wenbingl@outlook.com>
Co-authored-by: Wenbing Li <10278425+wenbingl@users.noreply.github.com>
Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-04-25 17:13:13 -07:00
Sayan Shaw 94142d8391
Remove unnecessary nupkg file and update nuspec (#405)
* Add nuget pack to build.bat and small nuget changes for demo

* Temporarily adding nuget.exe to build package until we can add to CI machine

* Switch back from Release to RelWithDebInfo

* Remove unnecessary changes

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-04-22 00:22:43 -07:00
Sayan Shaw a9198c3015
Added windows nuget work temporarily for testing (#402)
* Added windows nuget work temporarily for testing

* Cleanup

* Add back onnxruntime.lib in props file for possible future ORT need

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
Co-authored-by: Wenbing Li <10278425+wenbingl@users.noreply.github.com>
2023-04-21 10:56:30 -07:00
Wenbing Li 997fa892c2
more code fixing related whisper models (#403) 2023-04-21 09:26:44 -07:00
Wenbing Li 26dda4eb74
some fixing for python package (#401) 2023-04-20 15:57:06 -07:00
JiCheng db87dc416d
[object detection ppp] YoLo as example (#397)
* object detection
* Unit test
add e2e fastestdet model test

---------

Co-authored-by: Changming Sun <chasun@microsoft.com>
Co-authored-by: Scott McKay <skottmckay@gmail.com>
2023-04-20 13:34:11 +08:00
Wenbing Li adb8efd62b
support batch > 1 in BpeDecoder (#400)
* support batch > 1 in BpeDecoder

* update the shape in helper function
2023-04-19 14:28:56 -07:00
Wenbing Li 711774db6b
Add a merge step in whisper end-to-end script and fixed some issues (#399)
* add merged models in whisper model

* verify the final model
2023-04-17 16:37:06 -07:00
Changming Sun 77e63c8845
Update wheels_linux.yml: change the linux machine pool name (#398) 2023-04-13 21:01:27 -07:00
Wenbing Li 599525f053
a quick nuget package impl. (#396) 2023-04-12 13:31:15 -07:00
JiCheng 154ead35a3
built-in bounding box op (#382)
* built-in bounding box op
* update boundary check
* assert policy
* more boundary test and check
* XYXY--> X horizon
---------

Co-authored-by: Scott McKay <skottmckay@gmail.com>
2023-04-12 19:35:53 +08:00
Wenbing Li 2202e3e19b
make tensorflow be optional for unittest (#394)
* make tensorflow be optional for unitest.

* typo
2023-04-11 19:52:55 -07:00
Wenbing Li b5dce955f0
Add an audio decoder custom op for whisper end-to-end processing (#385)
* evaluate the audio decoder library

* MP3 Decoder

* rename it to test_audio_codec

* add the audio decoder to whisper model

* whisper end-to-end draft

* fix the mp3 decoder

* Running with ONNX models

* Add more audio format supports

* refine the end-to-end script

* Update operators/audio/audio_decoder.hpp

Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>

* Update operators/audio/audio_decoder.hpp

Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>

* Update operators/audio/audio_decoder.hpp

Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>

* some fixings of comments and more test cases.

* changes for review comments.

* Update audio_decoder.hpp

* Update audio_decoder.hpp

* code refinement

* Update operators/audio/audio_decoder.hpp

Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>

---------

Co-authored-by: Sayan Shaw <52221015+sayanshaw24@users.noreply.github.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
2023-04-11 14:47:10 -07:00
Edward Chen c0260ec704
Use dependency name 'nlohmann_json' which is the same name that ORT uses. (#393) 2023-04-10 16:49:47 -07:00
Wenbing Li 9cd2221965
ignore the unknown token id on bpe deocder (#391) 2023-04-07 15:24:25 -07:00
Sayan Shaw 460bd34183
Added optional outputs for GPT2, CLIP and Roberta Tokenizers (#389)
* Initial optional i/o for robertap

* Small fix

* Added working optional output functionality to RobertaTokenizer with tests

* Added optional outputs to CLIPTokenizer

* Added optional outputs to GPT2Tokenizer

* Use ternary operators

---------

Authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-04-06 13:28:59 -07:00
Wenbing Li 9cd1284da8
Pre and Post processing example for openAI Whisper model (#380)
* add a stft-norm custom op for log-mel spectrum.

* undo the debug change

* Support ONNX standard STFT op signature.

* Add a unit test onnx STFT compatible mode.

* add whisper pre-/post- processing example

* Update dlib.cmake

* undo test code changes

* Update setup.cfg

* update the end2end example with STFT op
2023-03-30 13:44:50 -07:00
Sayan Shaw bbd645de1b
Fix size_t overflow issue for RobertaTokenizer (#388)
Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-03-27 21:07:45 -07:00
Wenbing Li 9c93fade6f
add the onnxruntime 1.14 release into the CI pipeline (#387)
* add the onnxruntime 1.14 release into the CI pipeline

* torch 2.0 crashed on Linux
2023-03-27 16:52:08 -07:00
Sayan Shaw 8b2af20b46
Update CLIPTokenizer cvt for added offset mapping output (#384)
Authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-03-23 23:52:58 -07:00
Sayan Shaw 07d060dbc0
Improve offset map algorithm for RobertaTokenizer (#383)
Authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-03-23 15:51:14 -07:00
Sayan Shaw 20e6c167d4
Fixed and optimized offset mapping algorithm for CLIPTokenizer (#377)
Authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-03-21 09:51:01 -07:00
Edward Chen a4b8dec288
Gradle wrapper security updates (#381)
* Add gradle-wrapper.jar checksum validation workflow.

* Add gradle wrapper distribution checksum values.
2023-03-16 11:06:00 -07:00
Sayan Shaw b3420f9ca3
Added CLIPTokenizer to _cuops.py and corresponding cvt func and test (#379)
Authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2023-03-15 15:45:59 -07:00