* Add performance tests
* Add extra tests
* Fix
* Fix typo
* Fix Divide_Int16 and Divide_Int32_Int16 benchmarks
* Fix
* Change csproj file
* Update BenchmarkDotNetVersion to 0.13.5
* Fix
* Change to 0.13.1 because that is what is latest version in our nuget feeds.
---------
Co-authored-by: Jake Radzikowski <JakeRad@Microsoft.com>
* Initial commit for Arcade migration
* Added omitted files
* Changed strong name signing to use the same key for shipping and test assemblies
* arcade linux build (#5423)
* arcade linux build
* put file execution permission change into source control
* The `-test` command for windows. Nuget packages (#5464)
* working on testing
* testing updates
* tests almost working
* build changes
* all tests should be working
* changes from PR comments
* fixes for .net 3.1
* Fixed extension check. Removed <PackageId> where not needed
* Removed pkg folder and updated paths.
* Added test key. (#5475)
* Added test key.
* Update PublicKey.cs
Removed extra newline.
* Update ComponentCatalog.cs
Fixed 3 spaces to 4.
* Windows CI working (#5477)
* ci testing changes
* comments from pr
* Added Linux & Mac changes for Arcade (#5479)
* Initial Windows, Linux, Macos builds test
* Add Linux/MacOS specific CI requirements
* Run Arcade CI tests on MacOS/Linux
* Fix final package building
* Add benchmark download to benchmars .csporj file
* Print detailed status of each unit test
* Install CentOS & Ubuntu build dependencies
* Use container names to differenciate between Ubuntu & CentOS
* Remove sudo usage in CentOS
* Fix Linux build dependencies
* Add -y param to apt install
* Remove installation of Linux dependencies
* Minor additions
* Rename Benchmarks to PerformanceTests for Arcade
* Changes
* Added benchmark doc changes
* Pre-merge changes
* Fixing failing Arcade Windows Builds (#5482)
* Try Windows build single quote fix
* Remove %20
* Added variable space value
* Using variables for spacing
* Added space values as job parameters
* Try conditional variables again
* fix official builds
* Revert "fix official builds"
This reverts commit 7dbbdc7b94.
* fixing tensorflow rebase issue
* Fixes for many of the CI builds. (#5496)
* yml log changes
* Fix NetFX builds by ensuring assembly version is set correctly and not to Arcade default of 42.42.42.42 (#5503)
* Fixed official builds for Arcade SDK (#5512)
* Added fixes for official builds
* Make .sh files executable
* fix mkl nuget issue
Co-authored-by: Frank Dong <frdong@microsoft.com>
* fix code generator tests failure (#5520)
* Added fixes for official builds
* Make .sh files executable
* fix mkl nuget issue
* fix code generate test fails
* only add necessary dependency
Co-authored-by: Mustafa Bal <5262061+mstfbl@users.noreply.github.com>
* Fixed memory leaks from OnnxTransformer (#5518)
* Fixed memory leak from OnnxTransformer and related x86 build fixes
* Reverting x86 build related fixes to focus only on the memory leaks
* Updated docs
* Reverted OnnxRuntimeOutputCatcher to private class
* Addressed code review comments
* Refactored OnnxTransform back to using MapperBase based on code review comments
* Handle integration tests and nightly build testing (#5509)
* Make -integrationTests work
* Update .yml file
* Added the TargetArchitecture properties
* Try out -integrationTest
* Missed -integrationTest flag
* Renamed FunctionalTestBaseClass to IntegrationTestBaseClass
* Missed rename
* Modified tests to make them more stable
* Fixed leak in object pool (#5521)
Co-authored-by: frank-dong-ms <55860649+frank-dong-ms@users.noreply.github.com>
Co-authored-by: Michael Sharp <51342856+michaelgsharp@users.noreply.github.com>
Co-authored-by: Mustafa Bal <5262061+mstfbl@users.noreply.github.com>
Co-authored-by: Frank Dong <frdong@microsoft.com>
Co-authored-by: Michael Sharp <misharp@microsoft.com>
Co-authored-by: Antonio Velázquez <38739674+antoniovs1029@users.noreply.github.com>
* set max thread to unlimited, see if deadlock cause test host process hanging
* skip TensorFlowImageClassification test as this test is hanging the test host process
* make auto ml test inherient from base test class to identify which test hangs test host process
* undo automl test change, enable diagnostic log
* add new line at end
* undo unnecessary change
* remove flaky test from CI
* refine text
* remove timeout setting
* also remove benchmarktest from inner loop
* fix skip theory
* fix define constants
* skip benchmark properly
* skip tests in compile time
* skip one more tensorflow test from CI
* support running benchmarks on netfx
* adding license and correcting path for the output models generated during benchmarks
* changing target framework from net462 to net461
* addressing adam feedback
* correcting path for Test_Multiclass_WikiDetox_BigramsAndTrichar_OVAAveragedPerceptron
* Added Dry job for benchmarks ci
* Increasing Timeout and not copying large datasets to output directory
* disabling failing benchmark tests
* using GetDataPath function and simplyfying code
* Name changed to datapathprovider, make variables private, make xunit variable public
* making can execute static
* Removed Datasets from output and dead import
* Dynamically finding the root of the repo
* using Assembly.load, making getrepo root private, removing touching dependencyTest
* using typeof.assembly, adding summary comment to attribute and adding using statement for TestFramework
* testing installation of tools
* passing all arguments
* fixing syntax
* fixing syntax
* making sure tensorflow tests don't run in x86 pr validation ci leg
* fixing test by adding new regular expression in normalizer
* temporarily skipping benchmark test not working on x86 and fixed packaging issue with tensorflow
* skipping on debug
* Refactor CpuMathUtils
- Allow it to take Spans instead of arrays.
- Remove redundant overloads
- When multiple spans are accepted, always use an explicit count parameter instead of one being chosen as having the right length.
Working towards #608
* Use MemoryMarshal.GetReference to avoid perf hit when pinning Span.
* PR feedback
* move Harness-related code to Harness folder
* make sure that we always use recommended config
* mention the external dependencies in the README
* add nuget.config file so BDN can restore all packages
* add comments to the config so I am not the only person who understands it
* don't enable MemoryDiagnoser by default, it requires one extra iteration which is expensive for long running benchmarks
* don't add nuget.config file, generate it on the fly when needed by BDN
* generate a .csproj file that will handle both native dependencies and nuget.config file issue
* describe authoring new benchmarks in the docs
* add some integration tests that make sure that the benchmarks are not broken
* register the right assemblies after recent change of assembly loading, makes all benchmark work again ;)
* make Ranking benchmarks work
* code review: split Helpers.cs into multiple files, cleanup the code, don't hardcode the dependencies
Aleksei Smirnov
Michael Sharp
Harish Kulkarni
frank-dong-ms
Mustafa Bal
Sam Harwell
Ivan Matantsev
Marek Linka
Anirudh Agnihotry
Zeeshan Siddiqui
Artidoro Pagnoni
Eric Erhardt
Adam Sitnik