* fix#6949
* add MoveForwardToAttribute to assembly.cs and fix search space sub namespace
---------
Co-authored-by: XiaoYun Zhang <xiaoyuz@microsoft.com>
* Split out non concurrent test collections.
* Fix Core Tests
* removed torchsharp and tensorflow tests when not x64
* fixes from pr comments
* removing unnecessary line from the proj file
* Update dependencies from https://github.com/dotnet/arcade build 20231220.2
Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
From Version 8.0.0-beta.23265.1 -> To Version 8.0.0-beta.23620.2
* Fixed version update breaks.
* Update XUnitVersion
* Update MicrosoftMLOnnxRuntimeVersion to 1.16.3
* Rollback OnnxRuntime and suppress warning
* Update to Xunit with fix for https://github.com/xunit/xunit/issues/2821
* Update Centos docker containers
* Fix packaging step
* Try including stdint.h to fix missing uint8_t on centos
* Update Centos test queue
* Attempt to use runtime centos-stream8-helix container for tests
* Use centos-stream8-mlnet-helix container for testing
* Undo changes to test data
* Make NETFRAMEWORK ifdef versionless
* Only use semi-colons for NoWarn
* Fix assert by only accessing idx (#6924)
Asserting on `_rowCount < Utils.Size(_valueBoundaries)` was catching a
case where `_rowCount`'s update was reordered before `_valueBoundaries`
This was unnecessary, since this method doesn't need to use `_rowCount`.
Instead, make the asserts use only `idx` which will be maintained
consistent with the waiter logic in this cache.
Ensure we only ever use `_rowCount` from the caching thread, so write
reordering won't matter.
* Don't include the SDK in our helix payload (#6918)
* Don't include the SDK in our helix payload
I noticed that the tests included the latest SDK - including the host -
in our helix payloads.
This is a large amount of unnecessary downloads and it also makes it so
we use the latest host on the older frameworks which can fail when the
latest host drops support for distros.
Since our tests shouldn't need the full CLI, remove this from our helix
payloads.
We'll instead get just the runtime we need through `AdditionalDotNetPackage`
* Place Helix downloaded runtime on the PATH
Helix only sets the path when the CLI is included, however we don't
need the CLI.
* Make double assertions compare with tolerance instead of precision (#6923)
Precision might cause small differences to round to a different number.
Instead compare with a tolerance which is not sensitive to rounding.
---------
Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
Co-authored-by: Michael Sharp <misharp@microsoft.com>
Co-authored-by: Eric StJohn <ericstj@microsoft.com>
* ner options fix
* Ner fixed.
* Update src/Microsoft.ML.Tokenizers/Model/EnglishRoberta.cs
Co-authored-by: Eric StJohn <ericstj@microsoft.com>
* fixes from PR comments
* fixed build
---------
Co-authored-by: Michael Sharp <misharp@microsoft.com>
Co-authored-by: Michael Sharp <51342856+michaelgsharp@users.noreply.github.com>
Co-authored-by: Eric StJohn <ericstj@microsoft.com>
* added in win-arm64
* fixed MKL arm64 cmake issue
* right helix queue
* added in win-arm64
* fixed MKL arm64 cmake issue
* right helix queue
* fixing arm tests
* makes x64 test detection better
* change test label
* fixed onnx files not being included
* added new win-arm baselines
* baseline changes
* fixed build issue
* fixed test
* one more basleine
* fixed pack for mkl redist
* .NET update
* updated lightGBM version
* finished LightGBM baseline update
* removed accidental enums
* Fixed LightGBM Test
* fixed lightgbm
* fixed version
* fixed test with LightGBM
* fixed test result
* using tensor primitives
* added missing files
* some with indexes changed
* Initial swap for TensorPrimitives done
* Rebased and cleaned code
* more minor cleanup
* added system.numerics.tensors version to props
* build fixes
* added net6 again
* updates from PR comments
* fixed sumabsu
* fixed baseline tests
* test fixes
* fixed test failure for kmeans
* changed decimal comparison
* updated more baselines
* Test fixes.
* template update
* Test Fixes.
* fixed performance test csproj
* added baselines for linux arm/64
* fixed linux arm baselines
* fixed arm baselines
* removed extra files
* arm32 baselines updated
* fixed arm baselines
* Fixes incorrect work of DataFrame with VBufferColumn when number of elements is greater than Int.MaxValue
* Fix calculation of max capacity and amount of required buffers
* Fix unit test
* Run test allocating more than 2 Gb of memory on 64bit env only
* Fix StringDataFrameColumn same way as VBufferDataFrameColumn
* Fix wrong amount of buffers created in constructor of StringDataFrameColumn
* Fix code review findings
* Split Test for AppendMany into 4 different tests
* Block init of null validity buffer instead of setting individual bits
* Add unit tests for PrimitiveDataFrameColumn.Clone
* Fixes#6821
* Fix
* Fix bug with AppendMany values to not empty column
* Restart unit tests
* Add more unit tests
* Fix failing unit test
* Fix code review findings
* Initial structure and started fleshing out some sections
* Some corrections and paragraph on DL usages
* Starting fleshing out DL on ML.NET section
* Addresses #6533
* Add performance tests
* Add extra tests
* Fix
* Fix typo
* Fix Divide_Int16 and Divide_Int32_Int16 benchmarks
* Fix
* Change csproj file
* Update BenchmarkDotNetVersion to 0.13.5
* Fix
* Change to 0.13.1 because that is what is latest version in our nuget feeds.
---------
Co-authored-by: Jake Radzikowski <JakeRad@Microsoft.com>
* Fix wrong type conversion on PrimitiveDataFrameColumn
* Added tests for #6829
* Fix test
* Add file generated from tt template and fix unit tests
---------
Co-authored-by: Aleksei Smirnov <tlalok@inbox.ru>
* Fix inconsistent null handling in DataFrame Arithmetics
* Fix Null Count and division by zero issues
* Minor changes to restart build and rerun flaky tests