Граф коммитов

2931 Коммитов

Автор SHA1 Сообщение Дата
Xiaoyun Zhang 4c5aa85452
fix refit (#6572) 2023-02-22 12:24:57 -08:00
Xiaoyun Zhang fe2a4428c1
fix cancellation bug in SweepablePipelineRunner && fix object null exception in AutoML v1.0 regression API (#6560)
* update

* update

* blocking run task

* revert tests

* add more logging

* fix #6558

* update

* fix tests

* fix build

* fix tests

* fix build error

* add logger

* increase time

* fix tests
2023-02-15 21:33:11 -08:00
Andras Fuchs d239fda5c2
Add continuous resource monitoring to AutoML.IMonitor (#6520)
* Fix a typo

* Fix trial cancellation bug

* Move performance related properties to TrialPerformanceMetrics and add ReportTrialResourceUsage event to IMonitor

* Add new class and property explanations

* Revert "Fix trial cancellation bug"

This reverts commit 269b1bdd93.

* Remove pipeline info from the IMonitor Running event

* Remove FreeSpaceOnDrives from TrialPerformanceMetrics

* Change the default resource check interval to 5 seconds

* Remove StartedAtUtc property from TrialSettings

* move ReportTrialResourceUsage to IPerformanceMonitor

* Update AutoMLExperimentExtension.cs

* Pause the performance monitor if the trial is not running

* Add StartedAtUtc and EndedAtUtc to TrialSettings

* cancel trial when as is

* fix tests

* fix tests

* fix tests

* use workingset to evaluate memory usage

* remove handler

* add handler back

* add more logging

* add more logger

* add logging

* fix tests

---------

Co-authored-by: XiaoYun Zhang <xiaoyuz@microsoft.com>
Co-authored-by: Xiaoyun Zhang <bigmiao.zhang@gmail.com>
2023-02-09 11:38:50 -08:00
dotnet-maestro[bot] 8c0ceaf6ce
[main] Update dependencies from dotnet/arcade (#6518)
Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
2023-02-06 13:25:42 -08:00
Michael Sharp 9b22facd72
fixes doc typo (#6557)
Fixes https://github.com/dotnet/machinelearning/issues/6311
2023-02-06 12:28:36 -08:00
Michael Sharp f848603d74
mac python fix (#6549) 2023-01-24 13:29:56 -08:00
Michael Sharp 9181467d67
fixes one dal dispatching issues (#6547) 2023-01-24 11:52:55 -08:00
Xiaoyun Zhang a06dadcc35
add checkAlive in NasBertTrainer (#6546) 2023-01-23 12:47:47 -08:00
R. G. Esteves eeba2eeb45
Bail to default implementation upon any unforeseen situation (#6538) 2023-01-12 20:37:51 -08:00
Michael Sharp e451fb72c0
fixing bug with multi-threaded access for variable length string arrays for onnx models. (#6537) 2023-01-12 15:38:32 -08:00
Becca McHenry 6708456a26
Add VBufferDataFrameCoumn to DataFrame (#6409)
* vbuffer file

* updates to vbuffer file

* vector

* edit to single list

* update to list

* fix tests

* cleanup PR

* fix all the tests

* change vbuffertest

* update string

* revert csproj string issue

* update string namespace

* update summary tag
2023-01-09 17:16:24 -06:00
Xiaoyun Zhang c55038fd63
add addKeyValueAnnotationsAsText flag (#6535) 2023-01-06 14:24:21 -08:00
Xiaoyun Zhang bc250df896
fix #6446 (#6447)
fix https://github.com/dotnet/machinelearning/issues/6446
2023-01-05 12:47:35 -08:00
Michael Sharp 9d798f1bb3
moving onedal nuget download from onedal to native where its needed for building. (#6527) 2022-12-21 20:50:30 -08:00
R. G. Esteves 0880a9086e
Onedal algorithms backed by nuget packages (#6521)
Co-authored-by: Alexander Andreev <alexander.andreev@intel.com>
Co-authored-by: Michael Sharp <misharp@microsoft.com>
2022-12-21 12:54:13 -08:00
dotnet-maestro[bot] ff21cc5096
[main] Update dependencies from dotnet/arcade (#6451)
* Update dependencies from https://github.com/dotnet/arcade build 20221111.2

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22558.4 -> To Version 7.0.0-beta.22561.2

* Update dependencies from https://github.com/dotnet/arcade build 20221122.6

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22558.4 -> To Version 7.0.0-beta.22572.6

Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
2022-11-30 15:52:06 -08:00
Xiaoyun Zhang b1cb564289
add SentenceSimilarity sweepable estimator in AutoML (#6445) 2022-11-30 14:59:17 -08:00
Luis Quintanilla 42788c4351
2023 roadmap outline (#6444) 2022-11-28 12:14:29 -08:00
Xiaoyun Zhang 394821137d
set trial to unsuccess if trial loss is nan/inf (#6430) 2022-11-28 11:21:09 -08:00
Michael Sharp d523bd2124
new os image for official builds. (#6467)
Merging since it has already been validated with official build and it only touches official build.
2022-11-23 14:01:00 -08:00
Michael Sharp bb563da7c6
Add in ability to have pre-defined weights for ngrams. (#6458)
Merging on red since it was approved but approver doesn't have write access.
2022-11-22 22:11:46 -08:00
KKghub 0379e01ea0
Fixed typo for calibrators (#6438)
Fixes https://github.com/dotnet/machinelearning/issues/6210
2022-11-17 12:19:39 -08:00
dotnet-maestro[bot] 87337c0ef1
[main] Update dependencies from dotnet/arcade (#6439)
* Update dependencies from https://github.com/dotnet/arcade build 20221031.4

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22514.3 -> To Version 7.0.0-beta.22531.4

* Update dependencies from https://github.com/dotnet/arcade build 20221108.4

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22514.3 -> To Version 7.0.0-beta.22558.4

* Tell the compiler that VBuffer is scoped to Create call

This prevents errors CS9077 and CS8347 which are raised where the
compiler cannot determine if the reference parameter destination is
leaked.

Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
Co-authored-by: Eric StJohn <ericstj@microsoft.com>
2022-11-11 07:22:39 -08:00
Jake 17c061acd1
Update TorchSharp to 0.98.3 (#6436) 2022-11-07 14:19:39 -08:00
Luis Quintanilla 8481c2a00e
ML.NET 2.0 Release Notes (#6435)
* Initial commit

* Reworded ONNX

* minor nit

* Update with wikipedia article

* Update docs/release-notes/2.0/release-2.0.0.md

Thanks @justinormont

Co-authored-by: Justin Ormont <justinormont@users.noreply.github.com>

Co-authored-by: Justin Ormont <justinormont@users.noreply.github.com>
2022-11-07 07:32:07 -08:00
Eric StJohn 025e373bc0
Update version to 3.0.0 (#6424) 2022-11-04 09:05:45 -07:00
Eric StJohn 1a83389bbd
Updates to official build pipeline (#6423)
* Fix TSA parameters to be unique to ML.NET

* Add _BuildConfig variable used by arcade templates

* Update feed link for nightly builds
2022-11-02 08:53:21 -07:00
Eric StJohn 23bfaba133
Add SECURITY.md (#6420) 2022-11-01 12:30:06 -07:00
Michael Sharp 53ff2cff22
ts version update (#6419) 2022-11-01 07:08:25 -07:00
Xiaoyun Zhang 61b1fa5cf2
adding Microsoft.ML.TorchSharp in csharp using statement for text classifciation (#6408) 2022-10-31 13:28:04 -07:00
Eric StJohn 474f507612
Don't publish artifacts of package job (#6418) 2022-10-28 17:44:53 -07:00
Eric StJohn 3318eb20de
Fix dependencies that are flagging CG (#6415) 2022-10-28 14:38:32 -07:00
Eric StJohn 0b175c342d
Fix Mac CMake warnings (#6414)
* Generate symbols on release and fix warnings on Mac

* Fix more warnings on Mac and Arm

Co-authored-by: Eric StJohn <ericstj@MacBook-Pro.localdomain>
2022-10-28 12:29:41 -07:00
Eric StJohn de79b8a1b7
Refactor official build to use arcade templates (#6412) 2022-10-27 14:06:55 -07:00
Xiaoyun Zhang e15ff5f984
Add MaxModelToExplore exit strategy to AutoMLExperiment. (#6402) 2022-10-25 12:53:30 -07:00
Xiaoyun Zhang 73beb2849f
use seed from AutoMLExperiment.setting in eci_cfo tuner (#6406) 2022-10-25 09:28:30 -07:00
Tarek Mahmoud Sayed c69acbeb97
Embed the Tokenizer data files inside the assembly (#6403) 2022-10-24 10:30:48 -07:00
Eric StJohn 1903fa5eda
Use APICompat from the SDK (#6399)
* Use APICompat from the SDK

* Refine the condition for API Compat

* Fix SLN

* Move PackageValidationBaselineVersion property

Also make sure we run API Compat even on non-stable packages.
They just won't have baseline validation.

* Suppress APICompat error caused by removal of empty assembly
2022-10-21 14:36:37 -07:00
Michael Sharp 61376a4636
Sentence Similarity (#6390) 2022-10-21 13:24:24 -07:00
Xiaoyun Zhang 66b362addc
register formatter for parameter type (#6397) 2022-10-21 12:16:22 -07:00
Michael Sharp b2d880a943
Official build mac ci fix (#6398) 2022-10-20 16:16:54 -07:00
Xiaoyun Zhang 5723adb2be
use IMLContextManager to create child mlcontext from main context in AutoMLExperiment (#6395)
* create DefaultContextManager

* fix build error
2022-10-20 14:04:45 -07:00
Tarek Mahmoud Sayed 018293c457
Remove the System.Drawing dependency (#6363) 2022-10-20 12:51:31 -07:00
Eric StJohn da53e5531d
Fix CMake warning on Linux (#6391)
Cmake emits a warning because MKL_LIB_RPATH is specified but not used.

Fix this by consuming the property in the project that makes the
decision to use it or not.
2022-10-20 08:38:30 -07:00
Eric StJohn 60db8e82ef
Replace WebClient usage with HttpClient (#6388)
* Replace WebClient usage with HttpClient

* Fix test

* Attempt to fix sync over async
2022-10-18 21:02:01 -07:00
Eric StJohn 9ba2cd7edb
Fix warnings and enable warningsAsError (#6385)
* Fix warnings and enable warningsAsError

* Fix usage of <inheritdoc/>
2022-10-18 08:44:59 -07:00
Eric StJohn c8b3ca4720
Attempt to retarget tests to .NET 6.0 (#6367)
* Attempt to retarget tests to .NET 6.0

* Fix places where tests had hardcoded framework versions

* Update build naming

Ideally we should just remove the knowledge of TargetFramework from the
build, but that can happen in a follow up change.

* Update test data for rounding differences on net6.0

* Fix condition on CPUMathNative reference in tests

It should only be included when TargetFramework is not compatible with
netcoreapp3.1.

* Ensure we generate runtimeconfig.dev.json

We need this file to tell the runtime where the NuGet package cache is.
It uses that location when we disable copying of NuGet dependencies.

* Rename test baseline output directory.

Also fix a couple places where ifdefs were hardcoded to the version of .NETCore.
2022-10-18 08:29:37 -07:00
dotnet-maestro[bot] 7f737e6f8e
[main] Update dependencies from dotnet/arcade (#6382)
* Update dependencies from https://github.com/dotnet/arcade build 20221013.4

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22507.2 -> To Version 7.0.0-beta.22513.4

* Update dependencies from https://github.com/dotnet/arcade build 20221014.3

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22507.2 -> To Version 7.0.0-beta.22514.3

Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
2022-10-17 13:11:20 -07:00
Xiaoyun Zhang febcb920e0
update interactive package versino (#6378) 2022-10-14 14:32:13 -07:00
dotnet-maestro[bot] c5f03e2c42
[main] Update dependencies from dotnet/arcade (#6354)
* Update dependencies from https://github.com/dotnet/arcade build 20220923.4

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22327.2 -> To Version 7.0.0-beta.22473.4

* Update XUnit version

* Workaround CS0121 with Xunit.Assert(float,float,int)

Workaround issue https://github.com/xunit/xunit/issues/2393

* Fix a couple more CS0121 XUnit issues

* Fix more xunit issues

* Workaround anoter ref parameter issue.

* Fix more XUnit warnings

* Update XUnitRunnerVersion to 2.4.2

* Update one more Xunit reference

* Update dependencies from https://github.com/dotnet/arcade build 20221007.2

Microsoft.DotNet.Arcade.Sdk , Microsoft.DotNet.Build.Tasks.Feed , Microsoft.DotNet.Helix.Sdk , Microsoft.DotNet.SignTool , Microsoft.DotNet.SwaggerGenerator.MSBuild , Microsoft.DotNet.XUnitExtensions
 From Version 7.0.0-beta.22327.2 -> To Version 7.0.0-beta.22507.2

* Update to RC2 SDK to get FSharp fix

* Extend timeout for code-coverage builds

Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
Co-authored-by: Eric StJohn <ericstj@microsoft.com>
2022-10-13 14:06:01 -07:00