testfx/docs/releases.md

Releases

2.3.0-preview-20220810-02 (August 2022)

• Fixed issues with SDK style projects.

• Assert failure messages

• Better messages for XXXInitialize and XXXCleanup

• TestResults folder names are now cross platform compatible, as per #678

• Ensure assertions do not fail with FormatException

• Prevent format exceptions when parameters array is empty

• Adding Microsoft SECURITY.MD

• [main] Update dependencies from dotnet/arcade

• Remove unused classes

• Add whitespace editorconfig and run dotnet format whitespace

• Bumped up version to 2.3.0

A list of changes since last release are available here

Builds

• MSTest: 2.3.0-preview-20220810-02
• MSTest.TestFramework: 2.3.0-preview-20220810-02
• MSTest.TestAdapter: 2.3.0-preview-20220810-02

2.2.10 (April 2022)

• Run dotnet format whitespace

• Update dependencies from https://github.com/dotnet/arcade build 20220425.6

• Added more fail paths for data serialization.

• Added MSTest meta-package.

• Test execution bugs in specific TFMs addressed.

• Static init of StackTraceHelper.typesToBeExcluded

• Update description of the Nuget packages

• Converted files to utf-8 so they can be diffed.

A list of changes since last release are available here

Builds

• MSTest: 2.2.10
• MSTest.TestFramework: 2.2.10
• MSTest.TestAdapter: 2.2.10

2.2.10-preview-20220414-01 (April 2022)

• Fix write conflicts in parallel output
• Fixed test run executable files.
• [UITestMethod] should invoke test method with null

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.10-preview-20220414-01
• MSTest.TestAdapter: 2.2.10-preview-20220414-01

2.2.9 (April 2022)

Parallel output

🙇 Shout out to @SimonCropp, for bringing this functionality to XUnit in his https://github.com/SimonCropp/XunitContext project. And being an inspiration for implementing this.

MSTest 2.2.9 captures all Console output and attaches it to the correct test, even if you are running tests in parallel. This output is captured from your test code as well as from the tested code. And it requires no special setup.

Before

In 2.2.8, test output is scattered among tests, in our example, one unlucky test gets all the output of other tests just mixed together:

After

With 2.2.9, each output is correctly attached to the test that produced it:

Also notice that we are also capturing debug, trace and error. And we are not awaiting the FastChild method, and the output is still assigned correctly. Souce code.

Limitations

Due to the way that class and assembly initialize, and cleanup are invoked, their output will end up in the first test that run (or last for cleanup). This is unfortunately not easily fixable.

Builds

• MSTest.TestFramework: 2.2.9
• MSTest.TestAdapter: 2.2.9

A list of changes since last release are available here

2.2.8 (November 2021)

• Dependency version updates.
• Added internal versioning
• Fixed .nuspec files to mitigate NU5050 error.
• Updated to WindowsAppSDK 1.0.0 GA
• Downgrade uwp
• Add DoesNotReturnIf to Assert.IsTrue/Assert.IsFalse
• Implement Class Cleanup Lifecycle selection
• Fix concurrent issues in DataSerializationHelper
• Fix for incorrect Microsoft.TestPlatform.AdapterUtilities.dll for net45 target (#980)
• Updated to WindowsAppSDK 1.0.0-preview1
• CVE-2017-0247 fixed
• Added 500ms overhead to parallel execution tests.
• Cherry-picking the changes from 2.2.7

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.8
• MSTest.TestAdapter: 2.2.8

2.2.7 (September 2021)

• Fixed missing strong-name and Authenticode signatures
• Resolve dependencies from GAC

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.7
• MSTest.TestAdapter: 2.2.7

2.2.6 (August 2021)

• Allow opting-out of ITestDataSource test discovery.
• Enable internal testclass discovery (#937)
• Fix DateTime looses significant digits in DynamicData (#875)

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.6
• MSTest.TestAdapter: 2.2.6

2.2.5 (June 2021)

• Fixes #799 by testing logged messages against "null or whitespace" instead of "null or empty"
• Added missing framework references for WinUI
• Upgraded winui to 0.8.0
• Fixed a bug in ITestDataSource data deserialization
• Fixed DataSource deserialization.
• Fixed a serialization issue with DataRows.
• Replaced license file with an expression.

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.5
• MSTest.TestAdapter: 2.2.5

2.2.4 (May 2021)

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.4
• MSTest.TestAdapter: 2.2.4

2.2.4-preview-20210331-02 (March 2021)

• Fix StackOverflowException in StringAssert.DoesNotMatch
• Added basic WinUI3 support.
• MSBuild scripts fixed.
• Some code clean-up and refactoring

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.4-preview-20210331-02
• MSTest.TestAdapter: 2.2.4-preview-20210331-02

2.2.3 (March 2021)

• Added missing library to the NuGet package.

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.3
• MSTest.TestAdapter: 2.2.3

2.2.2 (March 2021)

• NuGet package dependencies fixed.
• Missing assembly added to TestAdapter package
• Unit test display name issue fixed.
• Fix infinite iteration in Matches method

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.2
• MSTest.TestAdapter: 2.2.2

2.2.1 (March 2021)

• Prepend MSTest to log messages, without formatting
• TestPlatform version updated to v16.9.1
• WIP: Remove .txt extension from LICENSE file
• Merge parameters safely
• Forward logs to EqtTrace on netcore
• Merge settings safely
• ManagedNames impl. refactored.
• Fixed concurrency issues in the TypeCache class.

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.1
• MSTest.TestAdapter: 2.2.1

2.2.0-preview-20210115-03 (January 2021)

• Pdb2Pbp path fix
• Fixing pdb2pdb package
• Fixing nugets
• Updates
• Refactored TypesToLoadAttribute into TestExtensionTypesAttribute
• Fixed TypesToLoadAttribute compatibility
• BugFix: WorkItemAttribute not extracted
• Removed unnecessary whitespace
• Removed MyGet references from README.md

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.0-preview-20210115-03
• MSTest.TestAdapter: 2.2.0-preview-20210115-03

2.2.0-preview-20201126-03 (November 2020)

• Load specific types from adapter
• Added support for ManagedType and ManagedClass
• Add nullable-annotated Assert.IsNotNull
• Replaced deprecated certificate
• Added StringComparison to StringAssert Contains(), EndsWith(), and StartsWith()
• Assert.IsTrue() & False() to handle nullable bools
• Add support to treat class/assembly warnings as errors
• Fix XML doc comments (code -> c)
• Fix null ref bug when base class cleanup fails when there is no derived class cleanup method

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.2.0-preview-20201126-03
• MSTest.TestAdapter: 2.2.0-preview-20201126-03

2.1.2 (June 2020)

• Set IsClassInitializeExecuted=true after base class init to avoid repeated class init calls
• enhance documentation on when the TestCleanup is executed
• Improve CollectionAssert.Are*Equal docs (#711)
• Fixed documentation for the TestMethodAttribute
• Make AssemblyCleanup/ClassCleanup execute even if Initialize fails.
• Change NuGet package to use None ItemGroup to copy files to output directory

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.1.2
• MSTest.TestAdapter: 2.1.2

2.1.1 (March 2020)

• Add FSharp E2E test
• remove unused usings
• fix blog link
• Create Write() in TestContext
• switch arguments for expected and actual in Assert.AreEquals in multiple tests
• Spelling / conventions and grammar fixes

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.1.1
• MSTest.TestAdapter: 2.1.1

2.1.0 (January 2020)

• Fix parameters in tests
• Fix bugs in parent class init/cleanup logic
• Record test start/end events for data driven tests

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.1.0
• MSTest.TestAdapter: 2.1.0

2.1.0-beta2 (December 2019)

• Friendly test names

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.1.0-beta2
• MSTest.TestAdapter: 2.1.0-beta2

2.1.0-beta (November 2019)

• Fix incompatibility between multiple versions of mstest adapter present in a solution
• Build script fix to work with VS2019

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.1.0-beta
• MSTest.TestAdapter: 2.1.0-beta

2.0.0 (September 2019)

• Implemented 'AddResultFile' for NetCore TestContext
• Datarow tests - support methods with optional parameters
• Implemented Initialize Inheritance for ClassInitialize attribute
• Apply TestCategory from derived class on inherited test methods
• Fixed IsNotInstanceOfType failing when objected being asserted on is null
• Setting MapNotRunnableToFailed to true by default

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.0.0
• MSTest.TestAdapter: 2.0.0

2.0.0-beta4 (April 2019)

• Deployment Item support in .NET Core
• Support for CancellationTokenSource in TestContext to help in timeout scenario
• Correcting error message when DynamicData doesn't have any data

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.0.0-beta4
• MSTest.TestAdapter: 2.0.0-beta4

2.0.0-beta2 (February 2019)

• (BREAKING CHANGE) TestContext Properties type fixed to be IDictionary
• Base class data rows should not be executed
• Setting option for marking not runnable tests as failed

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 2.0.0-beta2
• MSTest.TestAdapter: 2.0.0-beta2

1.4.0 (November 2018)

• (BREAKING CHANGE) Description, WorkItem, CssIteration, CssProjectStructure Attributes will not be treated as traits
• Added new runsettings configuration to deploy all files from test source location i.e. DeployTestSourceDependencies [enhancement]
• Removed Test discovery warnings in Test Output pane [Contributed by Carlos Parra]
• Allow test methods returning Task to run without suppling async keyword [Contributed by Paul Spangler]

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.4.0
• MSTest.TestAdapter: 1.4.0

1.4.0-beta (October 2018)

• Enabling Tfs properties in test context object [enhancement]
• Description, WorkItem, CssIteration, CssProjectStructure Attributes should not be treated as traits
• Adding appropriate error message for TestMethods expecting parameters but parameters not provided

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.4.0-beta
• MSTest.TestAdapter: 1.4.0-beta

1.3.2 (June 2018)

• Hierarchical view support for data-driven tests

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.3.2
• MSTest.TestAdapter: 1.3.2

1.3.1 (May 2018)

• AppDomain creation should honor runsettings
• Don't delete resource folder while clean/rebuild

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.3.1
• MSTest.TestAdapter: 1.3.1

1.3.0 (May 2018)

• TestTimeout configurable via RunSettings [enhancement]
• Customize display name for DynamicDataAttribute [Contributed by Brad Stoney] [enhancement]
• Fix incompatibility between multiple versions of mstest adapter present in a solution
• Fix multiple results not returning for custom TestMethod [Contributed by Cédric Bignon]
• Run Class Cleanup in sync with Class Initialize
• Fix to show right error message on assembly load exception during test run
• Consistent behavior of GenericParameterHelper's while running and debugging [Contributed by walterlv]

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.3.0
• MSTest.TestAdapter: 1.3.0

1.3.0-beta2 (January 2018)

• In-Assembly Parallel Feature
• Add missing Microsoft.Internal.TestPlatform.ObjectModel [Contributed by Andrey Kurdyumov]
• Adding warning message for vsmdi file
• Fixing Key collision for test run parameters
• Fix for csv x64 scenario
• DataRow DisplayName Fix in .Net framework
• Update File version for adapter and framework dlls
• Add information about which assembly failed to discover test [Contributed by Andrey Kurdyumov]

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.3.0-beta2
• MSTest.TestAdapter: 1.3.0-beta2

1.2.1 (April 2018)

• Fixing Key collision for test run parameters
• Don't call Class Cleanup if Class Init not called
• Fix masking assembly load failure error message
• Fix UWP tests discovery

Builds

• MSTest.TestFramework: 1.2.1
• MSTest.TestAdapter: 1.2.1

1.2.0 (October 2017)

• DataSourceAttribute Implementation
• Adding support for DiaNavigation in UWP test adapter
• Arguments order for ArgumentException
• Adding filtering support at discovery
• Improve handling of Assert.Inconclusive

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.2.0
• MSTest.TestAdapter: 1.2.0

1.2.0-beta3 (August 2017)

• Added Mapping for TestOutcome.None to the UnitTestOutcome Enum to achieve NotExecuted behaviour in VSTS [Contributed By Irguzhav] [enhancement]
• TestMethod failures masked by TestCleanUp exceptions
• Multiple copies added for same test on running multiple times in IntelliTest
• Adapter is not sending TestCategory traits in Testcase object to Testhost
• All the Assert constructor's has been made private and the classes sealed

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.2.0-beta3
• MSTest.TestAdapter: 1.2.0-beta3

1.2.0-beta (June 2017)

• Support for Dynamic Data Attribute [extensibility]
• Make discovering test methods from base classes defined in another assembly the default [enhancement]
• CollectSourceInformation awareness to query source information [enhancement]

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.2.0-beta
• MSTest.TestAdapter: 1.2.0-beta

1.1.18 (June 2017)

• Ability to provide a reason for Ignored tests [enhancement]
• VB unit test project templates that ship in VS 2017 do not reference MSTest V2 nuget packages [enhancement]
• Assert.IsInstanceOf passes on value null [Contributed By LarsCelie]
• Test methods in a base class defined in a different assembly are not navigable in Test Explorer [Contributed By ajryan]
• Enable MSTest framework based tests targeting .NET Core to be run and debugged from within VSCode
• Web project templates that ship in VS 2017 do not reference MSTest V2 nuget packages

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.1.18
• MSTest.TestAdapter: 1.1.18

1.1.17 (April 2017)

• Console.WriteLine support for .NetCore Projects [enhancement]
• Inheritance support for base classes that resides in different assemblies [enhancement]
• TestContext.Writeline does not output messages
• Logger.LogMessage logs a message mutliple times
• TestContext.CurrentTestOutcome is always InProgress in the TestCleanup method
• An inconclusive in a test initialize fails the test if it has an ExpectedException

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.1.17
• MSTest.TestAdapter: 1.1.17

1.1.14 (March 2017)

• Ability to add custom assertions [enhancement]
• Problems with null in DataRow

A list of changes since last release are available here

Builds

• MSTest.TestFramework: 1.1.14
• MSTest.TestAdapter: 1.1.14

1.1.13 (March 2017)

• Tests with Deployment Item do not run
• Run tests fail intermittently with a disconnected from server exception
• Templates and Wizards vsix should be built with RC3 tooling

This is also the first release from GitHub and with source code building against Dev15 tooling.

Builds

• MSTest.TestFramework: 1.1.13
• MSTest.TestAdapter: 1.1.13

1.1.11 (February 2017)

Initial release.

Builds

• MSTest.TestFramework: 1.1.11
• MSTest.TestAdapter: 1.1.11