6228e49554
[tests] Link NUnit/XUnit watchOS extensions.
...
Makes them much smaller.
2019-05-22 08:13:31 +02:00
2782ad3482
[tests] Fix reporting back to xharness for watchOS NUnit/XUnit tests.
...
* Choose the first hostname for the HttpTextWriter if there are multiple hosts.
* Open the HttpTextWriter before writing to it.
* Don't overwrite the http writer with another writer immediately after creating it.
* Close the HttpTextWriter when done writing.
* Wait for the HttpTextWriter to complete the final http request before exiting.
2019-05-22 08:13:25 +02:00
4e9b69e870
[xharness] Add ARM64_32 support.
2019-05-22 08:06:44 +02:00
6c3674658a
Download the Mono SDK archive for macOS as well. ( #5953 )
...
* Download the Mono SDK archive for macOS as well.
* [tests] Don't forget the tests.
2019-04-26 16:44:29 +02:00
8ed5e3926a
bcl-test-importer: Add three more unit test assemblies
2019-04-17 14:58:49 +02:00
dbbc954447
Reenable tests that were fixed
2019-04-17 11:30:41 +02:00
1cdf2ac3a8
Revert "[XHarness] Update ignore for some failing tests. ( #5887 )"
...
This reverts commit a3ad78c937
2019-04-11 20:31:48 +02:00
db86c8cc88
Merge remote-tracking branch 'upstream/master' into mono-2019-02
2019-04-11 20:28:57 +02:00
a3ad78c937
[XHarness] Update ignore for some failing tests. ( #5887 )
...
The mono bump added some new tests that fail on device + release
configurations. This is a known issue by mono and they'll fix it in the
next version but will not be backported to 2018-10.
2019-04-11 17:20:55 +02:00
1664cf6426
Merge branch 'master' into mono-2019-02
2019-04-05 15:53:37 -05:00
2326e87bd5
[XHarness] Ignore tests that fail on device. ( #5858 )
2019-04-05 15:42:01 -05:00
dd11ba5d6c
[XHarness] Fix issues building the today extensions for the BCL tests apps. ( #5854 )
2019-04-05 14:07:39 +02:00
067cbf0a28
Merge remote-tracking branch 'upstream/master' into mono-2019-02
...
# Conflicts:
# tools/mmp/driver.cs
2019-04-05 11:19:11 +02:00
3a0dfe42a7
[XHarness] Ignore a failing test on devices. ( #5848 )
2019-04-04 18:34:22 +02:00
56bb4f9505
Reenable more BCLTests
2019-03-28 11:16:47 +01:00
b1b557a1b9
Reenable a few BCLTests
2019-03-27 13:33:23 +01:00
45f3e649b9
Ignore tests for devices ( #5807 )
...
* [XHarness] Ignore some tests that fail on device.
Added the ignore, which can be later removed on the new mono 2019-02
since the issues do not happen there.
Fixes: https://github.com/xamarin/maccore/issues/1495
* [XHarness] Ignore corlib tets failing on devices.
Added the required ignores to get the devices green and workaround mono
issue https://github.com/mono/mono/issues/13641
2019-03-26 12:25:23 +01:00
1615b28ed1
[XHarness] Reduce the number of test applications for the BCL tests. ( #5768 )
...
This commit improves the state of the BCL testing in the following ways:
1. Improve the device tets running. Less apps, faster results.
2. WatchOS apps are left as they were to ensure that we do not have deplouyment/run issues.
We now support the ignore files per assembly name to simplify the
tracking of the ignored tests. All
2019-03-20 12:10:18 +01:00
22832369df
[XHarness] Fix crash in the bcl tests. ( #5762 )
2019-03-13 17:28:16 +01:00
3fc1e32adb
[XHarness] Reenable the NUnit System.Data tests on mac os x. ( #5749 )
...
Fixes https://github.com/xamarin/maccore/issues/1192
Fixes https://github.com/xamarin/maccore/issues/1193
2019-03-11 18:50:18 +01:00
849355eaf2
[XHarness] Don't run BitcodeNotSupported BCL tests on watchOS. ( #5750 )
2019-03-11 12:08:48 +01:00
5bfbefab14
[XHarness] Reneable System.Security nunit tests on mac os x. ( #5751 )
...
Fixes https://github.com/xamarin/maccore/issues/1197
2019-03-11 12:08:10 +01:00
7ef507b579
[XHarness] Fix the hostname parsing on devices. ( #5752 )
...
Following this
221f3e4a37/2478649/device-tests/jenkins-results/tests/index.html
2019-03-11 12:04:32 +01:00
9eb75dda71
[XHarness] Reenable the System.Core tests on mac os x. ( #5743 )
...
Fixes https://github.com/xamarin/maccore/issues/1191
2019-03-08 17:02:15 +01:00
99e727c90b
Merge pull request #4904 from xamarin/mono-2018-10
...
Bump to mono:2018-10
2019-03-08 11:06:50 +01:00
112502c081
[Xharness] Reenable the SystemXml tests on mac os x. ( #5735 )
...
Fixes https://github.com/xamarin/maccore/issues/1201
Fixes https://github.com/xamarin/maccore/issues/1202
2019-03-07 17:19:47 +01:00
bc3b5a2d43
[Tests] Fix the tests.sln to include the new test projects. ( #5720 )
...
Update the sun and ensure that the GUID of the projects are always the same to make the .sln file happy.
2019-03-07 13:14:53 +01:00
cad438dcfa
[XHarness] Reenable the System.Configuration tests on mac os x. ( #5702 )
...
Reenable the tests and add support to ignoring certain tests depending
on the version of the mac os x that is under test. The
System.Configuration tests make no sense in Modern.
Fixes https://github.com/xamarin/maccore/issues/1189
Fixes https://github.com/xamarin/maccore/issues/1190
2019-03-07 13:09:56 +01:00
92ebe5b64a
[XHarness] Reenable SystemServiceModelTests on mac os x. ( #5710 )
...
Fixes https://github.com/xamarin/maccore/issues/1198
2019-03-04 18:17:56 +01:00
568d19944d
[XHarness] Reneable SystemIdentityModelTests on mac os x. ( #5708 )
...
Fixes https://github.com/xamarin/maccore/issues/1194
2019-03-04 17:42:07 +01:00
10912633e3
[Xharness] Reenable the xunit based System.Data tests on mac os x. ( #5709 )
...
Fixes https://github.com/xamarin/maccore/issues/1208
2019-03-04 17:41:37 +01:00
98d9fc2cf3
[XHarness] Reenable MonoCSharpTests on mac os x. ( #5696 )
...
Fixes https://github.com/xamarin/maccore/issues/1186
2019-03-04 10:56:22 +01:00
de82764456
[XHarness] Reneable the System.Transaction tests on Mac OS X. ( #5686 )
...
Reenable the tests and ensure that the failing ones on Modern are
ignored. The bcl tests on mac os x can now make a diff between the
version (Moder/Full) to ignore files so that tests that work in a
version are not ignored in the other one.
Fixes https://github.com/xamarin/maccore/issues/1200
2019-03-01 10:29:21 +01:00
97b5aef47e
Merge branch 'master' into mono-2018-10
2019-02-28 21:18:49 +01:00
c2967c0d50
[XHarness] Ensure we do a nuget restore on bcl imported tests. Fixes #5383 ( #5574 )
...
* [XHarness] Ensure we do a nuget restore on bcl imported tests. Fixes #5383
We need to ensure that a nuget restore is done, otherwise we might have
build issues with missing libs.
Fixes https://github.com/xamarin/xamarin-macios/issues/5383
2019-02-28 18:27:01 +01:00
bbbf15a72b
Merge branch 'master' into mono-2018-10
...
# Conflicts:
# tests/bcl-test/System.Core/System.Core.csproj.template
# tests/bcl-test/System.Net.Http/System.Net.Http-mac.csproj.template
# tests/bcl-test/System.ServiceModel.Web/System.ServiceModel.Web.csproj.template
# tests/bcl-test/System.Xml.Linq/System.Xml.Linq-mac.csproj.template
# tests/bcl-test/System/System.csproj.template
2019-02-28 13:06:00 +01:00
297aebef60
[Tests] Fix the make rule that generate the test projects. Fixes #5638 ( #5666 )
...
Fixed the rule to generate the tests. This branch adds missing test dlls
that the make rule check, or it will give an error stating that tests
are missing.
This feature should be added to xharness and an issue was created for
that: https://github.com/xamarin/maccore/issues/1447
Fixes https://github.com/xamarin/xamarin-macios/issues/5638
2019-02-28 11:52:04 +01:00
9c35ba28d1
[XHarness] Allow all cultures in the bcl tests. #5640 ( #5667 )
...
Some of the bcl tests need certain cultures. Add them to the templates
so that tests do not fail due to a missing culture.
Fixes https://github.com/xamarin/xamarin-macios/issues/5640
2019-02-28 11:48:35 +01:00
1e9de96789
Merge branch 'master' into mono-2018-10
2019-02-24 10:20:44 +01:00
7cfbaf019a
[XHarness] Ensure that the correct values are shown on the test reports. ( #5649 )
...
Fixes #5639
The results reported in the xharness run do not add up. Total tests
should include the number of skipped tests. This change ensures that the
tests results correctly add up.
Example nunit fixed tests: [NUnit] Mono SystemIOCompressionTests (total should
be 24, passed 4, ignored 20).
Example xunit fixed tests: [xUnit] Mono SystemDataXunit (total should be
1061, passed 1054, ignored 7).
Fixes https://github.com/xamarin/xamarin-macios/issues/5639
2019-02-22 17:12:07 +01:00
3f512606fb
Remove no longer needed ignore files from BCLTests
...
The issues don't show up in 2018-10 anymore.
2019-02-20 14:30:04 +01:00
8b21371437
Merge branch 'master' into mono-2018-10
2019-01-30 13:43:03 +01:00
40c998e264
[XHarness] Add XUnit category filtering. ( #5455 )
...
Provide the ability to filter per categories in the xunit runner and add the default categories for Mac, iOS, TvOS and WatchOS.
2019-01-28 17:47:36 +01:00
6c12862d3e
[XHarness] Remove not needed ignore file. ( #5456 )
...
Since we support filtering via categories, we do not longer need the
ignore file in these tests.
2019-01-24 13:11:11 +01:00
debcee412c
[XHarness] Clean the System.Net.Http ignore file. ( #5459 )
...
Since we support categories, there is a test that does not longer needs
to be ignored in ios and tvos but needs to be in watchos (we do not yet
have the correct test assembly for the platform).
2019-01-24 13:10:40 +01:00
5165f1cdde
[Xharness] Remove not longer needed System.Service.Model.Web ignore file. ( #5460 )
...
Since we support categories, the file is not longer needed since the
failing tests are part of an ignored category.
2019-01-23 12:28:54 +01:00
99bda10aa4
[XHarness] Clean the System.Data ignore. ( #5458 )
...
Since we support filtering there are a number of tests that were ignore
that are part of a ignored category, therefore, they are not needed in
the file.
2019-01-23 10:17:46 +01:00
02f65cc119
[XHarness] Remove not needed ignore file for System.Transactions. ( #5457 )
...
Since we support filtering via categories, we do not longer need the
ignore file in these tests.
2019-01-22 23:24:44 +01:00
a71f421a67
[XHarness] Reneable Sytem.Security tests on iOS, TvOS and WatchOS. ( #5421 )
...
Reneable the tests and ignore those failing ones.
Fixes https://github.com/xamarin/maccore/issues/1139
2019-01-22 23:18:45 +01:00
a97dddf6db
[XHarness] Remove not needed dll from the test templates. ( #5454 )
2019-01-22 17:49:03 +01:00
Rolf Bjarne Kvinge
Alexander Köplinger
Manuel de la Pena
Sebastien Pouliot