22832369df
[XHarness] Fix crash in the bcl tests. ( #5762 )
2019-03-13 17:28:16 +01:00
3fc1e32adb
[XHarness] Reenable the NUnit System.Data tests on mac os x. ( #5749 )
...
Fixes https://github.com/xamarin/maccore/issues/1192
Fixes https://github.com/xamarin/maccore/issues/1193
2019-03-11 18:50:18 +01:00
849355eaf2
[XHarness] Don't run BitcodeNotSupported BCL tests on watchOS. ( #5750 )
2019-03-11 12:08:48 +01:00
5bfbefab14
[XHarness] Reneable System.Security nunit tests on mac os x. ( #5751 )
...
Fixes https://github.com/xamarin/maccore/issues/1197
2019-03-11 12:08:10 +01:00
7ef507b579
[XHarness] Fix the hostname parsing on devices. ( #5752 )
...
Following this
221f3e4a37/2478649/device-tests/jenkins-results/tests/index.html
2019-03-11 12:04:32 +01:00
9eb75dda71
[XHarness] Reenable the System.Core tests on mac os x. ( #5743 )
...
Fixes https://github.com/xamarin/maccore/issues/1191
2019-03-08 17:02:15 +01:00
99e727c90b
Merge pull request #4904 from xamarin/mono-2018-10
...
Bump to mono:2018-10
2019-03-08 11:06:50 +01:00
112502c081
[Xharness] Reenable the SystemXml tests on mac os x. ( #5735 )
...
Fixes https://github.com/xamarin/maccore/issues/1201
Fixes https://github.com/xamarin/maccore/issues/1202
2019-03-07 17:19:47 +01:00
bc3b5a2d43
[Tests] Fix the tests.sln to include the new test projects. ( #5720 )
...
Update the sun and ensure that the GUID of the projects are always the same to make the .sln file happy.
2019-03-07 13:14:53 +01:00
cad438dcfa
[XHarness] Reenable the System.Configuration tests on mac os x. ( #5702 )
...
Reenable the tests and add support to ignoring certain tests depending
on the version of the mac os x that is under test. The
System.Configuration tests make no sense in Modern.
Fixes https://github.com/xamarin/maccore/issues/1189
Fixes https://github.com/xamarin/maccore/issues/1190
2019-03-07 13:09:56 +01:00
92ebe5b64a
[XHarness] Reenable SystemServiceModelTests on mac os x. ( #5710 )
...
Fixes https://github.com/xamarin/maccore/issues/1198
2019-03-04 18:17:56 +01:00
568d19944d
[XHarness] Reneable SystemIdentityModelTests on mac os x. ( #5708 )
...
Fixes https://github.com/xamarin/maccore/issues/1194
2019-03-04 17:42:07 +01:00
10912633e3
[Xharness] Reenable the xunit based System.Data tests on mac os x. ( #5709 )
...
Fixes https://github.com/xamarin/maccore/issues/1208
2019-03-04 17:41:37 +01:00
98d9fc2cf3
[XHarness] Reenable MonoCSharpTests on mac os x. ( #5696 )
...
Fixes https://github.com/xamarin/maccore/issues/1186
2019-03-04 10:56:22 +01:00
de82764456
[XHarness] Reneable the System.Transaction tests on Mac OS X. ( #5686 )
...
Reenable the tests and ensure that the failing ones on Modern are
ignored. The bcl tests on mac os x can now make a diff between the
version (Moder/Full) to ignore files so that tests that work in a
version are not ignored in the other one.
Fixes https://github.com/xamarin/maccore/issues/1200
2019-03-01 10:29:21 +01:00
97b5aef47e
Merge branch 'master' into mono-2018-10
2019-02-28 21:18:49 +01:00
c2967c0d50
[XHarness] Ensure we do a nuget restore on bcl imported tests. Fixes #5383 ( #5574 )
...
* [XHarness] Ensure we do a nuget restore on bcl imported tests. Fixes #5383
We need to ensure that a nuget restore is done, otherwise we might have
build issues with missing libs.
Fixes https://github.com/xamarin/xamarin-macios/issues/5383
2019-02-28 18:27:01 +01:00
bbbf15a72b
Merge branch 'master' into mono-2018-10
...
# Conflicts:
# tests/bcl-test/System.Core/System.Core.csproj.template
# tests/bcl-test/System.Net.Http/System.Net.Http-mac.csproj.template
# tests/bcl-test/System.ServiceModel.Web/System.ServiceModel.Web.csproj.template
# tests/bcl-test/System.Xml.Linq/System.Xml.Linq-mac.csproj.template
# tests/bcl-test/System/System.csproj.template
2019-02-28 13:06:00 +01:00
297aebef60
[Tests] Fix the make rule that generate the test projects. Fixes #5638 ( #5666 )
...
Fixed the rule to generate the tests. This branch adds missing test dlls
that the make rule check, or it will give an error stating that tests
are missing.
This feature should be added to xharness and an issue was created for
that: https://github.com/xamarin/maccore/issues/1447
Fixes https://github.com/xamarin/xamarin-macios/issues/5638
2019-02-28 11:52:04 +01:00
9c35ba28d1
[XHarness] Allow all cultures in the bcl tests. #5640 ( #5667 )
...
Some of the bcl tests need certain cultures. Add them to the templates
so that tests do not fail due to a missing culture.
Fixes https://github.com/xamarin/xamarin-macios/issues/5640
2019-02-28 11:48:35 +01:00
1e9de96789
Merge branch 'master' into mono-2018-10
2019-02-24 10:20:44 +01:00
7cfbaf019a
[XHarness] Ensure that the correct values are shown on the test reports. ( #5649 )
...
Fixes #5639
The results reported in the xharness run do not add up. Total tests
should include the number of skipped tests. This change ensures that the
tests results correctly add up.
Example nunit fixed tests: [NUnit] Mono SystemIOCompressionTests (total should
be 24, passed 4, ignored 20).
Example xunit fixed tests: [xUnit] Mono SystemDataXunit (total should be
1061, passed 1054, ignored 7).
Fixes https://github.com/xamarin/xamarin-macios/issues/5639
2019-02-22 17:12:07 +01:00
3f512606fb
Remove no longer needed ignore files from BCLTests
...
The issues don't show up in 2018-10 anymore.
2019-02-20 14:30:04 +01:00
8b21371437
Merge branch 'master' into mono-2018-10
2019-01-30 13:43:03 +01:00
40c998e264
[XHarness] Add XUnit category filtering. ( #5455 )
...
Provide the ability to filter per categories in the xunit runner and add the default categories for Mac, iOS, TvOS and WatchOS.
2019-01-28 17:47:36 +01:00
6c12862d3e
[XHarness] Remove not needed ignore file. ( #5456 )
...
Since we support filtering via categories, we do not longer need the
ignore file in these tests.
2019-01-24 13:11:11 +01:00
debcee412c
[XHarness] Clean the System.Net.Http ignore file. ( #5459 )
...
Since we support categories, there is a test that does not longer needs
to be ignored in ios and tvos but needs to be in watchos (we do not yet
have the correct test assembly for the platform).
2019-01-24 13:10:40 +01:00
5165f1cdde
[Xharness] Remove not longer needed System.Service.Model.Web ignore file. ( #5460 )
...
Since we support categories, the file is not longer needed since the
failing tests are part of an ignored category.
2019-01-23 12:28:54 +01:00
99bda10aa4
[XHarness] Clean the System.Data ignore. ( #5458 )
...
Since we support filtering there are a number of tests that were ignore
that are part of a ignored category, therefore, they are not needed in
the file.
2019-01-23 10:17:46 +01:00
02f65cc119
[XHarness] Remove not needed ignore file for System.Transactions. ( #5457 )
...
Since we support filtering via categories, we do not longer need the
ignore file in these tests.
2019-01-22 23:24:44 +01:00
a71f421a67
[XHarness] Reneable Sytem.Security tests on iOS, TvOS and WatchOS. ( #5421 )
...
Reneable the tests and ignore those failing ones.
Fixes https://github.com/xamarin/maccore/issues/1139
2019-01-22 23:18:45 +01:00
a97dddf6db
[XHarness] Remove not needed dll from the test templates. ( #5454 )
2019-01-22 17:49:03 +01:00
d9dcc9ae21
[XHarness] Add support for filtering categories in NUnit. ( #5446 )
2019-01-22 14:59:36 +01:00
bec4e8604a
Merge branch 'master' of github.com:xamarin/xamarin-macios into mono-2018-10
2019-01-18 14:09:29 +01:00
879629bc9d
[XHarness] Reenable the System tests on iOS, WatchOS and TVOs. ( #5425 )
...
All the failing tests have been ignored. There are a large number of
tests ignored on the watchOS platform beacuase atm the iOS test dll is
used.
Fixes https://github.com/xamarin/maccore/issues/1135
2019-01-17 22:58:31 +01:00
cf1a034e96
[XHarness] Reenable the NUnit Corlib tests from the iOS Mono SDK. ( #5316 )
...
Reenable the tests on iOS/TvOS/WatchOS. Fixes xamarin/maccore#1153
2019-01-17 22:55:06 +01:00
8b68cdc62f
[XHarness] Report issues with the TestFixtureSetup ( #5428 )
...
There are a number of tests that use a TestFixtureSetup method that
fails. While the xml results report these errors, if a user runs xharness locally,
he will not get the errors reported. This issue meant that we had
different errors reported in jenkis and locally.
2019-01-17 22:54:06 +01:00
fea85dc569
[XHarness] Reenable SystemTransactionsTests on iOS, TvOS and WatchOs. ( #5411 )
...
Fixes https://github.com/xamarin/maccore/issues/1134
2019-01-16 19:12:20 +01:00
34ca0496fc
[XHarness] Reneable the SystemNetHttpTests on iOS, TvOS and WatchOS. ( #5405 )
...
Failing iOS tests are ignored WatchOS is running the iOS tests until we have the tests in the SDK
for the watch runtime.
Fixes https://github.com/xamarin/maccore/issues/1144
Fixes https://github.com/xamarin/maccore/issues/1145
Mono issue: https://github.com/mono/mono/issues/12430
2019-01-16 12:16:22 +01:00
c455a1d7b9
[XHarness] Reneable Mono.Security tests on WatchOS. ( #5412 )
...
Fixes https://github.com/xamarin/maccore/issues/1142
2019-01-16 12:13:34 +01:00
293ade0a30
[XHarness] Reneable the SystemSecurity tests on iOS, TvOS and WatchOS ( #5410 )
...
Some of the test classes are abstract, and we needed to change the
generator to ignore that fact. Before the change, we would have 0 test
cases.
Failing tests are ignored.
Fixes https://github.com/xamarin/maccore/issues/1128
Mono issue https://github.com/mono/mono/issues/12446
2019-01-16 12:11:53 +01:00
e53bfac5c0
[XHarness] Reenable System.Core tests on ios/tvos/watchos ( #5397 )
...
Fixes https://github.com/xamarin/maccore/issues/1143
Mono issue: https://github.com/mono/mono/issues/12419
2019-01-14 17:16:41 +01:00
102339ad47
[XHarness] Reenable the System.ServiceModel tests from the bcl. ( #5384 )
...
Fixes https://github.com/xamarin/maccore/issues/1138
A new mono issue was added: https://github.com/mono/mono/issues/12417
2019-01-14 16:58:36 +01:00
929e4623c4
Merge branch 'master' into mono-2018-10
...
# Conflicts:
# external/mono
2019-01-14 15:26:56 +01:00
adc9ddccf3
[XHarness] Reenable the System.Data tests from the bcl. ( #5379 )
2019-01-11 16:56:30 +01:00
6a1ecaabb0
[XHarness] Reenable the System.IO.Compression.Filesystem tests and ignore those failing ones. ( #5374 )
2019-01-11 12:22:48 +01:00
b6bf3586fb
FIXME: fix build, not sure if changing this is the right way
2019-01-10 22:14:58 +01:00
8e32a07af0
[XHarness] Reneable the System.IO.Compression tests. ( #5373 )
2019-01-10 19:05:13 +01:00
18035518fb
[XHarness] Reenable System.Xml tests from the mono test dlls. ( #5370 )
2019-01-10 16:26:54 +01:00
40921b9924
[XHarness] Reenable Mono.Data.Tds tests on watch os. ( #5317 )
...
Ignore the failing tests and run the rest. Fixes xamarin/maccore#1152
2018-12-21 10:38:13 +01:00
Manuel de la Pena
Rolf Bjarne Kvinge
Alexander Köplinger
Bernhard Urban