xamarin
/
xamarin-macios
зеркало из
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
xamarin-macios/jenkins
История
Rolf Bjarne Kvinge 61bf0db817
[tests] Run tests-docs using xharness. (#5372) 
Jenkins has a limitation where you can't mark a step a failure, it has to
*fail* to be reported as such.

This means that running multiple tests, and reporting a failure if any of
those tests fail is not possible.

We run into this with the normal test run + the docs tests; where we currently
don't show a red result in the UI if any of those fail.

So incorporate the test-docs step into xharness, so that we only have one
thing to in the Jenkinsfile, which makes it possible for us to fail the test
run step properly.

This also required a few upgrades to xharness to get more info for pull
requests, since the logic to enable the docs tests is a bit more complicated
than anything else we have (if the current branch (or the target branch for a
PR) is 'master' AND xamarin mode is enabled).
 		2019-01-10 16:43:02 +01:00
..
.gitignore [jenkins] Make it possible to skip API comparison by applying a label to a pull request. (#3994) 2018-06-12 14:37:03 +02:00
Jenkinsfile [tests] Run tests-docs using xharness. (#5372) 2019-01-10 16:43:02 +01:00
Makefile [jenkins] Fix scripts to be shellcheck-happy. (#4148) 2018-06-12 14:37:03 +02:00
README.md Fix typos. 2018-07-04 20:57:42 +02:00
add-commit-comment.sh [CI] Add scripts to set github status from Azure DevOps. (#5246) 2018-12-11 09:00:35 +01:00
add-commit-status.sh [CI] Add scripts to set github status from Azure DevOps. (#5246) 2018-12-11 09:00:35 +01:00
build-api-diff.sh [jenkins] Add support for completely skipping the public jenkins job using a label. (#4333) 2018-06-26 15:50:54 +02:00
build-package.sh Add support for building on Jenkins. (#4159) 2018-06-12 14:37:03 +02:00
build.sh Enable the device build correctly when mono/llvm is bumped. (#5294) 2018-12-19 16:56:12 +01:00
compare.sh [jenkins] Fix path to api diff in commit comment. (#5173) 2018-11-23 16:23:03 +01:00
fetch-pr-labels.sh [jenkins] Fix scripts to be shellcheck-happy. (#4148) 2018-06-12 14:37:03 +02:00
prepare-packaged-macos-tests.sh [xharness] Fix retry-download-on-error-56 logic to actually work. (#5206) 2018-11-30 15:42:18 +01:00
productsign.sh Add support for building on Jenkins. (#4159) 2018-06-12 14:37:03 +02:00
provision-deps.sh [jenkins] Remove any system versions of XI/XM to make absolutely sure nothing in our build requires them. (#5059) 2018-10-31 17:47:28 -04:00
publish-results.sh Add support for building on Jenkins. (#4159) 2018-06-12 14:37:03 +02:00
run-tests.sh [jenkins] Print out the environment for debug purposes. (#5261) 2018-12-12 15:01:03 +01:00
utils.groovy [jenkins] Specify repo manually for GitHub statuses to fix maccore#898. (#5269) 2018-12-13 16:38:08 +01:00
vsts-device-tests-set-status.sh [CI] Add scripts to set github status from Azure DevOps. (#5246) 2018-12-11 09:00:35 +01:00

README.md

Jenkins

This directory contains all the scripts to be executed as steps in the jenkins build bots for each of the PR in the project. The expected order in which they have to be executed is as follows:

  • provision-deps.sh : Downloads and installs the project dependencies.
  • build.sh : Builds the project.
  • run-tests.sh : Runs the tests.
  • build-api-diff.sh : Builds the API diff.

Jenkinsfile

This file contains the logic to run on our internal Jenkins, available here: http://xamarin-jenkins/blue/organizations/jenkins/macios/activity

The Jenkins job is a multi-branch pipeline job, it will execute in the following conditions:

  • For all branches in the xamarin org (not forks) that has a jenkins/Jenkinsfile file.
  • For all pull requests from people with write access (also conditional on having a jenkins/Jenkinsfile file).

In very broad strokes, the Jenkins job will:

  • Checkout xamarin-macios

  • Build

  • Create packages, upload them to Azure and publish the links to the packages as GitHub statuses.

  • Run our test suite.

  • Run selected Xamarin.Mac tests on all macOS versions we support. This is done in parallel with the normal test run.

    If a particular macOS version must be excluded temporarily from testing, search Jenkinsfile for excludedOSes and follow the instructions you'll find.