Граф коммитов

765 Коммитов

Автор SHA1 Сообщение Дата
Chris Manchester 494eff062e Bug 1555396 - Bump revision of sccache built in automation to current master. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D33102

--HG--
extra : moz-landing-system : lando
2019-05-30 06:32:54 +00:00
Andi-Bogdan Postelnicu 16bdec73bc Bug 1554632 - reviewbot tasks should use a mozconfig file. r=bastien,sylvestre
Differential Revision: https://phabricator.services.mozilla.com/D32680

--HG--
extra : moz-landing-system : lando
2019-05-27 14:07:39 +00:00
Tom Prince 573c84911a No bug: [mozharness] Don't explicitly pass scm-level to mozharness; r=Callek
The last use of scm level in mozharness is in `mozharness.mozilla.secrets` which
uses the `MOZ_SCM_LEVEL` environment variable directy.

Differential Revision: https://phabricator.services.mozilla.com/D20897

--HG--
extra : moz-landing-system : lando
2019-05-24 01:08:06 +00:00
Nathan Froyd fd36809417 Bug 1553973 - make run-profileserver.sh collect all .profraw files; r=firefox-build-system-reviewers,mshal
This change is necessary to make either e10s profiling or LLVM IR-based
PGO instrumentation work properly, as both will generate multiple
`.profraw` files.

Differential Revision: https://phabricator.services.mozilla.com/D32390

--HG--
extra : moz-landing-system : lando
2019-05-23 21:54:17 +00:00
Tom Ritter 6ac52e21b1 Bug 1471698 - Remove our binutils-corruption-avoiding workaround for mingw-clang r=froydnj
Depends on D31347

Differential Revision: https://phabricator.services.mozilla.com/D31349

--HG--
extra : moz-landing-system : lando
2019-05-22 13:40:36 +00:00
Edwin Gao 231ad45e42 Bug 1552563 - remove mochitest-media from whitelist not requiring compiz CLOSED TREE
Summary:
Changes:
- remove `mochitest-media` from the whiteslist - compiz is required.

Test Plan: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=pending%2Crunning%2Csuperseded%2Cusercancel%2Cretry%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&group_state=expanded&revision=f16b0ce4af9e575ef2ec877b405698c0b0c62f92

Reviewers: jmaher, gbrown

Bug #: 1552563

Differential Revision: https://phabricator.services.mozilla.com/D32383

--HG--
extra : rebase_source : 1d8b1ba401ab9b565258fd6be4c0de9975e1e4fd
extra : histedit_source : c53f405d98335228f3313abedb4dfd26fab4f9e2
2019-05-23 23:53:21 +03:00
Andreea Pavel 3c9b661125 Backed out changeset 52e365586577 (bug 1552563) for failing test_getUserMedia_basicScreenshare.html on a CLOSED TREE 2019-05-23 23:52:19 +03:00
Edwin Gao 428bdb8a57 Bug 1552563 - do not run compiz on linux tests unless needed by tests r=jmaher
Changes:

- removed UBUNTU_1604 detection mechanism at top of `test-linux.sh` file, since all tests are run on Ubuntu 16.04 anyway
- added new environment value `NEED_COMPIZ`, defaulting to `true`, which will inform the test if compiz is required for tests
- from `test-linux.sh` remove unconditional invocation of compiz, and replace it with detection of `NEED_COMPIZ` environment variable

Differential Revision: https://phabricator.services.mozilla.com/D31724

--HG--
extra : moz-landing-system : lando
2019-05-21 16:33:43 +00:00
Chris Manchester a18c4d2cbd Bug 1553339 - Abandon "2" in name of sccache toolchain artifacts. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D32218

--HG--
extra : moz-landing-system : lando
2019-05-22 21:06:16 +00:00
Oana Pop Rus af0293e185 Backed out changeset 7de6c5aab8b4 (bug 1471698) for build bustages on Windows MinGW all on a CLOSED TREE 2019-05-22 16:36:06 +03:00
Tom Ritter 382e464814 Bug 1471698 - Remove our binutils-corruption-avoiding workaround for mingw-clang r=froydnj
Depends on D31347

Differential Revision: https://phabricator.services.mozilla.com/D31349

--HG--
extra : moz-landing-system : lando
2019-05-21 17:57:06 +00:00
Chris Manchester 75b9d34484 Bug 1532329 - Build sccache for macOS as a toolchain task. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D31692

--HG--
extra : moz-landing-system : lando
2019-05-22 03:27:23 +00:00
Noemi Erli ea4d1bdf44 Backed out changeset aadea84deaeb (bug 1532329) for toolchains bustages CLOSED TREE 2019-05-22 02:40:58 +03:00
Chris Manchester 154f462aa7 Bug 1532329 - Build sccache for macOS as a toolchain task. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D31692

--HG--
extra : moz-landing-system : lando
2019-05-18 00:20:17 +00:00
Nathan Froyd 37d0db29a9 Bug 1551690 - be more specific about the LLVM target on OS X; r=nalexander
Our current OS X builds use `--target=x86_64-darwin11` (which
corresponds to OS X 10.7).  This target is problematic for two reasons:

* We're actually targeting for OS X 10.9 (`MACOSX_DEPLOYMENT_TARGET`);
* It's slightly different from the default Rust target.

Let's address these problems in reverse order: differences from the Rust
target are bad, because the `--target` we provide to `clang` and the
Rust target find their way into LLVM bitcode files and the linker will
refuse to link together bitcode files that have incompatible targets.

Why are the two incompatible?  The current `--target` doesn't have a
"vendor" in triple-speak, whereas the Rust one has "apple" as the
vendor (`x86_64-apple-darwin`) We therefore need to change the
`--target` we pass to `clang` to have a vendor of "apple".

This need is behind the {init,toolchain}.configure changes,
but it has ramifications elsewhere, because `clang` looks for
`--target`-prefixed build tools.  So we have to change the `--target`
for cctools to get the right tool prefixes and we have to change the
`--target` for building clang ourselves so that *those* builds can find
the newly renamed cctools.

Once we've done, that's really enough; we don't *need to address the
first problem: While the `--target` might be `x86_64-apple-darwin11`,
both `clang` and `rustc` will dynamically choose the target triple that
eventually lands in LLVM bitcode files based on
`MACOSX_DEPLOYMENT_TARGET`, which we set in all builds.  But the current
target is slightly misleading, and the cctools don't need to be prefixed
with a particular Darwin version, since they work for all Darwin
targets.  Let's just drop the "11" from the `--target` and eliminate a
little bit of confusion.

Differential Revision: https://phabricator.services.mozilla.com/D31128

--HG--
extra : moz-landing-system : lando
2019-05-21 17:53:44 +00:00
Andreea Pavel 58566309c2 Backed out changeset ae7096d1add7 (bug 1551690) for toolchain bustages on a CLOSED TREE 2019-05-21 17:05:24 +03:00
Nathan Froyd d49bc5f0ef Bug 1551690 - be more specific about the LLVM target on OS X; r=nalexander
Our current OS X builds use `--target=x86_64-darwin11` (which
corresponds to OS X 10.7).  This target is problematic for two reasons:

* We're actually targeting for OS X 10.9 (`MACOSX_DEPLOYMENT_TARGET`);
* It's slightly different from the default Rust target.

Let's address these problems in reverse order: differences from the Rust
target are bad, because the `--target` we provide to `clang` and the
Rust target find their way into LLVM bitcode files and the linker will
refuse to link together bitcode files that have incompatible targets.

Why are the two incompatible?  The current `--target` doesn't have a
"vendor" in triple-speak, whereas the Rust one has "apple" as the
vendor (`x86_64-apple-darwin`) We therefore need to change the
`--target` we pass to `clang` to have a vendor of "apple".

This need is behind the {init,toolchain}.configure changes,
but it has ramifications elsewhere, because `clang` looks for
`--target`-prefixed build tools.  So we have to change the `--target`
for cctools to get the right tool prefixes and we have to change the
`--target` for building clang ourselves so that *those* builds can find
the newly renamed cctools.

Once we've done, that's really enough; we don't *need to address the
first problem: While the `--target` might be `x86_64-apple-darwin11`,
both `clang` and `rustc` will dynamically choose the target triple that
eventually lands in LLVM bitcode files based on
`MACOSX_DEPLOYMENT_TARGET`, which we set in all builds.  But the current
target is slightly misleading, and the cctools don't need to be prefixed
with a particular Darwin version, since they work for all Darwin
targets.  Let's just drop the "11" from the `--target` and eliminate a
little bit of confusion.

Differential Revision: https://phabricator.services.mozilla.com/D31128

--HG--
extra : moz-landing-system : lando
2019-05-21 13:48:23 +00:00
Coroiu Cristina c4361da40f Backed out changeset 2e560a9e4bcf (bug 1551690) for build bustages 2019-05-21 03:51:56 +03:00
Nathan Froyd dc2ad25275 Bug 1551690 - be more specific about the LLVM target on OS X; r=nalexander
Our current OS X builds use `--target=x86_64-darwin11` (which
corresponds to OS X 10.7).  This target is problematic for two reasons:

* We're actually targeting for OS X 10.9 (`MACOSX_DEPLOYMENT_TARGET`);
* It's slightly different from the default Rust target.

Let's address these problems in reverse order: differences from the Rust
target are bad, because the `--target` we provide to `clang` and the
Rust target find their way into LLVM bitcode files and the linker will
refuse to link together bitcode files that have incompatible targets.

Why are the two incompatible?  The current `--target` doesn't have a
"vendor" in triple-speak, whereas the Rust one has "apple" as the
vendor (`x86_64-apple-darwin`) We therefore need to change the
`--target` we pass to `clang` to have a vendor of "apple".

This need is behind the {init,toolchain}.configure changes,
but it has ramifications elsewhere, because `clang` looks for
`--target`-prefixed build tools.  So we have to change the `--target`
for cctools to get the right tool prefixes and we have to change the
`--target` for building clang ourselves so that *those* builds can find
the newly renamed cctools.

Once we've done, that's really enough; we don't *need to address the
first problem: While the `--target` might be `x86_64-apple-darwin11`,
both `clang` and `rustc` will dynamically choose the target triple that
eventually lands in LLVM bitcode files based on
`MACOSX_DEPLOYMENT_TARGET`, which we set in all builds.  But the current
target is slightly misleading, and the cctools don't need to be prefixed
with a particular Darwin version, since they work for all Darwin
targets.  Let's just drop the "11" from the `--target` and eliminate a
little bit of confusion.

Differential Revision: https://phabricator.services.mozilla.com/D31128

--HG--
extra : moz-landing-system : lando
2019-05-15 21:13:17 +00:00
Tom Ritter 505cced8b9 Bug 1471698 - Switch the mingw clang compiler to the 8 branch r=froydnj
This will match the compiler version Tor would like. We backport several
llvm-objcopy patches that landed right after the 8 branch though. We
also grab some upstream changes from mingw-clang in the build script

Differential Revision: https://phabricator.services.mozilla.com/D31347

--HG--
extra : moz-landing-system : lando
2019-05-17 19:21:15 +00:00
Emilio Cobos Álvarez cee627fc60 Bug 1529002 - Update cbindgen. r=boris
We need this to auto-generate the copy-constructor for TransformOperation,
without which the patch wouldn't build.

Differential Revision: https://phabricator.services.mozilla.com/D30799

--HG--
extra : moz-landing-system : lando
2019-05-16 23:24:17 +00:00
Ciure Andrei 00a73f5055 Backed out 17 changesets (bug 1550554, bug 1549593, bug 1551991, bug 1529002) for failing multiple Android tests and Windows 2012 bustages CLOSED TREE
Backed out changeset 3bb3fafa62e2 (bug 1551991)
Backed out changeset e12a979de502 (bug 1551991)
Backed out changeset d81e4aa6bf0c (bug 1551991)
Backed out changeset c354e61f2a34 (bug 1551991)
Backed out changeset 37fd602bebc2 (bug 1551991)
Backed out changeset 6c1f00cc30ca (bug 1551991)
Backed out changeset 8a7a0329bdc3 (bug 1551991)
Backed out changeset 86159475ddd3 (bug 1551991)
Backed out changeset 35f91a9ea82a (bug 1529002)
Backed out changeset 6798155e71dc (bug 1529002)
Backed out changeset b90c2cf5b8c5 (bug 1550554)
Backed out changeset 882ab9868c95 (bug 1550554)
Backed out changeset b28a48e2ed21 (bug 1550554)
Backed out changeset 2c31fe18eefd (bug 1550554)
Backed out changeset 57f2362aa538 (bug 1550554)
Backed out changeset 45f171b26e95 (bug 1550554)
Backed out changeset 2e4b263c9410 (bug 1549593)
2019-05-16 13:17:10 +03:00
Emilio Cobos Álvarez e10c38f6f4 Bug 1529002 - Update cbindgen. r=boris
We need this to auto-generate the copy-constructor for TransformOperation,
without which the patch wouldn't build.

Differential Revision: https://phabricator.services.mozilla.com/D30799
2019-05-16 16:24:36 +02:00
Joel Maher ec5f3f9ae1 Bug 1551957 - Allow for osx 10.14 in CI for source tasks. r=ahal
Allow for osx 10.14 in CI for source tasks.

Differential Revision: https://phabricator.services.mozilla.com/D31297

--HG--
extra : moz-landing-system : lando
2019-05-15 21:04:57 +00:00
Kartikaya Gupta e23526209c Bug 1545968 - Update repack_rust.py to include rust stdlib src and analysis data. r=glandium
This makes the rust toolchain artifacts contain the rust stdlib as well,
for use by searchfox. It does bring up the size of the toolchain
artifact slightly - rustc.tar.xz file for the Linux/rust 1.34 job for
example goes from 270483672 bytes to 273803148 bytes (1.23% larger) and
the equivalent android tarball goes from 230503888 to 235698736 bytes
(2.25% larger).

Differential Revision: https://phabricator.services.mozilla.com/D28282

--HG--
extra : moz-landing-system : lando
2019-05-14 17:30:55 +00:00
Rob Thijssen 898299aa0d Bug 1549346 - toggle sccache gcs feature to always on r=chmanchester
partial revert of https://hg.mozilla.org/mozilla-central/rev/5b08dd3eeec9 where the gcs feature switch should have been to the win build only and always enabled rather than just when the SCCACHE_GCS_KEY_PATH variable is set.

Differential Revision: https://phabricator.services.mozilla.com/D30774

--HG--
extra : moz-landing-system : lando
2019-05-13 23:56:02 +00:00
Edwin Gao cfbdbd0133 Bug 1548924 - task efficiency: remove sleep 15 clause from test-linux.sh r=gbrown,jmaher CLOSED TREE
Changes:
- remove the `sleep 15` clause.

Differential Revision: https://phabricator.services.mozilla.com/D30251

--HG--
extra : source : 0e9e744accd3ed7b7b0ff2436904ed78a92bf9e2
2019-05-07 23:06:53 +00:00
Mihai Alexandru Michis f7b2873656 Backed out changeset 0e9e744accd3 (bug 1548924) for causing leaks 2019-05-08 09:35:04 +03:00
Edwin Gao 473d6ab07b Bug 1548924 - task efficiency: remove sleep 15 clause from test-linux.sh r=gbrown,jmaher
Changes:
- remove the `sleep 15` clause.

Differential Revision: https://phabricator.services.mozilla.com/D30251

--HG--
extra : moz-landing-system : lando
2019-05-07 23:06:53 +00:00
Narcis Beleuzu 92064a19e9 Backed out changeset 588a1949ec96 (bug 1545968) as per kats request. CLOSED TREE 2019-05-07 18:28:48 +03:00
Kartikaya Gupta da8d200ba0 Bug 1545968 - Update repack_rust.py to include rust stdlib src and analysis data. r=glandium
This makes the rust toolchain artifacts contain the rust stdlib as well,
for use by searchfox. It does bring up the size of the toolchain
artifact slightly - rustc.tar.xz file for the Linux/rust 1.34 job for
example goes from 270483672 bytes to 273803148 bytes (1.23% larger) and
the equivalent android tarball goes from 230503888 to 235698736 bytes
(2.25% larger).

Differential Revision: https://phabricator.services.mozilla.com/D28282

--HG--
extra : moz-landing-system : lando
2019-04-23 15:36:56 +00:00
Alexis Beingessner 52bd6c3025 Bug 1525402 - Bump cargo-vendor to 0.1.23. r=kats
0.1.21 mishandles cargo package renames, which are a required
feature for Rust 2018 support. The latest version fixes this.

Differential Revision: https://phabricator.services.mozilla.com/D29946

--HG--
extra : moz-landing-system : lando
2019-05-07 01:40:17 +00:00
Alexis Beingessner 1017bd764c Bug 1525402 - Bump cbindgen to 0.8.6. r=kvark
This version adds support for Rust 2018's new externs

Differential Revision: https://phabricator.services.mozilla.com/D29565

--HG--
extra : moz-landing-system : lando
2019-05-07 01:40:15 +00:00
Kartikaya Gupta 7d7e68f66b Bug 1548635 - Add opt builds of wrench. r=jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D29715

--HG--
extra : moz-landing-system : lando
2019-05-02 20:50:12 +00:00
Rob Thijssen c00716af37 Bug 1543026 - enable sccache on gcp r=wcosta
this change comprises the in-tree changes required to make use of sccache in gcp.
specifically:
- a gcp metadata lookup for availability-zone is added to mozconfig, enabling a build to determine its regional gcp sccache bucket
- the sccache cargo build command is modified to include the gcs feature when the environment contains gcs configuration

note that further changes are required on infra to support sccache use. the required changes already [exist](https://github.com/mozilla-releng/OpenCloudConfig/commit/1d515dc) and are enabled for gcp windows infra, including:
- a json credential file on the build instance filesystem, containing credentials valid for the appropriate scm level bucket for the gcp region
- an `SCCACHE_GCS_KEY_PATH` env variable containing the path to the json credential file
- an `SCCACHE_GCS_RW_MODE` env variable containg the text `READ_WRITE`
- sccache buckets must exist for each region and scm levels 1 & 3
- credentials for scm level 1 buckets **must not** be valid for scm level 3 buckets

on gcp systems which do not contain credential files and the above mentioned env variables (eg gecko-[1-3]-b-linux), sccache should fail gracefully without breaking builds.

Differential Revision: https://phabricator.services.mozilla.com/D29622

--HG--
extra : moz-landing-system : lando
2019-05-02 12:56:20 +00:00
Mike Hommey 46175d5797 Bug 1546870 - Package win*-rust toolchains as .tar.xz. r=froydnj
This uniformizes the artifact name across platforms. We may want to do
the same for other toolchains, but it bears the question whether xz is
reliably available on users' Windows machines, while it doesn't matter
for rust, since mach bootstrap pulls it with rustup rather than from
automation, contrary to other toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D28780

--HG--
extra : moz-landing-system : lando
2019-04-25 13:22:38 +00:00
Mike Hommey ca39c407dd Bug 1545368 - Support fetches in run-task on generic-worker. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D28048

--HG--
extra : moz-landing-system : lando
2019-04-27 21:56:47 +00:00
Mike Hommey 33a06d6450 Bug 1545344 - Don't change current directory when executing a command via run-task. r=tomprince
Currently, all things running via run-task don't really care that the
current directory is set to /. However, on generic-worker, many things
assume the current directory is the task directory, which varies by
task, and wrapping them with run-task fails because it resets the
current directory.

Differential Revision: https://phabricator.services.mozilla.com/D28018

--HG--
extra : moz-landing-system : lando
2019-04-27 21:51:53 +00:00
Mike Hommey 25920280d9 Bug 1544986 - Fall back more gracefully when TASKCLUSTER_WORKER_GROUP is not set. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D27841

--HG--
extra : moz-landing-system : lando
2019-04-23 21:27:50 +00:00
Nathan Froyd 0eebba71e5 Bug 1540082 - add an aarch64-cross clang build; r=nalexander
Analogously to the existing `linux64-clang-8-android-cross` build, this
build is a linux x86-64 build with runtime library support for aarch64.

Depends on D28405

Differential Revision: https://phabricator.services.mozilla.com/D28406

--HG--
extra : moz-landing-system : lando
2019-04-22 22:11:12 +00:00
Chris Manchester 2f81da5755 Bug 1544865 - Build `dist-server` in the sccache toolchain job where available. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D27749

--HG--
extra : moz-landing-system : lando
2019-04-16 17:08:38 +00:00
Chris Manchester 5b1f3fb485 Bug 1544521 - Update the sccache revision used in our automation to the current master. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D27568

--HG--
extra : moz-landing-system : lando
2019-04-15 23:33:50 +00:00
Ionut Goldan e0060de75c Bug 1539437 - Replace Chrome with Chromium mentionings where needed r=sparky,davehunt
Differential Revision: https://phabricator.services.mozilla.com/D25094

--HG--
rename : taskcluster/ci/test/raptor-chrome.yml => taskcluster/ci/test/raptor-chromium.yml
extra : moz-landing-system : lando
2019-04-12 10:33:24 +00:00
Connor Sheehan a8c491e89c Bug 1534463: patch `run-task` to clone from private hgweb mirrors r=tomprince
With tasks able to access the hgmointernal config from a Taskcluster
secret, we can now add functionality to `run-task` to support checking
out from the private hg service. Here we add add a `resolve_checkout_url`
function which takes the base/head repository URLs and determines
whether we should clone from the public or private service, returning
the resolved URL. The function pulls down the secret and checks that
the region the task is executing in is in the set of supported regions.
Then we generate a random number and default to the public service if
the number is lower than our "rate". If all the above conditions are
met, we replace `hg.mozilla.org` with the resolved domain name for the
given region.

We add a call to this function to `collect_vcs_options`, and skip
resolving the private URL if we aren't performing a checkout from
within `run-task`.

Differential Revision: https://phabricator.services.mozilla.com/D25002

--HG--
extra : moz-landing-system : lando
2019-04-11 17:19:36 +00:00
Daniel Varga f2b514eaaa Merge autoland to mozilla-central. a=merge 2019-04-11 00:51:52 +03:00
Daniel Varga 6d6f6dadce Backed out 4 changesets (bug 1458385) for nightly updates fail. a=backout
Backed out changeset 09338587b68e (bug 1458385)
Backed out changeset f7791b680d46 (bug 1458385)
Backed out changeset cc06a7beb3d1 (bug 1458385)
Backed out changeset 3b10487587c3 (bug 1458385)
2019-04-10 21:09:46 +03:00
Bastien Abadie a474eff8dd Bug 1541412 - Add static-analysis check-java to source-test tasks, r=ahal,andi
Differential Revision: https://phabricator.services.mozilla.com/D25929

--HG--
rename : taskcluster/scripts/misc/source-test-clang-setup.sh => taskcluster/scripts/misc/source-test-common.sh
extra : moz-landing-system : lando
2019-04-08 15:41:30 +00:00
Tom Prince 28cf04eec9 Bug 1458385: Update linux-upx to 3.9.5; r=glandium
This matches the version that exists in mozilla-build (see Bug 1501403).

Differential Revision: https://phabricator.services.mozilla.com/D26413

--HG--
extra : moz-landing-system : lando
2019-04-09 09:13:02 +00:00
Tom Prince b4e1868e59 Bug 1458385: Package mar and mbsdiff as a toolchain; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D24229

--HG--
extra : moz-landing-system : lando
2019-04-06 05:49:31 +00:00
Tom Ritter e0934a52d0 Bug 1540907 - Bump MinGW version to pick up MFVideoTransferMatrix constants r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D26530

--HG--
extra : moz-landing-system : lando
2019-04-08 19:14:03 +00:00
Andrew Halberstadt 16131e65d0 Bug 1195299 - [ci] Use 'mach python' to run mozharness scripts when we have a srcdir r=catlee
This makes sure that the mozharness scripts have access to all the packages in
the build system virtualenv (namely mozbase).

Differential Revision: https://phabricator.services.mozilla.com/D22184

--HG--
extra : moz-landing-system : lando
2019-04-05 15:39:50 +00:00
Bogdan Tara c39c82922d Backed out 2 changesets (bug 1195299) for l10n bustages a=backout
Backed out changeset 9645ac1a9851 (bug 1195299)
Backed out changeset 4de7f94119fd (bug 1195299)
2019-04-05 14:11:45 +03:00
Christian Holler e3fb12ff12 Bug 1541943 - Temporarily switch libFuzzer builds back to clang-7. r=froydnj
Differential Revision: https://phabricator.services.mozilla.com/D26194

--HG--
extra : moz-landing-system : lando
2019-04-04 16:47:57 +00:00
Andrew Halberstadt 2f1869451d Bug 1532747 - Use 'mach python' with repackage.sh script, CLOSED TREE, r=catlee
Differential Revision: https://phabricator.services.mozilla.com/D26239

--HG--
extra : moz-landing-system : lando
2019-04-04 20:35:09 +00:00
Andrew Halberstadt ff9a2ed949 Bug 1195299 - [ci] Use 'mach python' to run mozharness scripts when we have a srcdir r=catlee
This makes sure that the mozharness scripts have access to all the packages in
the build system virtualenv (namely mozbase).

Differential Revision: https://phabricator.services.mozilla.com/D22184

--HG--
extra : moz-landing-system : lando
2019-04-04 18:41:12 +00:00
Bastien Abadie 502ea8a095 Bug 1538770 - Replace TRY_MODIFIED_FILES by mozversioncontrol usage, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D24876

--HG--
extra : moz-landing-system : lando
2019-04-02 14:00:30 +00:00
Mike Hommey 9454edbe38 Bug 1538060 - Update non-Windows builds to clang 8. r=froydnj
Windows builds have been taken care of in bug 1535441.

Differential Revision: https://phabricator.services.mozilla.com/D25328

--HG--
rename : build/build-clang/clang-7-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-7-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-7-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : build/build-clang/clang-trunk-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-7-android.sh => taskcluster/scripts/misc/build-clang-8-android.sh
rename : taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-7-linux.sh => taskcluster/scripts/misc/build-clang-8-linux.sh
rename : taskcluster/scripts/misc/build-clang-trunk-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
extra : moz-landing-system : lando
2019-04-02 02:18:10 +00:00
Noemi Erli c479fa48df Backed out changeset 0d8cf467ed34 (bug 1538060) for Toolchains bustages CLOSED TREE
--HG--
rename : build/build-clang/clang-8-android.json => build/build-clang/clang-7-android.json
rename : build/build-clang/clang-8-linux64.json => build/build-clang/clang-7-linux64.json
rename : build/build-clang/clang-8-macosx64.json => build/build-clang/clang-7-macosx64.json
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-trunk-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-android.sh => taskcluster/scripts/misc/build-clang-7-android.sh
rename : taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-8-linux.sh => taskcluster/scripts/misc/build-clang-7-linux.sh
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-trunk-mingw.sh
2019-04-02 04:54:34 +03:00
Mike Hommey 0b2041f465 Bug 1538060 - Update non-Windows builds to clang 8. r=froydnj
Windows builds have been taken care of in bug 1535441.

Differential Revision: https://phabricator.services.mozilla.com/D25328

--HG--
rename : build/build-clang/clang-7-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-7-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-7-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : build/build-clang/clang-trunk-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-7-android.sh => taskcluster/scripts/misc/build-clang-8-android.sh
rename : taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-7-linux.sh => taskcluster/scripts/misc/build-clang-8-linux.sh
rename : taskcluster/scripts/misc/build-clang-trunk-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
extra : moz-landing-system : lando
2019-04-01 12:23:13 +00:00
Emilio Cobos Álvarez 1edac4dc48 Bug 1536582 - Update cbindgen. r=boris
Differential Revision: https://phabricator.services.mozilla.com/D25520

--HG--
extra : moz-landing-system : lando
2019-03-30 19:55:23 +00:00
Jacek Caban 970c738076 Bug 1536308 - Apply a local patch to MinGW to get the needed winrt stuff for ANGLE r=froydnj
We apply a local patch while we wait for upstream wine and mingw to review
the changes to widl that are necessary to generate the correct headers. Here we
just grab the generated headers and patch them into MinGW

We can revert this when MinGW updates, but for now we would like to unblock
the ANGLE update

Depends on D25294

Differential Revision: https://phabricator.services.mozilla.com/D25295

--HG--
extra : moz-landing-system : lando
2019-03-30 04:26:28 +00:00
Jacek Caban 39cc12375a Bug 1530493 - Bump mingw-w64 version r=froydnj
This is needed to bring dispatcherqueue.h in, which is needed for
an ANGLE upgrade. It also ensures that overloads for secure string
functions are always defined and removes redundant --enable-secure-api
configure option and use of MINGW_HAS_SECURE_API

Differential Revision: https://phabricator.services.mozilla.com/D25294

--HG--
extra : moz-landing-system : lando
2019-03-30 04:28:15 +00:00
Ciure Andrei 8a67ec169a Backed out 3 changesets (bug 1538060, bug 1539779, bug 1536790) for causing clang-tidy bustages CLOSED TREE
Backed out changeset 7d058f3174e5 (bug 1538060)
Backed out changeset 8839622122ed (bug 1539779)
Backed out changeset 9eb7867c1dd4 (bug 1536790)

--HG--
rename : build/build-clang/clang-8-android.json => build/build-clang/clang-7-android.json
rename : build/build-clang/clang-8-linux64.json => build/build-clang/clang-7-linux64.json
rename : build/build-clang/clang-8-macosx64.json => build/build-clang/clang-7-macosx64.json
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-trunk-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-android.sh => taskcluster/scripts/misc/build-clang-7-android.sh
rename : taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-8-linux.sh => taskcluster/scripts/misc/build-clang-7-linux.sh
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-trunk-mingw.sh
2019-03-30 01:52:37 +02:00
Andreea Pavel e9856466cd Bug 1538060 - Update non-Windows builds to clang 8.
Summary: Windows builds have been taken care of in bug 1535441.

Reviewers: froydnj

Reviewed By: froydnj

Subscribers: froydnj, sylvestre, rjl

Bug #: 1538060

Differential Revision: https://phabricator.services.mozilla.com/D25328

--HG--
rename : build/build-clang/clang-7-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-7-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-7-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : build/build-clang/clang-trunk-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-7-android.sh => taskcluster/scripts/misc/build-clang-8-android.sh
rename : taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-7-linux.sh => taskcluster/scripts/misc/build-clang-8-linux.sh
rename : taskcluster/scripts/misc/build-clang-trunk-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
extra : rebase_source : 4306240dd7bee404e83b6f0e651f4be0a1bfa165
extra : histedit_source : e569b2a5568d3aa2b9191b214947a8a11a3e06bf
2019-03-30 01:24:50 +02:00
Ciure Andrei 9fa2ff7bbe Backed out changeset dc3b81670b01 (bug 1538060) for causing clang-tidy bustages CLOSED TREE
--HG--
rename : build/build-clang/clang-8-android.json => build/build-clang/clang-7-android.json
rename : build/build-clang/clang-8-linux64.json => build/build-clang/clang-7-linux64.json
rename : build/build-clang/clang-8-macosx64.json => build/build-clang/clang-7-macosx64.json
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-trunk-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-android.sh => taskcluster/scripts/misc/build-clang-7-android.sh
rename : taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-8-linux.sh => taskcluster/scripts/misc/build-clang-7-linux.sh
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-trunk-mingw.sh
2019-03-30 00:36:40 +02:00
Mike Hommey 632b7eac9a Bug 1538060 - Update non-Windows builds to clang 8. r=froydnj
Windows builds have been taken care of in bug 1535441.

Differential Revision: https://phabricator.services.mozilla.com/D25328

--HG--
rename : build/build-clang/clang-7-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-7-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-7-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : build/build-clang/clang-trunk-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-7-android.sh => taskcluster/scripts/misc/build-clang-8-android.sh
rename : taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-7-linux.sh => taskcluster/scripts/misc/build-clang-8-linux.sh
rename : taskcluster/scripts/misc/build-clang-trunk-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
extra : moz-landing-system : lando
2019-03-29 21:37:37 +00:00
Oana Pop Rus d9ec36d04f Backed out 3 changesets (bug 1458385) for windows partial bustages. a=backout
Backed out changeset 8036c03c3b51 (bug 1458385)
Backed out changeset 99fa5539c2bd (bug 1458385)
Backed out changeset 9a5f255979c2 (bug 1458385)
2019-03-28 15:13:13 +02:00
Tom Prince fbb8603385 Bug 1458385: Package mar and mbsdiff as a toolchain; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D24229

--HG--
extra : moz-landing-system : lando
2019-03-27 22:30:44 +00:00
Kartikaya Gupta 08ce8aed17 Bug 1537734 - Update wrench android build to use offline mode in gradle. r=nalexander
The updated cargo-apk version now correctly handles the `--frozen` flag
and additionally translates it to the `--offline` flag when invoking
gradle. This makes the gradle build fail instead of attempting network
fetches. To make the offline gradle build work, we set up a build.gradle
snippet that points to the maven repositories from the gradle toolchain
artifact, and have cargo-apk use that instead of the default jcenter()
repository.

Differential Revision: https://phabricator.services.mozilla.com/D24485

--HG--
extra : moz-landing-system : lando
2019-03-24 15:34:17 +00:00
Kartikaya Gupta fb63ec3305 Bug 1537734 - Move the wrench android build out into a helper script. r=nalexander
No functional change here. This just extracts the existing script into a
helper file and shifts things around slightly so it's more logically
grouped (the env variables are needed for the cargo-apk invocation).
Also use better bash hygiene with variables.

Differential Revision: https://phabricator.services.mozilla.com/D24484

--HG--
extra : moz-landing-system : lando
2019-03-27 17:23:39 +00:00
Calixte Denizet 44a8c68d93 Bug 1519825 - Update grcov to revision 9214a916805838265764f9c69eaed657ea3db021 r=marco
This revision corresponds to grcov 0.4.2

Differential Revision: https://phabricator.services.mozilla.com/D16465

--HG--
extra : moz-landing-system : lando
2019-03-25 17:07:23 +00:00
Tom Prince b7b0abc340 Bug 1491371: [comm-task-env] Pass wrapped command name as argv[0]; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D24415

--HG--
rename : taskcluster/scripts/comm-task-env => taskcluster/docker/decision/comm-task-env
extra : moz-landing-system : lando
2019-03-21 20:05:56 +00:00
Mike Shal f06c5f664d Bug 632954 - Add support for MOZHARNESS_OPTIONS to test-linux.sh; r=tomprince
The mozharness.py transform passes in "options" parameters through the
MOZHARNESS_OPTIONS environment variable. This will allow the Android PGO
run task to pass in the mozharness script name to test-linux.sh

Differential Revision: https://phabricator.services.mozilla.com/D22822

--HG--
extra : source : 097f141a499d151e167c85dcb57e66aade7c28cb
2019-03-18 23:53:06 +00:00
Mike Shal a62630aabf Bug 632954 - Add execute bit to test-linux.sh; r=tomprince
In order to call test-linux.sh with the job-script parameter, it needs
to have executable permissions.

Differential Revision: https://phabricator.services.mozilla.com/D22821

--HG--
extra : source : 6f5fc0d644dd1eb83294ce41b2b47be44c2d9783
2019-03-18 23:53:01 +00:00
Noemi Erli b61340c4b0 Backed out 12 changesets (bug 632954) for causing Android Bpgo(run) pending jobs CLOSED TREE
Backed out changeset 429c96e4de32 (bug 632954)
Backed out changeset de8beacc5eb4 (bug 632954)
Backed out changeset c151ebf303ca (bug 632954)
Backed out changeset b96dd954a456 (bug 632954)
Backed out changeset 26031d362333 (bug 632954)
Backed out changeset 097f141a499d (bug 632954)
Backed out changeset 6f5fc0d644dd (bug 632954)
Backed out changeset 53d3443e55d9 (bug 632954)
Backed out changeset 503bcac73583 (bug 632954)
Backed out changeset 142ae187478d (bug 632954)
Backed out changeset 0615c775a0cf (bug 632954)
Backed out changeset 3dfc0e4f8e7c (bug 632954)
2019-03-20 11:58:18 +02:00
Bastien Abadie 9e0cc34738 Bug 1535355 - Add clang-tidy & clang-format in CI for code-review, r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D23524

--HG--
extra : moz-landing-system : lando
2019-03-19 14:42:32 +00:00
Mike Shal b63bf70e42 Bug 632954 - Add support for MOZHARNESS_OPTIONS to test-linux.sh; r=tomprince
The mozharness.py transform passes in "options" parameters through the
MOZHARNESS_OPTIONS environment variable. This will allow the Android PGO
run task to pass in the mozharness script name to test-linux.sh

Differential Revision: https://phabricator.services.mozilla.com/D22822

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:06 +00:00
Mike Shal 3729df6ca6 Bug 632954 - Add execute bit to test-linux.sh; r=tomprince
In order to call test-linux.sh with the job-script parameter, it needs
to have executable permissions.

Differential Revision: https://phabricator.services.mozilla.com/D22821

--HG--
extra : moz-landing-system : lando
2019-03-18 23:53:01 +00:00
Rob Lemley d7db4546d1 Bug 1491371 - Pin comm branches to mozilla revs without .taskcluster.yml. r=tomprince,dustin
comm-task-env runs before run-task and updates the environment with GECKO_*
variables that are defined in a file at the root of the comm repository,
".gecko_rev.yml". run-task needs these variables to be set to find the
correct mozilla repository to check out for a particular TB build.

The current pinning method of updating ".taskcluster.yml" with the mozilla
repository and revision to pin tois no longer supported.

Differential Revision: https://phabricator.services.mozilla.com/D16783

--HG--
extra : moz-landing-system : lando
2019-03-18 22:19:38 +00:00
Nathan Froyd 2cf028fbc4 Bug 1451104 - part 6 - don't remove the libstdc++ files from the mingw build; r=glandium
History does not disclose why we needed this, but in the brave new GCC
6-compiled world, deleting these files means that host links can no
longer find libstdc++, which causes problems.  Let's put the files back.

Differential Revision: https://phabricator.services.mozilla.com/D22884

--HG--
extra : moz-landing-system : lando
2019-03-15 01:29:33 +00:00
Nathan Froyd 116083d76a Bug 1451104 - part 4 - sync up gcc-related toolchains and linux64-binutils binutils version; r=glandium
We're going to copy an x86_64-unknown-linux-gnu ld into the clang build,
which clang will then use in preference to things on PATH.  We therefore
need to ensure that this ld is the same ld as would be used for other
builds, such as PGO.  This change is the most expedient way to do that;
future work will make the gcc job(s) depend on linux64-binutils directly.

Differential Revision: https://phabricator.services.mozilla.com/D22882

--HG--
extra : moz-landing-system : lando
2019-03-15 01:29:14 +00:00
Nathan Froyd 1d99a85b72 Bug 1535350 - remove win32-clang-tidy job; r=dmajor
Updating clang indicates that 32-bit compilation is substantially longer
than 64-bit compilation, perhaps due to swapping.  The compilation
process is hitting the timeout limit shortly before the compilation
process completes (~3681/3695 tasks according to ninja).

We could tweak our clang build process to accommodate this job.  But we
don't support building on 32-bit Windows anymore, and we don't produce a
32-bit Windows clang either.  So we shouldn't support a 32-bit Windows
clang-tidy job either.  Let's get rid of it.

Differential Revision: https://phabricator.services.mozilla.com/D23517

--HG--
extra : moz-landing-system : lando
2019-03-14 20:28:48 +00:00
Gurzau Raul c3883e46f7 Backed out 6 changesets (bug 1451104) for toolchains bustage on a CLOSED TREE.
Backed out changeset 2f6199beeb71 (bug 1451104)
Backed out changeset 7c116f85ede6 (bug 1451104)
Backed out changeset 5179c8066914 (bug 1451104)
Backed out changeset 675f73d41eb4 (bug 1451104)
Backed out changeset c64bfaad8a2f (bug 1451104)
Backed out changeset 991777e081ff (bug 1451104)
2019-03-14 05:02:44 +02:00
Nathan Froyd 79e81b7326 Bug 1451104 - part 6 - don't remove the libstdc++ files from the mingw build; r=glandium
History does not disclose why we needed this, but in the brave new GCC
6-compiled world, deleting these files means that host links can no
longer find libstdc++, which causes problems.  Let's put the files back.

Depends on D22883

Differential Revision: https://phabricator.services.mozilla.com/D22884

--HG--
extra : moz-landing-system : lando
2019-03-12 00:27:26 +00:00
Nathan Froyd d0cfab31be Bug 1451104 - part 4 - sync up gcc-related toolchains and linux64-binutils binutils version; r=glandium
We're going to copy an x86_64-unknown-linux-gnu ld into the clang build,
which clang will then use in preference to things on PATH.  We therefore
need to ensure that this ld is the same ld as would be used for other
builds, such as PGO.  This change is the most expedient way to do that;
future work will make the gcc job(s) depend on linux64-binutils directly.

Depends on D22881

Differential Revision: https://phabricator.services.mozilla.com/D22882

--HG--
extra : moz-landing-system : lando
2019-03-12 00:25:33 +00:00
Dustin J. Mitchell 1fded4473e Bug 1508381 - use rootUrl style with taskcluster-proxy r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D18023

--HG--
extra : moz-landing-system : lando
2019-03-12 20:38:42 +00:00
Mike Hommey b0f3ca8044 Bug 1490573 - Use fetches for nsis and wine toolchain tasks. r=froydnj
These toolchain tasks are the last ones using the historical
download-tools script from build/unix/build-gcc, which invokes gpg to
validate the downloaded tarballs. The consequence is that gpg-agent is
spawned and stays running, preventing a cleanup script from doing its
job, making the tasks fail.

Fetches are the new way to download sources, and can also do gpg
validation without those caveats.

The download-tools.sh script can then be removed as it's not used
anymore.

Differential Revision: https://phabricator.services.mozilla.com/D22682

--HG--
extra : moz-landing-system : lando
2019-03-11 01:38:46 +00:00
Kartikaya Gupta 1889f4e164 Bug 1532284 - Build wrench on Android. r=glandium
Depends on D22377

Differential Revision: https://phabricator.services.mozilla.com/D22378

--HG--
extra : moz-landing-system : lando
2019-03-08 00:37:46 +00:00
Gregory Mierzwinski 153a327822 Bug 1476372 - Add fetch tasks for raptor chromium builds. r=rwood,glandium,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D21372

--HG--
extra : moz-landing-system : lando
2019-03-06 19:45:34 +00:00
Emilio Cobos Álvarez 9b1323a3ae Bug 1533142 - Update min cbindgen version. r=jrmuizel,kats
Differential Revision: https://phabricator.services.mozilla.com/D22381

--HG--
extra : moz-landing-system : lando
2019-03-06 22:31:57 +00:00
Steve Fink b8306b2633 Bug 1531234 - Write JS test structured logs to main_raw.log instead of intermixing them in stdout r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D21483

--HG--
extra : moz-landing-system : lando
2019-03-01 18:19:40 +00:00
Thomas Daede 2e3619211c Bug 1520163 - Add linux64-nasm toolchain. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D20037

--HG--
extra : moz-landing-system : lando
2019-02-25 21:10:41 +00:00
Steve Fink d06b59a48d Bug 1527777 - Move spidermonkey jobs from win32 to win64 r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D20619

--HG--
extra : moz-landing-system : lando
2019-02-22 09:33:02 +00:00
Ciure Andrei ea1096a1f5 Backed out changeset e9e880f7aee4 (bug 1520163) for failing nightly builds a=backout
--HG--
extra : amend_source : 49a3d640d1784faa6a017315a73b94c109c64aa5
2019-02-25 11:36:37 +02:00
Thomas Daede 3484d62a4b Bug 1520163 - Add linux64-nasm toolchain. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D20037

--HG--
extra : moz-landing-system : lando
2019-02-22 21:52:41 +00:00
Ciure Andrei 0497e5f2f4 Backed out changeset e89b6e3d3de8 (bug 1520163) for profile-guided optimization builds bustage CLOSED TREE 2019-02-22 23:27:42 +02:00
Thomas Daede 4602595bb6 Bug 1520163 - Add linux64-nasm toolchain. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D20037

--HG--
extra : moz-landing-system : lando
2019-02-22 20:41:20 +00:00
Andreea Pavel 86ca08bb6b Backed out changeset fe259096e7ed (bug 1529033) for failing toolchains on a CLOSED TREE 2019-02-20 16:19:23 +02:00
David Major ef4b7f86ac Bug 1529033 - Update gn build to pick up MSVC /WX fix r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D20375

--HG--
extra : moz-landing-system : lando
2019-02-20 05:00:28 +00:00
Mike Hommey 901d68ed91 Bug 1519816 - Simplify build-custom-v8 script and avoid installing packages during build. r=sparky
The build script currently is doing some unnecessary steps:
- Running `gclient` only prints out an help message. It is a step
indicated in various documentations, but is only necessary to keep
depot-tools up-to-date, which they are, since we just cloned it.
- The `fetch v8` command creates a v8 directory, no need to create
another layer.
- `gclient sync` is run as part of `fetch`. Same as `gclient`, this step
is only given in documentations to keep things up-to-date on an existing
clone, but we just freshly got one.
- Same goes for `git pull && gclient sync`
- `git checkout master` is not necessary, as `fetch` gets us there
already (albeit, in a detached head state)
- install-build-deps.sh installs build dependencies for chrome or
whatever. That's way too much for v8, that barely needs pkg-config and
glib, which we now install in the docker image.

Differential Revision: https://phabricator.services.mozilla.com/D20082
2019-02-20 07:45:47 +09:00
Mike Hommey 8d9ccce339 Bug 1528150 - Build gn from https://gn.googlesource.com/gn/. r=froydnj
Make some adjustments to make the build work:
- On Linux, a newer GCC is needed, and -lrt is missing for
  clock_gettime.
- On Mac, ninja expect AR be accept ar arguments, which clang doesn't,
  so use llvm-ar.
- On Windows, remove the /WX flag that upstream sets (warnings as
  errors) because there _are_ warnings in the code, and remove the
  explicit /MACHINE:x64 linker flag because we're building for x86.
  (we could build for x64, but I'd rather leave that to a followup)

Differential Revision: https://phabricator.services.mozilla.com/D19911
2019-02-16 07:22:36 +09:00
Mike Hommey 87cc8cdde5 Bug 1527798 - Kill mspdbsrv at the end of gn build. r=froydnj
It keeps running and prevents the worker from unmounting, failing the
task.

Differential Revision: https://phabricator.services.mozilla.com/D19910
2019-02-16 07:22:35 +09:00
Mike Hommey 353eb51c20 Bug 1527798 - Upgrade toolchain tasks using MSVC to 15.8.4. r=froydnj
It turns out version 15.4.2 spawns a vctip process that sticks after the
build, and since bug 1527798, that breaks unmounting caches because the
process has a handle on msvcp140.dll, which lies in the source
directory. The problem goes away with 15.8.4, so upgrade all toolchain
tasks to that.

That's the same version as we're using on x86/x86-64 MSVC builds.

Differential Revision: https://phabricator.services.mozilla.com/D19752
2019-02-16 07:22:34 +09:00
Mike Hommey f70fc6ed56 Backout changesets cdefcc66972a, 1527e2d84ff9 (bug 1527798), ac565cc75295 (bug 1431523) and 0605b508a2c6 (bug 1528150)
to give time to docker images and toolchains to build.


--HG--
rename : taskcluster/docker/debian-raw/cloud-mirror-workaround.sh => taskcluster/docker/debian-base/cloud-mirror-workaround.sh
rename : taskcluster/docker/debian-raw/setup_packages.sh => taskcluster/docker/debian-base/setup_packages.sh
2019-02-16 00:38:13 +09:00
Mike Hommey 36613706a4 Bug 1528150 - Build gn from https://gn.googlesource.com/gn/. r=froydnj
Make some adjustments to make the build work:
- On Linux, a newer GCC is needed, and -lrt is missing for
  clock_gettime.
- On Mac, ninja expect AR be accept ar arguments, which clang doesn't,
  so use llvm-ar.
- On Windows, remove the /WX flag that upstream sets (warnings as
  errors) because there _are_ warnings in the code, and remove the
  explicit /MACHINE:x64 linker flag because we're building for x86.
  (we could build for x64, but I'd rather leave that to a followup)

Differential Revision: https://phabricator.services.mozilla.com/D19911
2019-02-16 00:33:29 +09:00
Mike Hommey 0f1d72a827 Bug 1527798 - Kill mspdbsrv at the end of gn build. r=froydnj
It keeps running and prevents the worker from unmounting, failing the
task.

Differential Revision: https://phabricator.services.mozilla.com/D19910
2019-02-16 00:33:03 +09:00
Mike Hommey cbec6eb233 Bug 1527798 - Upgrade toolchain tasks using MSVC to 15.8.4. r=froydnj
It turns out version 15.4.2 spawns a vctip process that sticks after the
build, and since bug 1527798, that breaks unmounting caches because the
process has a handle on msvcp140.dll, which lies in the source
directory. The problem goes away with 15.8.4, so upgrade all toolchain
tasks to that.

That's the same version as we're using on x86/x86-64 MSVC builds.

Differential Revision: https://phabricator.services.mozilla.com/D19752
2019-02-16 00:31:55 +09:00
Kartikaya Gupta 56bd94dd33 Bug 1516568 - Add jobs to cross-compile cargo test binaries and run them on macOS. r=glandium
Similar to the previous patch, this adds two jobs. One that
cross-compiles the binaries produced by `cargo test` and publishes them
as an artifact. The other job downloads the artifact and runs the
resulting binaries.

Differential Revision: https://phabricator.services.mozilla.com/D19370

--HG--
extra : source : 79120d13e713114032263c0851455ec5f981d72c
2019-02-15 01:32:21 +00:00
Kartikaya Gupta 10e1acc2e9 Bug 1516568 - Add jobs to cross-compile wrench and use the resulting binaries. r=glandium
One job (which runs on a Linux docker worker) cross compiles wrench in
two configurations (regular and headless) and publishes artifacts with
the binaries. The other job (which runs on macOS) downloads the
artifacts and uses them to run the WebRender macOS CI release-mode
scripts, which basically consists of running the WebRender reftest
suite.

Differential Revision: https://phabricator.services.mozilla.com/D19369

--HG--
extra : source : 028c0ed368b844a4e54f3c38177b0fe65211d484
2019-02-15 01:32:16 +00:00
Kartikaya Gupta 3674245c97 Bug 1516568 - Provide path to python executable when invoking fetch-content script. r=ahal
The shebang at the top of fetch-content doesn't work on macOS because
the path to python3 is not /usr/bin. Using /usr/bin/env doesn't work
properly on all platforms either so instead we invoke the script using
the currently running python executable.

Differential Revision: https://phabricator.services.mozilla.com/D19744

--HG--
extra : source : f6413e576a2169855f766085704570c9fc851ee2
2019-02-15 01:30:48 +00:00
Dorel Luca b73b2c4f67 Backed out 7 changesets (bug 1516568) for Docker and Toolchain failures. CLOSED TREE
Backed out changeset 79120d13e713 (bug 1516568)
Backed out changeset 028c0ed368b8 (bug 1516568)
Backed out changeset f06721b552a8 (bug 1516568)
Backed out changeset ee403c79877e (bug 1516568)
Backed out changeset 8990eef6c31e (bug 1516568)
Backed out changeset f6413e576a21 (bug 1516568)
Backed out changeset e9f887f489e5 (bug 1516568)
2019-02-15 05:16:55 +02:00
Kartikaya Gupta ad84b74ed1 Bug 1516568 - Add jobs to cross-compile cargo test binaries and run them on macOS. r=glandium
Similar to the previous patch, this adds two jobs. One that
cross-compiles the binaries produced by `cargo test` and publishes them
as an artifact. The other job downloads the artifact and runs the
resulting binaries.

Differential Revision: https://phabricator.services.mozilla.com/D19370

--HG--
extra : moz-landing-system : lando
2019-02-15 01:32:21 +00:00
Kartikaya Gupta dc62fcc29a Bug 1516568 - Add jobs to cross-compile wrench and use the resulting binaries. r=glandium
One job (which runs on a Linux docker worker) cross compiles wrench in
two configurations (regular and headless) and publishes artifacts with
the binaries. The other job (which runs on macOS) downloads the
artifacts and uses them to run the WebRender macOS CI release-mode
scripts, which basically consists of running the WebRender reftest
suite.

Differential Revision: https://phabricator.services.mozilla.com/D19369

--HG--
extra : moz-landing-system : lando
2019-02-15 01:32:16 +00:00
Kartikaya Gupta a03acb6831 Bug 1516568 - Provide path to python executable when invoking fetch-content script. r=ahal
The shebang at the top of fetch-content doesn't work on macOS because
the path to python3 is not /usr/bin. Using /usr/bin/env doesn't work
properly on all platforms either so instead we invoke the script using
the currently running python executable.

Differential Revision: https://phabricator.services.mozilla.com/D19744

--HG--
extra : moz-landing-system : lando
2019-02-15 01:30:48 +00:00
Thomas Daede 3fcd2d85d2 Bug 1511224 - Add win64-nasm toolchain. r=ted,jya,glandium
Differential Revision: https://phabricator.services.mozilla.com/D13875

--HG--
extra : moz-landing-system : lando
2019-02-14 21:30:22 +00:00
Dorel Luca 72ca9e0f17 Backed out changeset fe264afc03aa (bug 1511224) for Fetch failures. CLOSED TREE 2019-02-14 20:44:38 +02:00
Thomas Daede ce727c14e7 Bug 1511224 - Add win64-nasm toolchain. r=ted,jya,glandium
Differential Revision: https://phabricator.services.mozilla.com/D13875

--HG--
extra : moz-landing-system : lando
2019-02-14 17:11:57 +00:00
Steve Fink 1150832058 Bug 1500247 - Add a mechanism to embed known hazards into test files and verify that they are caught, r=jonco
Use it to verify that MOZ_INHERIT_ATTRIBUTE_FROM_TEMPLATE_PARAM works.

--HG--
extra : rebase_source : cb0d6d901d723274053988cdf70fedd92504e40e
2018-12-28 21:13:32 -08:00
Emilio Cobos Álvarez 7e29cc1765 Bug 1523071 - Update cbindgen. r=glandium,jwatt
Gonna need it to use https://github.com/eqrion/cbindgen/pull/275.

Differential Revision: https://phabricator.services.mozilla.com/D17736
2019-02-10 04:09:54 +01:00
Emilio Cobos Álvarez da05bafa94 Bug 1394825 - Update minimum clang version to 4.0. r=glandium
libclang 3.9 has a bug that makes bindgen unable to distinguish some typedefs
from the underlying type, which matters for bug 1523071.

We have had quite a few workarounds for this bug and I don't really want to add
more, since in this case it is non-trivial. I think requiring libclang 4.0+ is
reasonable at this point.

Of the distros that can't build Firefox out of the box with clang, dropping support
for clang 3.9 would only break Ubuntu 14.04 LTS, which support ends April 2019,
right before we release 67.

Differential Revision: https://phabricator.services.mozilla.com/D18889

--HG--
rename : build/build-clang/clang-3.9-linux64.json => build/build-clang/clang-4.0-linux64.json
rename : taskcluster/scripts/misc/build-clang-3.9-linux.sh => taskcluster/scripts/misc/build-clang-4.0-linux.sh
extra : moz-landing-system : lando
2019-02-10 02:56:13 +00:00
Nathan Froyd c7e74390d2 Bug 1525069 - part 1 - add a node repack task for 32-bit Windows; r=nalexander
We don't use this in automation, but people who develop on AArch64
Windows will be happy we're providing Node for them.
2019-02-05 16:15:58 -05:00
Daniel Varga 69ace4b45f Backed out 3 changesets (bug 1525069) for linting failure at /builds/worker/checkouts/gecko/python/mozboot/mozboot/mozillabuild.p on a CLOSED TREE
Backed out changeset 1a41624ff365 (bug 1525069)
Backed out changeset ef7b4d60481f (bug 1525069)
Backed out changeset 898be859c1a4 (bug 1525069)
2019-02-04 23:50:08 +02:00
Nathan Froyd 383b7a52cf Bug 1525069 - part 1 - add a node repack task for 32-bit Windows; r=nalexander
We don't use this in automation, but people who develop on AArch64
Windows will be happy we're providing Node for them.
2019-02-04 16:32:17 -05:00
arthur.iakab c152ccec1d Backed out 4 changesets (bug 1508381) for multiple Windows build bustages CLOSED TREE
Backed out changeset f01cec6f712e (bug 1508381)
Backed out changeset ba69e59924de (bug 1508381)
Backed out changeset 97fe4e5a665e (bug 1508381)
Backed out changeset 0c3065c12bef (bug 1508381)
2019-01-31 23:14:11 +02:00
Dustin J. Mitchell 22fcbfc133 Bug 1508381 - use rootUrl style with taskcluster-proxy r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D18023

--HG--
extra : moz-landing-system : lando
2019-01-30 18:58:09 +00:00
Mike Hommey 7499c701a0 Fixup webrender-windows job after bug 1523201. r=me 2019-01-29 17:10:37 +09:00
Tom Ritter 4618468d6a Bug 1518989 - Bump MinGW to get D3D constant fix. r=froydnj 2019-01-12 19:11:17 -06:00
Tom Ritter 81f8c1c716 Bug 1518544 - Bump the default value of _WIN32_WINNT in the mingw-clang toolchain to 0x601. r=froydnj 2019-01-13 00:25:18 -06:00
Emilio Cobos Álvarez d133439037 Bug 1519501 - Update min cbindgen version. r=dmajor
We need this to properly generate the WR bindings.

Also update the comment since the check was recently moved.

Differential Revision: https://phabricator.services.mozilla.com/D16398
2019-01-14 13:44:27 +01:00
Dorel Luca 5524f7b7d5 Bug 1391408 - Add missing executable bit r=glandium. CLOSED TREE
--HG--
extra : amend_source : deab4b7c47edd5adeda44661c3178dca01f056f7
2019-01-12 01:52:24 +02:00
Mike Hommey bd810a1c0d Bug 1391408 - Build minidump_stackwalk as a toolchain. r=froydnj
This produces the same executables (produced for the same platforms) as
those currently pulled from tooltool (modulo timestamps, maybe changes
since last manifest change, etc.). Unfortunately, as of currently, the
Windows variant needs to be cross-built with mingw because it doesn't
compile without some POSIX APIs that MSVC/Windows SDK don't provide.

One thing that is left out of this change is whether to be completely
accurate with the toolchain cache hash (requiring a large list of files
as resources, and making those built very frequently), whether we'd
rely on manual updates, or if we should go with completely uncached
tasks. This can be left for a followup, the tasks not being hooked up
to be actually used by other tasks yet.

Differential Revision: https://phabricator.services.mozilla.com/D16302

--HG--
extra : moz-landing-system : lando
2019-01-11 22:29:35 +00:00
Mike Shal 8e7f2fc16c Bug 1507334 - Taskcluster configurations for 3-tier PGO; r=tomprince,firefox-build-system-reviewers,chmanchester#firefox-build-system-reviewers
Two new kinds are introduced - 'instrumented-build' and
'generate-profile'. The instrumented-build kind is almost identical to
the build kind, except it can be used earlier in the task graph. The
3-tier PGO process becomes:

instrumented-build -> generate-profile -> build

The final build stage is identical to any other build, except it has
the 'use-pgo' flag set to True in its task definition. This flag causes
the transforms to add the instrumented-build and generate-profile tasks
to the taskgraph.

Differential Revision: https://phabricator.services.mozilla.com/D15750

--HG--
extra : moz-landing-system : lando
2019-01-10 01:34:58 +00:00
Kartikaya Gupta 684b20393f Bug 1508828 - Add a task to run standalone WebRender CI scripts on Windows. r=glandium,jrmuizel
Differential Revision: https://phabricator.services.mozilla.com/D15412

--HG--
extra : moz-landing-system : lando
2019-01-08 14:15:30 +00:00
Gregory Szorc 7db2ec0def Bug 1512188 - Consolidate VCS checkout from args logic; r=tomprince,dustin
We create a minimal wrapper function to call collect_vcs_options()
and vcs_checkout().

We could consolidate this logic into vcs_checkout(). But I don't have
strong feelings about doing that.

Differential Revision: https://phabricator.services.mozilla.com/D13821

--HG--
extra : moz-landing-system : lando
2018-12-31 18:50:34 +00:00
Gregory Szorc 2bf175f722 Bug 1512188 - Collect hg store path in collect_vcs_options(); r=tomprince,dustin
One step closer to making all state gathering and normalization in one
place.

Differential Revision: https://phabricator.services.mozilla.com/D13819

--HG--
extra : moz-landing-system : lando
2018-12-31 18:54:14 +00:00
Gregory Szorc 952e5d5655 Bug 1512188 - Move base repo normalization into collect_vcs_options(); r=tomprince,dustin
This is a generic normalization and doesn't need to be Firefox
specific.

Differential Revision: https://phabricator.services.mozilla.com/D13817

--HG--
extra : moz-landing-system : lando
2018-12-31 18:54:31 +00:00
Gregory Szorc 426f2868cd Bug 1512188 - Collect environment variables into VCS options; r=tomprince,dustin
This makes behavior consistent across all VCS checkouts. I'm still not
a fan of using environment variables here. But at least this gets us
1 step closer to being able to plug alternate logic in without having
to update use of environment variables outside a single function.

Differential Revision: https://phabricator.services.mozilla.com/D13816

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:32 +00:00
Gregory Szorc b809920807 Bug 1512188 - make VCS checkout options generic; r=tomprince,dustin
We currently manage VCS checkout arguments as one-offs for each
project. This isn't scalable and results in a bit of copy-pasta.

Let's make the VCS checkout arguments generic so we can have the
same control for all repositories.

This commit focuses on consolidating the existing argument parser
code. It stops short of further unification, which will be done in
subsequent commits.

Differential Revision: https://phabricator.services.mozilla.com/D13815

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:30 +00:00
Tom Prince 94212a8c9a Bug 1512285: Stop checking out tools; r=nthomas,gps
This code was used by mozharness jobs to check out the tools repo.
However, those jobs aren't actually using the repository.

Differential Revision: https://phabricator.services.mozilla.com/D13855

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:28 +00:00
Gregory Szorc 1693cc73d8 Bug 1512188 - Rename --sparse-profile to --gecko-sparse-profile; r=tomprince,dustin
We have multiple source checkouts. --sparse-profile is ambiguous
as to which one it could refer to. Let's rename the argument so it
is prefixed with the repo/project we are checking out.

Differential Revision: https://phabricator.services.mozilla.com/D13814

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:26 +00:00
Gregory Szorc fe09099db1 Bug 1512188 - Rename --vcs-checkout to --gecko-checkout; r=tomprince,dustin
We now have multiple things we may check out. "vcs" meaning "gecko"
is not obvious. Let's change the terminology to be more specific.

Differential Revision: https://phabricator.services.mozilla.com/D13813

--HG--
extra : moz-landing-system : lando
2018-12-31 18:51:27 +00:00
Bogdan Tara 8fb34de423 Backed out 8 changesets (bug 1512285, bug 1512188) for fetch bustages CLOSED TREE
Backed out changeset 5e7aa7d98012 (bug 1512188)
Backed out changeset 55874a956ae1 (bug 1512188)
Backed out changeset ac6e2cd6eb32 (bug 1512188)
Backed out changeset f68df074eac1 (bug 1512188)
Backed out changeset f01d2662582f (bug 1512188)
Backed out changeset 35d74dd16706 (bug 1512285)
Backed out changeset 9e95b9bf1201 (bug 1512188)
Backed out changeset ac4a49eb95f5 (bug 1512188)
2018-12-29 07:56:56 +02:00
Gregory Szorc 555c86c76d Bug 1512188 - Consolidate VCS checkout from args logic; r=tomprince,dustin
We create a minimal wrapper function to call collect_vcs_options()
and vcs_checkout().

We could consolidate this logic into vcs_checkout(). But I don't have
strong feelings about doing that.

Differential Revision: https://phabricator.services.mozilla.com/D13821

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:45 +00:00
Gregory Szorc d87b04a55a Bug 1512188 - Collect hg store path in collect_vcs_options(); r=tomprince,dustin
One step closer to making all state gathering and normalization in one
place.

Differential Revision: https://phabricator.services.mozilla.com/D13819

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:38 +00:00
Gregory Szorc 7d0932f16a Bug 1512188 - Move base repo normalization into collect_vcs_options(); r=tomprince,dustin
This is a generic normalization and doesn't need to be Firefox
specific.

Differential Revision: https://phabricator.services.mozilla.com/D13817

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:36 +00:00
Gregory Szorc 8fb6cd08a8 Bug 1512188 - Collect environment variables into VCS options; r=tomprince,dustin
This makes behavior consistent across all VCS checkouts. I'm still not
a fan of using environment variables here. But at least this gets us
1 step closer to being able to plug alternate logic in without having
to update use of environment variables outside a single function.

Differential Revision: https://phabricator.services.mozilla.com/D13816

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:28 +00:00
Gregory Szorc 17d3010722 Bug 1512188 - make VCS checkout options generic; r=tomprince,dustin
We currently manage VCS checkout arguments as one-offs for each
project. This isn't scalable and results in a bit of copy-pasta.

Let's make the VCS checkout arguments generic so we can have the
same control for all repositories.

This commit focuses on consolidating the existing argument parser
code. It stops short of further unification, which will be done in
subsequent commits.

Differential Revision: https://phabricator.services.mozilla.com/D13815

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:26 +00:00
Tom Prince d5999f77d3 Bug 1512285: Stop checking out tools; r=nthomas,gps
This code was used by mozharness jobs to check out the tools repo.
However, those jobs aren't actually using the repository.

Differential Revision: https://phabricator.services.mozilla.com/D13855

--HG--
extra : moz-landing-system : lando
2018-12-29 05:22:38 +00:00
Gregory Szorc 8c1a7bccef Bug 1512188 - Rename --sparse-profile to --gecko-sparse-profile; r=tomprince,dustin
We have multiple source checkouts. --sparse-profile is ambiguous
as to which one it could refer to. Let's rename the argument so it
is prefixed with the repo/project we are checking out.

Differential Revision: https://phabricator.services.mozilla.com/D13814

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:17 +00:00
Gregory Szorc 8fc5669189 Bug 1512188 - Rename --vcs-checkout to --gecko-checkout; r=tomprince,dustin
We now have multiple things we may check out. "vcs" meaning "gecko"
is not obvious. Let's change the terminology to be more specific.

Differential Revision: https://phabricator.services.mozilla.com/D13813

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:09 +00:00