Граф коммитов

60 Коммитов

Автор SHA1 Сообщение Дата
Narcis Beleuzu 51c3c369dd Backed out changeset 0a1edd15b210 (bug 1634204) for valgrind bustages. CLOSED TREE 2020-05-06 17:10:37 +03:00
Mike Hommey 87df0b2d72 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 07:35:52 +00:00
Narcis Beleuzu 845e286da1 Backed out changeset b4d73278792e (bug 1634204) as per glandium req. 2020-05-06 10:33:08 +03:00
Mike Hommey 80e8586858 Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-06 04:56:14 +00:00
Csoregi Natalia dc4560dcaa Backed out changeset 2bf3343d2994 (bug 1634204) as per request. CLOSED TREE 2020-05-06 07:24:07 +03:00
Mike Hommey d0b2cc67af Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj
This gets rid for the need of a number of local packages (mostly related
to Gtk+3). One exception is that we now need a 32-bits version of the
xz-utils package, some -dev package depends on it, and that dependency
can't be fulfilled in the 32-bits image because we already have the
64-bits backport installed, which conflicts with it (we need both
32-bits and 64-bits package to be at the same version when installed).

The system binutils fails to link clang-7 for some reason, so we now use
our toolchain binutils instead, like we already do for newer versions of
clang.

The debian-packages docker image now needs an explicit installation of
git, because it's not pulled in via the recommends of some other
package.

For some reason, snapshot.debian.org doesn't contain the jessie-backports
archive at the same location as others, and only has a few snapshots of
the archive.

Differential Revision: https://phabricator.services.mozilla.com/D73784
2020-05-05 12:13:27 +00:00
David Major 8aae4415b9 Bug 1628036 - Use linux64-binutils in the mac instrumented build r=glandium
This is needed so we have a workable ld for building host libraries. Prior to my patch in bug 1326486, we had been getting an ld in the clang package by accident, since 1-stage builds had the wrong value of `is_final_stage` here: https://searchfox.org/mozilla-central/rev/4d2a9d5dc8f0e65807ee66e2b04c64596c643b7a/build/build-clang/build-clang.py#162-170

Since the build-clang comment says "we expect any consumers of the newly-built toolchain to provide an appropriate ld themselves", I'm doing so in this patch.

Differential Revision: https://phabricator.services.mozilla.com/D70054

--HG--
extra : moz-landing-system : lando
2020-04-07 22:34:40 +00:00
Mike Hommey 32bf570594 Bug 1618782 - Use winchecksec on Windows cross builds too. r=rstewart
Differential Revision: https://phabricator.services.mozilla.com/D68162

--HG--
extra : moz-landing-system : lando
2020-03-27 10:41:06 +00:00
Mike Hommey b80ad1b15a Bug 1620166 - Switch shippable windows builds to cross builds. r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D67279

--HG--
extra : moz-landing-system : lando
2020-03-20 00:59:15 +00:00
Arthur Iakab 5c9d64d430 Backed out changeset a1a54431e6d6 (bug 1620166) for causing beetmover exeptions Bug 1623616 a=backout 2020-03-19 16:33:03 +02:00
Mike Hommey 75be07d957 Bug 1620166 - Switch shippable windows builds to cross builds. r=dmajor
Differential Revision: https://phabricator.services.mozilla.com/D67279

--HG--
extra : moz-landing-system : lando
2020-03-18 23:56:31 +00:00
Tom Prince 776a84e980 Bug 1527313: Enable caching on windows builds; r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D62485

--HG--
extra : moz-landing-system : lando
2020-03-06 09:17:54 +00:00
Tom Prince fa69ebf563 Bug 1527313: Move objdir out of source directory for all mozharness builds; r=glandium,Callek
This moves the object directory and source directories around in all mozharness
jobs, to allow enabling caching on windows builders.

This makes a number of changes that all need to land at once:
- Move the source checkout for the workspace cache mount, to the checkouts
  cache mount.
- Makes the object directoy from underneath the source directory, to directly
  in the work directory (which is still under `workspace`).
- Sets the object directory to `obj-build` instead of `obj-firefox`.
- Stops caching the workspace directory (it is still a volume in docker workers,
  so writes perform well; a followup revision add some checks around this).
- Removes one level of directory in the mozharness workdir (things were under
  `workspace/build`, but are now just under `workspace/`.
- Adjust paths in environment variables and artifact specifications to match
  the above changes.

Differential Revision: https://phabricator.services.mozilla.com/D62482

--HG--
extra : moz-landing-system : lando
2020-03-06 08:51:21 +00:00
Nathan Froyd 543b59831b Bug 1615595 - add lucetc and wasi-sysroot to Mac instrumented builds; r=firefox-build-system-reviewers,rstewart
Differential Revision: https://phabricator.services.mozilla.com/D62908

--HG--
extra : moz-landing-system : lando
2020-02-14 20:45:20 +00:00
Sebastian Hengst 18aefc612f Bug 1613958 - set correct treeherder platform names for macOS webrender and condprof tasks. r=chmanchester
Some webrender and condprof tasks on macOS had raw/'ugly' platform names and
were listed at the top of a treeherder push due to that and not together with
the other OS X tasks. With this patch applied, they are shown together with the
other tasks on that platform.

The platform name should reference either cross compile or the platform version
it is running on.

Differential Revision: https://phabricator.services.mozilla.com/D62051

--HG--
extra : moz-landing-system : lando
2020-02-07 20:48:13 +00:00
Nathan Froyd 14178935f1 Bug 1608428 - rename lucetc toolchain task; r=rstewart
We're going to build `lucetc` for other platforms; let's prefix this
task with the platform name like we do for other toolchains.

Differential Revision: https://phabricator.services.mozilla.com/D59498

--HG--
extra : moz-landing-system : lando
2020-01-10 16:21:40 +00:00
Edwin Takahashi b2e141b8ed Bug 1599197 - do not run linux32 on autoland or try by default r=jmaher,gbrown
Changes:

Do not run `linux32` builds on `try` or `autoland` by default, but ensure it is able to run on all other repos (eg. `mozilla-beta`).

Filter out all tasks with `linux-shippable` in the name, including builds, auxiliary tasks (balrog, etc).

Differential Revision: https://phabricator.services.mozilla.com/D58982

--HG--
extra : moz-landing-system : lando
2020-01-09 01:09:07 +00:00
Nathan Froyd 9be53fe0cd Bug 1605875 - add lucetc/wasi-sysroot toolchains to more linux64 builds; r=firefox-build-system-reviewers,rstewart
Some of these were busted in the initial push for wasm sandboxing; some
of these didn't break in that push, but seem likely to if/when we have
more complete coverage of turning on wasm sandboxing.

Differential Revision: https://phabricator.services.mozilla.com/D58200

--HG--
extra : moz-landing-system : lando
2019-12-26 14:19:00 +00:00
Chris Manchester fb4f4b357e Bug 1604578 - Enable pgo on macOS shippable builds. r=firefox-build-system-reviewers,mshal
Differential Revision: https://phabricator.services.mozilla.com/D57581

--HG--
extra : moz-landing-system : lando
2019-12-18 17:54:40 +00:00
Chris Manchester 0929dac033 Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-16 23:25:07 +00:00
Oana Pop Rus b49aefd3c9 Backed out 3 changesets (bug 1528374) for build bustages failures during artifact upload: file-missing-on-worker: Could not read directory /Users/task_1576213467/artifacts on a CLOSED TREE
Backed out changeset 3c2a1cf616b4 (bug 1528374)
Backed out changeset 967d0072cd2f (bug 1528374)
Backed out changeset 0d0186ecd70e (bug 1528374)
2019-12-16 23:50:45 +02:00
Chris Manchester 23e9c6d856 Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-13 05:43:44 +00:00
Eric Rahm 3122df4697 Bug 1594344 - Part 2: Fetch dump_syms toolchain on Windows builds. r=firefox-build-system-reviewers,chmanchester
This installs the rust-based `dump_syms` toolchain on Windows builds.

Differential Revision: https://phabricator.services.mozilla.com/D53319

--HG--
extra : moz-landing-system : lando
2019-12-13 10:27:30 +00:00
Noemi Erli 24e02f049b Backed out 3 changesets (bug 1528374) per tomprice's request for breaking macOS signing jobs CLOSED TREE
Backed out changeset 5a6fa3b5123b (bug 1528374)
Backed out changeset 32f3b1b3fe3b (bug 1528374)
Backed out changeset a412a319534c (bug 1528374)
2019-12-13 06:48:05 +02:00
Chris Manchester 3138b4cffd Bug 1528374 - Add macOS pgo builds to the taskgraph. r=firefox-build-system-reviewers,mshal,tomprince
Differential Revision: https://phabricator.services.mozilla.com/D20409

--HG--
extra : moz-landing-system : lando
2019-12-12 19:31:17 +00:00
Dorel Luca 682cfaa718 Backed out 3 changesets (bug 1594344) for Decision task failure on taskcluster/ci/toolchain/rust-size.yml. CLOSED TREE
Backed out changeset 3208e2b16458 (bug 1594344)
Backed out changeset 57b641bb4d4b (bug 1594344)
Backed out changeset 36458762149d (bug 1594344)

--HG--
rename : taskcluster/ci/toolchain/dump-syms.yml => taskcluster/ci/toolchain/rust-size.yml
rename : taskcluster/scripts/misc/build-dump-syms.sh => taskcluster/scripts/misc/build-rust-size.sh
2019-12-10 15:59:12 +02:00
Eric Rahm add4cfcb1e Bug 1594344 - Part 2: Fetch dump_syms toolchain on Windows builds. r=firefox-build-system-reviewers,chmanchester
This installs the rust-based `dump_syms` toolchain on Windows builds.

Differential Revision: https://phabricator.services.mozilla.com/D53319

--HG--
extra : moz-landing-system : lando
2019-12-10 13:37:09 +00:00
Mike Shal 43f8eb0fbd Bug 1557788 - Remove NEED_XVFB from Linux instrumented and rusttest builds; r=firefox-build-system-reviewers,chmanchester
xvfb was used to create a virtual framebuffer for running Firefox during
build jobs to support PGO profile generation. That now runs in a
separate task, so we don't need this flag for builds anymore.

Note that other Linux builds still need xvfb in order to run xpcshell in
'make check'.

Differential Revision: https://phabricator.services.mozilla.com/D56111

--HG--
extra : moz-landing-system : lando
2019-12-09 18:02:34 +00:00
Mike Shal bf9c8ef9a1 Bug 1599551 - Don't specify full crashreporter symbols for instrumented builds; r=froydnj
minidump_stackwalk doesn't care about full crashreporter symbols per
https://bugzilla.mozilla.org/show_bug.cgi?id=1593465#c30, so we can turn
off the attribute. The generate-profile task already hooks up to the
non-full crashreporter symbols.

Differential Revision: https://phabricator.services.mozilla.com/D54794

--HG--
extra : moz-landing-system : lando
2019-12-02 13:33:55 +00:00
Daniel Varga 98807fe5a2 Bug 1593465 - followup for busting gecko decision task. On a CLOSED TREE
--HG--
extra : rebase_source : 0483136a5ea4be8d10938372a7674254a6614af2
2019-11-22 07:15:22 +02:00
Daniel Varga c40b39b26d Bug 1593465 - Removing -full for causing build bustage from kind.yml and run_pgo_profile.py. On a CLOSED TREE
--HG--
extra : amend_source : 8ca7be097049e9edd26385716ab0c0cd7dc22c79
2019-11-22 06:53:28 +02:00
Mike Shal bca8fea099 Bug 1593465 - Dump symbols during instrumented builds for crashlogs in the run task; r=firefox-build-system-reviewers,chmanchester
To get an accurate backtrace if the run task crashes, we need the
symbols from the instrumented build.

Depends on D53716

Differential Revision: https://phabricator.services.mozilla.com/D53717

--HG--
extra : moz-landing-system : lando
2019-11-21 18:44:10 +00:00
Tom Prince 069263ab46 Bug 1595368: [firefox-ci] Use consitent logic to determine tooltool url; r=sfraser a=task-fix
Differential Revision: https://phabricator.services.mozilla.com/D52498

Depends on D52497

--HG--
extra : histedit_source : 4b7e40193155303d8757f08aabe670e4dd127924
2019-11-11 05:50:11 +01:00
Tom Prince c0945dfd53 Bug 1546801: [firefox-ci] Use taskcluster-proxy for windows builds' tooltool access; r=Callek a=tomprince CLOSED TREE
Differential Revision: https://phabricator.services.mozilla.com//D52471

--HG--
extra : histedit_source : a61b23e325340f4673cfe3c2a6f857023a2b4ab7
2019-11-10 01:25:19 +02:00
Tom Prince 065ccdcd35 Bug 1546801: [firefox-ci] Use taskcluster-proxy for windows builds' tooltool access; r=Callek a=tomprince CLOSED TREE
MANUAL PUSH: Fix windows tooltool failures in firefox-ci cluster.

Differential Revision: https://phabricator.services.mozilla.com/D52456

--HG--
extra : rebase_source : 1444058a60e72214986e3ac6151b5d00b38f300e
extra : amend_source : 6c44b9e8f0185f8023af04898df89079586a2b55
2019-11-09 15:19:55 -07:00
Ricky Stewart 5cb192aedf Fix Bug 1583368. Don't use sccache on dependencies of shippable builds r=froydnj,mshal,tomprince,catlee
Differential Revision: https://phabricator.services.mozilla.com/D46871

--HG--
extra : moz-landing-system : lando
2019-09-27 20:35:27 +00:00
Mike Shal 27c798ba32 Bug 1581612 - index instrumented builds; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D46053

--HG--
extra : moz-landing-system : lando
2019-09-18 17:12:36 +00:00
Mike Hommey ace4568daa Bug 1573435 - Use toolchain fetches for all remaining toolchain uses, part 2. r=nalexander
This part removes the use_toolchains transform, and adjusts all task
definitions accordingly.

Differential Revision: https://phabricator.services.mozilla.com/D41891

MANUAL PUSH: avoid closing autoland while docker images and toolchains
are rebuilt.
2019-08-15 11:22:23 +09:00
Mike Shal ff39c620e5 Bug 1560164 - Pull out common variables in instrumented-build/kind.yml; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D39240

--HG--
extra : moz-landing-system : lando
2019-07-24 23:28:12 +00:00
Mike Shal bd20bd66db Bug 1561144 - Add win32 PGO-instrumented task; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D35744

--HG--
extra : moz-landing-system : lando
2019-06-25 18:43:49 +00:00
Mike Shal fdda992909 Bug 1561147 - Add linux32 PGO-instrumented task; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D35886

--HG--
extra : moz-landing-system : lando
2019-06-26 15:30:10 +00:00
Mike Shal 3bdb950687 Bug 1557785 - Add win64 PGO-instrumented task; r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D34795

--HG--
extra : moz-landing-system : lando
2019-06-19 22:05:26 +00:00
Tom Prince 85e8be2031 Bug 1550816: Enforce consistent indenting in taskcluster yaml; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D30684

--HG--
extra : moz-landing-system : lando
2019-05-10 21:19:48 +00:00
Tom Prince e0ca5b4dd8 Bug 1532783: [taskgraph] Switch to using worker aliases for docker-worker and generic-worker; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D24238

--HG--
extra : moz-landing-system : lando
2019-04-30 22:58:06 +00:00
Mike Shal b524fdd571 Bug 1516114 - Enable 3-tier PGO for Linux; r=firefox-build-system-reviewers,Callek,chmanchester
Now that 3-tier PGO uses a debian9 image to generate the profile data
(bug 1519424), we no longer see the XDG_RUNTIME_DIR failures in the run
task. The frequency of those errors was the primary blocker for enabling
3-tier PGO in the first place. Since we still see those errors
occasionally in 1-tier PGO, we should switch to the 3-tier model for
Linux.

Differential Revision: https://phabricator.services.mozilla.com/D27326

--HG--
extra : moz-landing-system : lando
2019-04-12 20:54:40 +00:00
Chris AtLee e779730f54 Bug 1539903: Use linux worker types for android jobs r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D25272

--HG--
extra : moz-landing-system : lando
2019-04-02 16:50:36 +00:00
Mike Hommey 9454edbe38 Bug 1538060 - Update non-Windows builds to clang 8. r=froydnj
Windows builds have been taken care of in bug 1535441.

Differential Revision: https://phabricator.services.mozilla.com/D25328

--HG--
rename : build/build-clang/clang-7-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-7-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-7-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : build/build-clang/clang-trunk-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-7-android.sh => taskcluster/scripts/misc/build-clang-8-android.sh
rename : taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-7-linux.sh => taskcluster/scripts/misc/build-clang-8-linux.sh
rename : taskcluster/scripts/misc/build-clang-trunk-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
extra : moz-landing-system : lando
2019-04-02 02:18:10 +00:00
Noemi Erli c479fa48df Backed out changeset 0d8cf467ed34 (bug 1538060) for Toolchains bustages CLOSED TREE
--HG--
rename : build/build-clang/clang-8-android.json => build/build-clang/clang-7-android.json
rename : build/build-clang/clang-8-linux64.json => build/build-clang/clang-7-linux64.json
rename : build/build-clang/clang-8-macosx64.json => build/build-clang/clang-7-macosx64.json
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-trunk-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-android.sh => taskcluster/scripts/misc/build-clang-7-android.sh
rename : taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-8-linux.sh => taskcluster/scripts/misc/build-clang-7-linux.sh
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-trunk-mingw.sh
2019-04-02 04:54:34 +03:00
Mike Hommey 0b2041f465 Bug 1538060 - Update non-Windows builds to clang 8. r=froydnj
Windows builds have been taken care of in bug 1535441.

Differential Revision: https://phabricator.services.mozilla.com/D25328

--HG--
rename : build/build-clang/clang-7-android.json => build/build-clang/clang-8-android.json
rename : build/build-clang/clang-7-linux64.json => build/build-clang/clang-8-linux64.json
rename : build/build-clang/clang-7-macosx64.json => build/build-clang/clang-8-macosx64.json
rename : build/build-clang/clang-trunk-mingw.json => build/build-clang/clang-8-mingw.json
rename : taskcluster/scripts/misc/build-clang-7-android.sh => taskcluster/scripts/misc/build-clang-8-android.sh
rename : taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-7-linux.sh => taskcluster/scripts/misc/build-clang-8-linux.sh
rename : taskcluster/scripts/misc/build-clang-trunk-mingw.sh => taskcluster/scripts/misc/build-clang-8-mingw.sh
extra : moz-landing-system : lando
2019-04-01 12:23:13 +00:00
Ciure Andrei 8a67ec169a Backed out 3 changesets (bug 1538060, bug 1539779, bug 1536790) for causing clang-tidy bustages CLOSED TREE
Backed out changeset 7d058f3174e5 (bug 1538060)
Backed out changeset 8839622122ed (bug 1539779)
Backed out changeset 9eb7867c1dd4 (bug 1536790)

--HG--
rename : build/build-clang/clang-8-android.json => build/build-clang/clang-7-android.json
rename : build/build-clang/clang-8-linux64.json => build/build-clang/clang-7-linux64.json
rename : build/build-clang/clang-8-macosx64.json => build/build-clang/clang-7-macosx64.json
rename : build/build-clang/clang-8-mingw.json => build/build-clang/clang-trunk-mingw.json
rename : taskcluster/scripts/misc/build-clang-8-android.sh => taskcluster/scripts/misc/build-clang-7-android.sh
rename : taskcluster/scripts/misc/build-clang-8-linux-macosx-cross.sh => taskcluster/scripts/misc/build-clang-7-linux-macosx-cross.sh
rename : taskcluster/scripts/misc/build-clang-8-linux.sh => taskcluster/scripts/misc/build-clang-7-linux.sh
rename : taskcluster/scripts/misc/build-clang-8-mingw.sh => taskcluster/scripts/misc/build-clang-trunk-mingw.sh
2019-03-30 01:52:37 +02:00