Граф коммитов

278 Коммитов

Автор SHA1 Сообщение Дата
Tom Ritter 59cfa9d5ce Bug 1432319 Bump MinGW version to incorporate Process Mitigation structs needed by the sandbox r=froydnj
MozReview-Commit-ID: HnYuQa8DflY

--HG--
extra : rebase_source : ed06ff4ffc4938a861afaec833537676e32e1907
2018-01-27 19:44:45 -06:00
Emilio Cobos Álvarez 11cd13abd8 Bug 1432563: Fetch rustfmt when repackaging rust. r=rillian
I tested this on automation and the build went on, though I couldn't test
the bindgen output because the build right now is busted on one dependent crate
with rust beta, which is the first toolchain that has this package, and will go
to release shortly.

This should work though! If I need more changes I'll adjust them in bug 1432153.

You can test the repackage manually with repack_rust.py --toolchain beta, for
example.

MozReview-Commit-ID: GI2f6vGVqTe
2018-01-27 02:02:17 +01:00
Mike Hommey 520f9865db Bug 1432397 - Switch mingw builds to a Debian stretch-based docker image. r=dustin
Don't build ucl when building upx, Debian stretch has a recent enough
version. In fact, the last upstream version doesn't build with GCC in
Debian stretch (http://bugs.debian.org/811707)

--HG--
extra : rebase_source : aae67773b9dd3b99f6ddf9ab7f59a628037e6925
2018-01-26 14:39:07 +09:00
Tom Ritter 6f227dea91 Bug 1431809 Bump MinGW version for new Product Constants r=froydnj
MozReview-Commit-ID: CmxZTdyHP3X

--HG--
extra : rebase_source : 7aa739cb54ac0f4c52087dcd1c992fe220bda737
2018-01-23 17:57:08 -06:00
Dorel Luca 4b9ccdb392 Merge mozilla-inbound to mozilla-central r=merge a=merge 2018-01-23 12:02:17 +02:00
Tom Ritter 40e0f3ea5e Bug 1432009 Fix MinGW build failure with d_write3.h r=jfkthame
Bump mingw version to get the newest commit and do not include the
un-needed dw-extras.h on MinGW (thanks Jacek!)

MozReview-Commit-ID: OjO93XHCxs

--HG--
extra : rebase_source : 933bbb385004988a23d1069c9cd3241b3a3b336e
2018-01-22 15:01:49 -06:00
Tom Prince 0a70a075ef Bug 1424146: Simplify taskcluster l10n mozharness config; r=Callek
MozReview-Commit-ID: 5Pg480dLRbz

--HG--
extra : rebase_source : 040b3d219043ddd93bf538f0d6ba77d20110ae28
extra : source : c73e7b3292dfd0c7a1a4fa095fa614d0720d64e2
2017-11-28 12:46:22 -07:00
Tom Prince b6125ff578 Bug 1429603: Remove mock configuration from build mozharness configs and code; r=jlund
Differential Revision: https://phabricator.services.mozilla.com/D369

--HG--
extra : rebase_source : 9fd6eab5d2c85fcc61d0420dc860dcc26c18303c
2018-01-04 13:13:24 -07:00
Mike Hommey 374330afe4 Bug 1429056 - Add llvm-symbolizer to the llvm-dsymutil toolchain. r=ted
llvm-symbolizer is necessary to get symbols in llvm-dsymutil crash
dumps. While we could use the one from clang during the build, it's
better if the llvm-dsymutil toolchain is standalone for local testing.

--HG--
extra : rebase_source : 5cd234a3e14ab52a4ce759821e0e756e68167797
2018-01-19 19:00:06 +09:00
Mike Hommey ee232fad88 Bug 1429056 - Don't strip llvm-dsymutil. r=ted
When I originally wrote the llvm-dsymutil build script in bug 1430315,
I wasn't setting CMAKE_BUILD_TYPE to Release, and was ending up with
a very large binary (> 300MB), so I stripped it.

When I later set CMAKE_BUILD_TYPE to Release, I left the manual
stripping on, but that removes symbols that are useful for stacktraces
when dsymutil crashes (the Release type still leaves out debug info).

--HG--
extra : rebase_source : 802daadc24c0090574b1a44ea8b4e6c25735f703
2018-01-19 10:16:11 +09:00
Gregory Szorc 6f469dc037 Bug 1430908 - Use --progress=dot:mega with wget; r=glandium
By default, wget prints dots every 1k bytes. This can render a
lot of output for large files. We switch to the "mega" style, which
makes each dot represent 64k, thus reducing output by up to 64x.

We also force the use of dot display. By default, it uses "bar"
which attempts to use terminal formatting if possible. Since most
of this code executes in CI and terminal control characters can
interfere with logged output, we force the use of "dot." (Although
wget appears to automatically switch to dot in TC today. But
consistency is good.)

MozReview-Commit-ID: IpTWJdcauTV

--HG--
extra : rebase_source : 5c9aa1bbdcd78eaa0b31347ad026a2c1beaedc03
2018-01-16 14:24:31 -08:00
Ryan VanderMeulen ac18fd5152 Backed out 20 changesets (bug 1411654) for incorrect android:debuggable. r=nalexander, a=RyanVM
Backed out changeset cfad693be918 (bug 1411654)
Backed out changeset 55776829a744 (bug 1411654)
Backed out changeset c5bf85d56fed (bug 1411654)
Backed out changeset c270f97bb0da (bug 1411654)
Backed out changeset fde9bf9c14c3 (bug 1411654)
Backed out changeset 01836fd98c63 (bug 1411654)
Backed out changeset 730a70767743 (bug 1411654)
Backed out changeset 690e265c684c (bug 1411654)
Backed out changeset f918500d9cf5 (bug 1411654)
Backed out changeset cec2b8828cc8 (bug 1411654)
Backed out changeset 76085ddd5ac7 (bug 1411654)
Backed out changeset 2b37201606f5 (bug 1411654)
Backed out changeset d0d513d1c379 (bug 1411654)
Backed out changeset e7b0cc801cf1 (bug 1411654)
Backed out changeset 901b304603d9 (bug 1411654)
Backed out changeset 373c9a71d945 (bug 1411654)
Backed out changeset 3dc3beab95f8 (bug 1411654)
Backed out changeset 22a861db1573 (bug 1411654)
Backed out changeset 0850b319efd4 (bug 1411654)
Backed out changeset d276d3deba05 (bug 1411654)

--HG--
rename : mobile/android/app/src/main/res/values-v17/themes.xml => mobile/android/base/resources/values-v17/themes.xml
2018-01-17 15:55:38 -05:00
Mike Hommey b7f54b9288 Bug 1430315 - Add a toolchain job to build llvm-dsymutil independently. r=rillian
We've had problems with crashes in llvm-dsymutil for a while, and while
they are, in essence, due to the fact that rustc produces bad debug
info, they are a hurdle to our builds. The tool comes along clang, and
updating clang is not necessarily easy (witness bug 1409265), so, so
far, we've relied on backporting fixes, which can be time confusing
(witness bug 1410148).

OTOH, llvm-dsymutil is a rather specific tool, that doesn't strictly
need to be tied to clang. It's only tied to it because it uses the llvm
code to do some of the things it does, and it's part of the llvm source
tree. But it could just as well be a separate tool, like it was(is?) on
OSX.

So, we add a toolchain job to build it from the llvm source,
independently from clang, so that we can update it separately, if we
hit new crashes that happen to already be fixed on llvm trunk. It will
also allow to more easily update after upstream fixes crashes after we
report them.

--HG--
extra : rebase_source : b814353b4b4632e46646a24b8f54c5300618ff49
2018-01-16 16:23:33 +09:00
Nick Alexander 47c107e74f Bug 1411654 - Part 1: Upgrade to Android-Gradle 3.0+ and build-tools;26.0.2. r=maliu
New Android-Gradle plugins pin the build-tools version, and we want to
be consistent between Gradle and moz.build.

MozReview-Commit-ID: ApWS4rHzPuH

--HG--
extra : rebase_source : 38a9781c472d858f3300cbbcbdc6d2311c465713
2017-10-26 11:00:36 -07:00
Nick Alexander e6080c2ce7 Bug 1411654 - Pre: Don't block Google's maven repository. r=maliu
Turns out Google's maven repository doesn't publish checksums.  I
can't imagine why not, but there it is.  We have to think more about
whether to trust the artifacts downloaded from maven.google.com.

MozReview-Commit-ID: CdWijorq1IV

--HG--
extra : rebase_source : a884971e51ce7b1ff993754b130f462c476646ab
2017-10-27 14:50:27 -07:00
Dorel Luca ab63c465d9 Backed out 19 changesets (bug 1411654) for Android nightly bustages a=backout
Backed out changeset 649e7aa405ca (bug 1411654)
Backed out changeset c2e51b70519f (bug 1411654)
Backed out changeset a371f3ef4312 (bug 1411654)
Backed out changeset db978e230556 (bug 1411654)
Backed out changeset 56538ed998cf (bug 1411654)
Backed out changeset 6ff0cdf46a3d (bug 1411654)
Backed out changeset 0e493bacc5e3 (bug 1411654)
Backed out changeset 23cbcf427745 (bug 1411654)
Backed out changeset eda74143389f (bug 1411654)
Backed out changeset 359fadf9b3e9 (bug 1411654)
Backed out changeset 5c64eda20f1e (bug 1411654)
Backed out changeset bffb6a5b78d1 (bug 1411654)
Backed out changeset 43787f4089c3 (bug 1411654)
Backed out changeset 9141bbdfd13b (bug 1411654)
Backed out changeset 108674372ef7 (bug 1411654)
Backed out changeset fb15e1f54987 (bug 1411654)
Backed out changeset 264476c77210 (bug 1411654)
Backed out changeset d23f467218da (bug 1411654)
Backed out changeset 78576ff98660 (bug 1411654)

--HG--
rename : mobile/android/app/src/main/res/values-v17/themes.xml => mobile/android/base/resources/values-v17/themes.xml
2018-01-13 15:17:49 +02:00
Coroiu Cristina c6a942e1bf Merge inbound to mozilla-central r=merge a=merge 2018-01-13 11:55:23 +02:00
Mike Hommey 68e591a606 Bug 1430270 - Disable ccache in hazard builds. r=nalexander
I don't intend to install ccache in the Debian build images. Hazard
builds are the only builds running on the desktop-build image still
using ccache somehow, and that gains them nothing, since the ccache
directory is not set to a cached directory on taskcluster, meaning
the build always starts with an empty cache. If anything, this currently
makes the build slower.

Eventually, those builds should be able to use sccache, once the
necessary setup moves out of mozconfig.cache.

--HG--
extra : rebase_source : fba6dab78b25ea61892cbe6127ead36da395b0e0
2018-01-13 06:33:12 +09:00
Csoregi Natalia bed10b400c Merge mozilla-central to autoland. r=merge a=merge CLOSED TREE 2018-01-13 00:02:18 +02:00
Mike Hommey eb3cf6d41b Bug 1430030 - Enable parallelism when building wine, upx and fxc2. r=ted 2018-01-12 21:25:59 +09:00
Mike Hommey a6d328e83e Bug 1430087 - Build sccache with system GCC/binutils. r=nfroyd
It was failing to build with the GCC/binutils on the CentOS-based docker
image, but it doesn't with the Debian-based one, so we can remove the
dependency on the gcc toolchain task. This allows sccache to remain
untouched when we change the gcc build scripts, and more importantly,
this allows it to depend on no toolchain that requires building things.

This makes it now possible to use sccache as a dependency for all other
toolchains jobs that compile, if that's beneficial (which might not be
the case, given the current sccache retention time, but at least it's a
viable option, now)
2018-01-13 05:57:57 +09:00
Nick Alexander e820c8ca18 Bug 1411654 - Part 1: Upgrade to Android-Gradle 3.0+ and build-tools;26.0.2. r=maliu
New Android-Gradle plugins pin the build-tools version, and we want to
be consistent between Gradle and moz.build.

MozReview-Commit-ID: ApWS4rHzPuH

--HG--
extra : rebase_source : 5a5730b4b9ce84af40a7c73c4f1abba017103f02
2017-10-26 11:00:36 -07:00
Nick Alexander a0865e7202 Bug 1411654 - Pre: Don't block Google's maven repository. r=maliu
Turns out Google's maven repository doesn't publish checksums.  I
can't imagine why not, but there it is.  We have to think more about
whether to trust the artifacts downloaded from maven.google.com.

MozReview-Commit-ID: CdWijorq1IV

--HG--
extra : rebase_source : e4373273e7aea7df79d70b5fbc233233a84d2360
2017-10-27 14:50:27 -07:00
Mike Hommey 714ba3c60d Bug 1428967 - Allow to build cctools-port on Debian. r=ted
There is no /lib64 on Debian. OTOH, one doesn't need to give the full
path to a system library in LDFLAGS, so just use -l syntax instead.

--HG--
extra : rebase_source : b795f97ab209499824afa5ef1aee9da52657ceb9
2017-12-30 12:57:51 +09:00
Mike Hommey d0497c863b Bug 1427266 - Statically link libdmg-hfsplus against OpenSSL. r=gps
libcrypto, part of OpenSSL, and that dmg links against, has a varying
ABI, and something built against libcrypto on Centos won't run on Debian
and vice versa. It might not even work between versions of the same OS
(e.g. Debian 7 vs. Debian 9).

Because of that, it is desirable to statically link it.

This incorporates https://github.com/mozilla/libdmg-hfsplus/pull/1
and sets OPENSSL_USE_STATIC_LIBS when building libdmg-hfsplus.

--HG--
extra : source : 78f2064b3811db58b364c32ce9b58a3f2dcaf8f8
2017-12-28 18:19:31 +09:00
Ted Mielczarek d9f364de3f bug 1401647 - Fix spidermonkey mozjs / rust-bindings builds. r=nalexander
The spidermonkey mozjs and rust-bindings builds run sed on
$topsrcdir/.cargo/config.in to generate the cargo config they use, but
they previously only replaced the @top_srcdir@ substitution. This patch
makes them replace any other substitutions with an empty value to add
a bit of future-proofing.

MozReview-Commit-ID: 1DzP9vXxHMD

--HG--
extra : rebase_source : e8c0268a2a6e91ca2000b340beee2dcff0636591
2018-01-03 14:51:52 -05:00
Mike Hommey ebcec7e922 Followup for bug 1421100: deterministically download rustc 1.23.0-beta.2. r=me, a=bustage on a CLOSED TREE 2018-01-04 14:52:20 +09:00
Mike Hommey de81c42aa0 Bug 1426785 - Allow more `mach artifact toolchain` calls to not use a tooltool manifest. r=gps
We're about to remove some tooltool manifests, so we need those calls to
work properly when TOOLTOOL_MANIFEST is not set.

--HG--
extra : rebase_source : 89d41021a87915dc9133e61543352e3bda1dace4
2017-12-22 07:48:14 +09:00
Coroiu Cristina dbb27acb6d Backed out 5 changesets (bug 1426785) for failing repackage the nightly build on Linux a=backout.
Backed out changeset 08b5850633de (bug 1426785)
Backed out changeset 61453b6473f1 (bug 1426785)
Backed out changeset 851ce8944b41 (bug 1426785)
Backed out changeset 386cd0532519 (bug 1426785)
Backed out changeset 2a52bf9e0898 (bug 1426785)
2017-12-24 14:03:02 +02:00
Mike Hommey 399ebca32e Bug 1426785 - Allow more `mach artifact toolchain` calls to not use a tooltool manifest. r=gps
We're about to remove some tooltool manifests, so we need those calls to
work properly when TOOLTOOL_MANIFEST is not set.

--HG--
extra : rebase_source : 38ca0e3b894097ed3667901b05af79062a6c82c2
2017-12-22 07:48:14 +09:00
Mike Hommey 40aecc07ad Bug 1426553 - Autoconf-related changes to spidermonkey jobs. r=nalexander
On Debian, the autoconf binary is autoconf2.13 while it is autoconf-2.13
on Centos.

In make-source-package.sh, we need to run autoconf to generate the
old-configure to include in the package, so try both.

In hazard-analysis.sh, we actually don't need autoconf itself, so just
copy configure.in to configure.

--HG--
extra : rebase_source : d21075394c69cd7cd6738da645173eb29f4a1259
2017-12-21 09:41:19 +09:00
Mike Hommey fbaf337e4b Bug 1426322 - Separate gcc and mingw32-gcc. r=gps
The "contract" for toolchains is that extracting foo.tar.xz creates a
directory named foo/. That is however not true for mingw32.tar.xz, which
extracts into gcc/, possibly overwriting files from the gcc.tar.xz
archive (which is also used for mingw builds, for the host part).

This is also not true for nsis.tar.xz, but it reportedly has problems
when it's not in the same directory as mingw32.

But mingw32 doesn't actually need to be mixed with gcc, so it's better
to separate them as they are supposed to be.

--HG--
extra : rebase_source : 30d90af64459bbb31bc076e48f3c661fa9cd4a79
2017-12-20 13:46:53 +09:00
Mike Hommey a588499893 Bug 1426321 - Explicitly enable tar wildcard support when repacking proguard. r=nalexander
While on Centos --wildcards is the default, it is not on Debian.

--HG--
extra : rebase_source : cff03dfb587d295c4e8f8893948a9775d6e5e8b5
2017-12-20 16:01:51 +09:00
Tom Prince df534f30a9 Bug 1426209: Allow passing `--extra-config-path in L10N tasks; r=jlund
MozReview-Commit-ID: FCG2K9L5Z3T

--HG--
extra : rebase_source : 9536c96f8aa7445149a7075b34310870d768f219
2017-11-27 13:47:29 -07:00
Steve Fink 6c225d1905 Bug 1351559 - Make fuzzing builds match firefox more closely, r=jonco
--HG--
extra : rebase_source : af836bee8642447855b50913ebbe1e345ecaed15
2017-12-15 10:13:12 -08:00
Ting-Yu Chou 0bc952653b Bug 1360650 part 2 - Export VSINSTALLDIR so LLVM_ENABLE_DIA_SDK will be set. r=ehsan 2017-12-18 11:28:20 -05:00
Ted Mielczarek 8b7140ce04 bug 1424323 - remove MOZ_AUTOMATION_UPLOAD_SYMBOLS from in-tree mozconfigs. r=rillian
With all of our builds in Taskcluster now, we should never be uploading
symbols from build tasks. Unfortunately Windows builds were still doing so.
This patch removes MOZ_AUTOMATION_UPLOAD_SYMBOLS from all the in-tree
mozconfigs and a few other places so that it should always default off
(per moz-automation.mk). The rest of the uploadsymbols bits will be
removed once Thunderbird fixes their automation.

This patch was mostly autogenerated by running:
rg --files-with-matches UPLOAD_SYMBOLS browser/config/mozconfigs/ mobile/android/config/mozconfigs/ | xargs sed -ri '/.*UPLOAD_SYMBOLS.*/d'
sed -ri '/.*UPLOAD_SYMBOLS.*/d' build/unix/mozconfig.linux build/mozconfig.win-common build/macosx/local-mozconfig.common build/mozconfig.automation

Then mobile/android/config/mozconfigs/common and
taskcluster/scripts/builder/build-linux.sh were hand-edited.

MozReview-Commit-ID: Cy8kSEodSg4

--HG--
extra : rebase_source : 01caf1651b4eb428313e1f371aa585f8f34c4151
2017-12-08 13:50:17 -05:00
Christian Holler 107b880d6a Bug 1415689 - Add Clang 6 (pre) and use it for ASan builds. r=froydnj
MozReview-Commit-ID: 34rcG7gEswz
2017-11-10 10:14:26 +01:00
Tom Prince 3062e80d46 Bug 1415618: Add support to taskcluster to specifying extra paths to mozharness. r=jlund
MozReview-Commit-ID: 7CGQgSUUg0n

--HG--
extra : rebase_source : 2a184e66c3413e9e206b999b1340a6ecb52bd234
extra : source : 71510fd07ef52f8539ed37968e2ec7ea9c1a5fdd
2017-11-14 15:16:22 -07:00
Brindusan Cristian ef3b43fb44 Backed out 4 changesets (bug 1415618) for build bustage failures. r=backout on a CLOSED TREE
Backed out changeset 71510fd07ef5 (bug 1415618)
Backed out changeset 780f67a36d6d (bug 1415618)
Backed out changeset 5ecdc55db739 (bug 1415618)
Backed out changeset be3173822987 (bug 1415618)
2017-11-16 05:53:38 +02:00
Tom Prince eea866d632 Bug 1415618: Add support to taskcluster to specifying extra paths to mozharness. r=jlund
MozReview-Commit-ID: 7CGQgSUUg0n

--HG--
extra : rebase_source : e31e1f70d0f54b4c1d6535d004f49267ea3071b5
2017-11-14 15:16:22 -07:00
Marco Castelluccio 14a1047ffd Bug 1415568 - Support applying patches to Windows clang. r=froydnj
--HG--
extra : rebase_source : ed53f564166f6c26ed4f7fc0dabcc4582116ddbf
2017-11-08 17:23:12 +01:00
Nick Alexander b4332702f0 Bug 1414678 - Pass through MOZ_SCM_LEVEL, so that secret fetching works. r=Callek
MozReview-Commit-ID: IqtMzMsjxOZ

--HG--
extra : rebase_source : eefc31daa43894a08c9bc9eb1da40faeb466c2a5
extra : source : a5a189a375dcc63af11dec3afa2d6491e52ddc4e
2017-11-06 11:32:40 -08:00
Sebastian Hengst f5e52adeea merge mozilla-inbound to mozilla-central. r=merge a=merge 2017-11-07 12:43:06 +02:00
David Major 375f8abff8 Bug 1414304 - Use VS2017 for the sccache toolchain build. r=cmanchester 2017-11-06 17:15:13 -05:00
David Major 422a57aa5b Bug 1414306 - Use VS2017 for the gn toolchain task. r=cmanchester 2017-11-06 17:14:45 -05:00
Ralph Giles 1999c8d8f8 Bug 1414906 - Build sccache with openssl 1.1.0g. r=froydnj
Fixes bn_sqrx8x_internal carry bug on x86_64 (CVE-2017-3736)

MozReview-Commit-ID: 5qF9NfCi3XX

--HG--
extra : rebase_source : 287dfb7198b2c7cce065010e5c603a4bb2fe986f
2017-11-06 10:16:07 -08:00
Gregory Szorc 29dc336611 Bug 1413687 - Move hazard build scripts out of mozharness; r=sfink
These scripts are included by hazard-analysis.sh. That's their only
reference in repo.

We could probably inline these scripts. But let's start by moving them
out of mozharness since no active mozharness based task is using them.

MozReview-Commit-ID: 13oen42Txmh

--HG--
rename : testing/mozharness/scripts/spidermonkey/build.browser => taskcluster/scripts/builder/hazard-browser.sh
rename : testing/mozharness/scripts/spidermonkey/build.shell => taskcluster/scripts/builder/hazard-shell.sh
extra : rebase_source : 782f7b3f3537cfefb51b0e5f1b459c8ad0daca5b
2017-11-06 11:02:24 -08:00
David Major 2d71b41c6f Bug 1412952 - Build clang-cl itself with VS2017. r=froydnj 2017-11-03 12:29:58 -04:00
Nathan Froyd c32f61a4c3 Bug 1412888 - bump the sccache revision to include argument parsing fixes; r=ted.mielczarek 2017-10-30 12:31:07 -04:00