Port of D125630.
Differential Revision: https://phabricator.services.mozilla.com/D125720
--HG--
extra : rebase_source : 7673bf170031eaa187278e93e622f655b82b2103
extra : amend_source : 06d1638ba096f5a76f9dd5bd3db5abe0b5d30451
extra : histedit_source : 2febc9740537348f933bfa5f8a4c5d546d37813e
Port of D125635.
Differential Revision: https://phabricator.services.mozilla.com/D125719
--HG--
extra : amend_source : b2ceb4c17179eceef9bfb1bf632d01e00c04ae33
extra : histedit_source : 7a4751cc1650d1ef21104286dfe9a61bc673b35b
Adjust the path to libssp-0.dll so it's found.
A follow-up bug needs to fix the error handling in build-libotr.sh so that
when something like this happens, libotr jobs do not complete "successfully".
Depends on D123297
Differential Revision: https://phabricator.services.mozilla.com/D123298
--HG--
extra : moz-landing-system : lando
Thunderbird does not use the "esrXX" names for release types, it needs to be
set to "release".
The last watershed version is going to be 78.15.0.
Differential Revision: https://phabricator.services.mozilla.com/D122397
--HG--
extra : amend_source : f8ee451ef149c2647e2772a8d85d7056e1f15675
Win32 builds need to pick up two functions from libgcc (__udivdi3, __umoddi3).
Statically link it so that we do not need to ship an additional DLL.
Differential Revision: https://phabricator.services.mozilla.com/D122237
--HG--
extra : moz-landing-system : lando
Necessary to compile things like nsinstall which run on the Linux host during
the build.
Differential Revision: https://phabricator.services.mozilla.com/D120081
--HG--
extra : amend_source : a6643e2b4c136a6f192998f3ce44c6f227fa967c
This is to add a second set of update-verify test jobs that run during release
promotion. This allows testing that Thunderbird 78 installs stay on
Thunderbird 78 and Thunderbird 91 gets Thunderbird 91 updates. Once 78 is
EOL, these tests get disabled.
Differential Revision: https://phabricator.services.mozilla.com/D116748
--HG--
extra : histedit_source : 41bcd02a98a9d38c80cc1492ba585a9dc8098882
The Nightly Thunderbird builds are triggered by .cron.yml, which sets the value
of "target_tasks_method" to "nightly_desktop". That happens before the defaults
from PER_PROJECT_PARAMETERS are applied though, so it was getting overwritten.
As a result, none of the L10n, Beetmover, or Balrog jobs that are normally run
for a Daily build were not run.
Differential Revision: https://phabricator.services.mozilla.com/D120005
Depends on D120004
Per bug 1717883 comment 5, run the non-webrender tests for Windows 10 in addition
to webrender so it's easier to identify failures.
For win32, all test platforms are now webrender.
Differential Revision: https://phabricator.services.mozilla.com/D119892
Test optimization strategy needs to align with the build strategy. If the test
strategy determines that the test needs to run, by definition the build must run.
The optimization attribute doesn't normally allow setting a different strategy
based on the test platform. This is useful for Thunderbird, and doesn't align
with the way Firefox CI runs tests.
Differential Revision: https://phabricator.services.mozilla.com/D118395
is_backstop needs to be reset prior to calling it a second time. The trust_domain
also needs to be passed to locate the previous backstop push.
Differential Revision: https://phabricator.services.mozilla.com/D117659
Set up backstop optimizer to run jobs roughly once a day.
Differential Revision: https://phabricator.services.mozilla.com/D117171
--HG--
extra : amend_source : 8463d46d0a7a3efc3eb04fcd51feafb2cded8252
extra : histedit_source : 7c6fcdeb646413f445e6e135a2b85a01d7276b8a
Backed out changeset 25979118e932 (bug 1713312)
Backed out changeset ff95d0a57315 (bug 1713312)
The once-daily jobs did not actually run with the daily cron as expected.
Some build jobs need to run, but not necessarily on every push. At the moment,
this includes the ASan builds, and the Windows plain builds.
Differential Revision: https://phabricator.services.mozilla.com/D116709
--HG--
extra : moz-landing-system : lando
Prevents these jobs from running when only Seamonkey-associated files are
changed in the push.
Differential Revision: https://phabricator.services.mozilla.com/D116269
--HG--
extra : moz-landing-system : lando
The "nightly" attribute has effectively been replaced by "shippable" and is no
longer needed.
Differential Revision: https://phabricator.services.mozilla.com/D116712
--HG--
extra : amend_source : 261bbe1b932a220993e405fd6a3c28b352eea77b
Previously, the MS MAPI headers that are necessary for Thunderbird Windows builds
were downloaded as a tooltool artifact, making it necessary for Thunderbird to
use a different manifest file.
In bug 1687220, the MAPI headers were moved to a private Taskcluster artifact.
The only remaining tooltool artifact to download is the MS VS SDK, which is the
same as Firefox so use their manifest file.
Differential Revision: https://phabricator.services.mozilla.com/D115613
Merge automation overwrites the pinned changesets in l10n-changesets.json
on comm-beta. This isn't a huge problem as it runs automatically, but not until
the following day which either delays beta 1 release by a day or, more likely,
leads to a beta 1 release without pinned changesets.
With this change, the pinning is run as part of the merge.
Differential Revision: https://phabricator.services.mozilla.com/D112997
--HG--
extra : amend_source : de8634452e62059c35bdd3701904a8ef40926240
It's quite cumbersome to have the filename be versioned (eg. libotr.so.5) as
the way it's done is inconsistent between the supported platforms. Libtool
insists on using the full names, so bypass it with a link command that
sets the SONAME correctly as well.
Additionally, statically link the dependencies for Windows builds like the
other platforms.
Differential Revision: https://phabricator.services.mozilla.com/D109488
--HG--
rename : third_party/clang/aarch64-linux-gnu.cfg => third_party/clang/i686-linux-gnu.cfg
extra : moz-landing-system : lando
Makes it obvious what architecture it's for and is more consistent with the
macosx64 build jobs.
Differential Revision: https://phabricator.services.mozilla.com/D109446
--HG--
extra : moz-landing-system : lando
With gpg-error 1.42 and libgcrypt 1.9.2, libgcrypt does not compile with
ASM enabled. This manifested as a failure to initialize libotr previously.
Differential Revision: https://phabricator.services.mozilla.com/D109632
--HG--
extra : rebase_source : eb2a1982d2cae54de557475dc12ee770ae012fe7
Also, only run asan builds on "release" repos: comm-central, comm-beta,
and comm-esr*.
Differential Revision: https://phabricator.services.mozilla.com/D106350
--HG--
extra : amend_source : 36291b72f104eaad91998f36a64ed8db9f86c316
The target libraries (libc++.a and libc++abi.a) are 32-bit, so the 32-bit sysroot
is needed.
Differential Revision: https://phabricator.services.mozilla.com/D104560
--HG--
extra : rebase_source : fbd155be3af178a9370f48c1b591a08b0aedb8dd
Need to pass the sysroot path to clang so it finds the necessary
files for linking. Using --with-sysroot from the configure
script does not work in our case as it confuses libtool when
it looks for libgcrypt/libgpg-error when building libotr.
Differential Revision: https://phabricator.services.mozilla.com/D104561
--HG--
extra : amend_source : c86c91ce6b640b2c309985706b80d05211c2945e
extra : histedit_source : 86b638e9a6c3eeea7db7e7bf33802f1fbb6f25b7
The resulting universal DMG does not run with hardened runtime.
Bug 1690118 will track the fix for that.
--HG--
extra : histedit_source : 95f62111886673ac80ffe1861504051a8ec460b5
Setting the config.h define HAVE_CPU_ARCH_X86 somehow has become dependent on
having asm enabled. --disable-asm needs to go. It is set because of compile
time errors "not in 64-bit mode".
CCASFLAGS is for the assembler. It's supposed to default to $CFLAGS, which
is set up for generating i686 machine code, but that does not seem to be the
case. Setting CCASFLAGS explicitly fixes the "not in 64 bit mode" compiler
errors seen previously, so then --disable-asm is no longer needed.
Differential Revision: https://phabricator.services.mozilla.com/D103557
--HG--
extra : rebase_source : 9f0b797f6304acacd7d2e204219081e32dcec311
extra : amend_source : 459e5ce496616e04956b6544e87449f20cdb3744
extra : histedit_source : e0683e54f172c6f8fb6f056ff8ccdf97f03fa0ff
The hash_paths function in comm-central does not work when comm/ not a separate
repository. As both repositories need to work for the next few months, this
wrapper will support both possibilities.
Differential Revision: https://phabricator.services.mozilla.com/D99921
--HG--
extra : moz-landing-system : lando
Brings the taskgraph config in line with the linter config, add appropriate
exclusions, and run the check on all projects.
Differential Revision: https://phabricator.services.mozilla.com/D97678
Taskcluster does not build on suite-only pushes. Using the 'when.files-changed'
method is prone to missing things due to new directories being added and is
not easy to combine with other strategies such as a backstop.
The skip-suite-only optimization is effectively the same as what is done with
when.files-changed. The changed files in a push are pulled from hg.mo and then
any files matching the suite/editor exclude patterns are removed from the list.
If the changed files list is empty after that process, then no build is done.
Differential Revision: https://phabricator.services.mozilla.com/D96186
--HG--
extra : moz-landing-system : lando
Docker image context directories go under comm/taskcluster/docker and must be
defined in comm/taskcluster/ci/docker-image/docker-image.yml in order for
the decision task to find them properly.
Differential Revision: https://phabricator.services.mozilla.com/D92705
--HG--
extra : moz-landing-system : lando
Builds are going to Clang 11 but various other things are staying at Clang 9 for
now.
Differential Revision: https://phabricator.services.mozilla.com/D88326
--HG--
extra : amend_source : 2cba7b4e187d2378929494ac977ff828c722ec4f
Builds are going to Clang 11 but various other things are staying at Clang 9 for
now.
Differential Revision: https://phabricator.services.mozilla.com/D88326
--HG--
extra : rebase_source : 8e375f881ff1d014a70f8236928c4a2a02363f6d
extra : histedit_source : a6a275839489b050a03d2cc10599d4bbd23237e0
Make .cron.yml consistent with itself and provide some comments and a reference
to additional information.
Differential Revision: https://phabricator.services.mozilla.com/D87935
--HG--
extra : moz-landing-system : lando
Port of D87693.
There's no diffence between Thunderbird and Firefox URLs now. It's just what's
on tip.
Depends on D87780
Differential Revision: https://phabricator.services.mozilla.com/D87781
--HG--
extra : moz-landing-system : lando
l10n-bumper-beta was added to get around the need for a Taskcluster cron task.
Since signoffs are no longer part of the process it can be removed.
Differential Revision: https://phabricator.services.mozilla.com/D87780
--HG--
extra : moz-landing-system : lando
Bug 1636797 made changes to the hash calculations done when determining if toolchains
need building. Rather than relying on the filesystem, the version control repository
is consulted.
This breaks the toolchains where resource files are not in the GECKO repository, such
as libotr.
hash_paths_extended is used the same way hash_paths is, but it is aware of the comm/
subdirectory.
Depends on D87457
Differential Revision: https://phabricator.services.mozilla.com/D87476
--HG--
extra : moz-landing-system : lando
Bumping the watershed from which beta updates are tested to one where all
locales are available for download.
Differential Revision: https://phabricator.services.mozilla.com/D85782
--HG--
extra : moz-landing-system : lando
For release, even though the watershed on AUS is actually at 68.10.0,
test updates only from version 78.0 because updates from 68.x are not
enabled yet.
Differential Revision: https://phabricator.services.mozilla.com/D83868
--HG--
extra : amend_source : 49071753ab79c189a5d0ef1fc0a4ffea1b54c4cf
extra : histedit_source : 67dc08321e6ebab9ff090a36fe1ba4cd3b641db5
The actual searchfox_index method includes tasks that do not exist in the
Thunderbird taskgraph. Register a new method specific to Thunderbird that
includes only what is needed.
Differential Revision: https://phabricator.services.mozilla.com/D81261
--HG--
extra : moz-landing-system : lando
There is no 32-bit libc++ built as part of the Clang toolchain, this builds
a standalone version using the same source tar file that the rest of the
Clang toolchain is built with.
Differential Revision: https://phabricator.services.mozilla.com/D80223
--HG--
extra : moz-landing-system : lando
This is a copy of the transform from mozilla-central. The only change is to pass
comm_head_rev and comm_head_repository instead of the mozilla repo information.
Differential Revision: https://phabricator.services.mozilla.com/D79408
--HG--
extra : moz-landing-system : lando
This is a partial port of D73250.
--HG--
extra : rebase_source : 11427771ec461259484500bd347e3810da5b7a56
extra : amend_source : 2eb68dbdaf6434571047e048d48f30d0f3ba8117
extra : histedit_source : 89eaf8a6586cd235f87c3e7c5025d7290b2dedf9
Port of D79084 for fixing 78 beta.
--HG--
extra : rebase_source : 737e158c1fc106546c2b541879f2778e607f40e9
extra : histedit_source : d018010cd2a263fdeddb23f80dbf51dfac2c34b5
The thirdparty build kind has problems with indexing that never really worked
out. By using the existing toolchain kind we can rely on that indexing that has
seen a lot more use and be more confident that it works right.
Depends on D78205
Differential Revision: https://phabricator.services.mozilla.com/D78206
--HG--
rename : taskcluster/ci/thirdparty/libotr.yml => taskcluster/ci/toolchain/libotr.yml
extra : moz-landing-system : lando
Toolchain builds have things in a slightly different arrangement. GECKO_PATH
is at /builds/worker/workspace/build/src, so removing build at line 17 will
delete the checkout we need for the libotr sources.
At the same time, this script will also run on the thunderbird-mingw docker
image which uses the build image layout, and the build directory will need
to be created.
In either case, workspace can be cached between Taskcluster runs under some
circumstances so clearing out the directories that this script uses is still
warranted.
Differential Revision: https://phabricator.services.mozilla.com/D78205
--HG--
extra : moz-landing-system : lando
The original plan for libotr was to build it as a toolchain dependency. That
was not possible at the time, but can be done now. The biggest advantage to
switching is going to be improved artifact indexing.
This will also be used for some RNP work.
Most of this code is copied from taskgraph with modifications made to fix
some hardcoded paths. There are no plans to update the code in M-C.
--HG--
extra : rebase_source : c0efc76af4e4110e2eeb5f3a195b574021b086bb
extra : amend_source : 497b9a111388a75670dc05a2385a948c41ae8ab1
extra : histedit_source : 81bdd4f41e1a49f3c2457e877755a07ca24f71f2
There's some verification that happens in the Decision task that checks that
documentation exists. In this case we need to make sure that the "comm-toolchain-script"
run-as function passes such verification.
Other updates for existing functionality included as well.
--HG--
extra : rebase_source : 85dfe9a96507e2da341dbca41b94ee3dea2acc91
extra : histedit_source : a69f3618245a4b00634d61a779d588393ff71bb0
Replaces the debian7 images with debian8. Port of D73784.
--HG--
extra : rebase_source : 1d6888ce35657fd833629223dc7debef1d9e0ec5
extra : histedit_source : e33a1de6fd62bcf1841f9a196b33dd3c4653172e%2C3b4bce34909984759c74a6af6d2c998668f27b55
The differentiation for ja and ja-JP-mac by platform is handled in the
l10n-bump kind file, so it's no longer necessary in shipped-locales.
Port of D73712.
The failing tests were only going to be run on try-comm-central. There appears
to be a bug in the run-on-projects matching that warrants further investigation.
--HG--
extra : histedit_source : b24338322d5c1cd9c5478cf061beb128101375dd
The Seamonkey project does not use Taskcluster for builds, but they are working on using mozlint.
In order to accommodate both projects and minimize duplicate code, when MOZLINT_NO_SUITE is
set, comm/suite and comm/editor will get added to the exclude list.
This makes it easy for Thunderbird developers to do the same when running "mach lint" locally.
--HG--
extra : rebase_source : 757a06eadbb927f3c5950a5dfde8c1165c728f73
l10n-bump-beta did not trigger as expected on comm-beta. skip-unless-changed paths
are relative to GECKO.
--HG--
extra : rebase_source : 9fb82b9854e012f929ab888380bb7bccc571f2e8
extra : amend_source : 5e46009f11b3af42d7d5238c2d6c675a5323bb43
Make sure libotr build tasks have a long enough expiration so the artifacts
are available when used. 1 year is the value used by toolchain builds.
--HG--
extra : histedit_source : 1d25ca3c5aa84bad9c641cd60cf7f8d6fff272e8
There's no need to check for unsupported signature formats in this job. They
will have been removed by the signing tasks already.
Leaving it in removes the language packs from upstreamArtifacts so the
Beetmover service does not know how to find those files to copy to the archive
server.
--HG--
extra : rebase_source : cb9d211b96195b5d485796e4d655c7adcdc856b3
Port of D67580.
--HG--
extra : rebase_source : eabdb21a3d3f449a16e5b023f1674032d5393400
extra : amend_source : f074aca7204e2104df30c0668cdf443c78e389fc
Arrange the Treeherder groups so that they are easier to update.
They are now grouped in blocks by category and are alphabetized
within each category.
--HG--
extra : histedit_source : 56b61de5a315d1dbfbc1a9290673d7899c551c56
Port of D67279.
--HG--
extra : rebase_source : 717de5d74be12e1c85c328ac9fedaf9fb1236cd4
extra : histedit_source : adedef6dc0813091295da25f9cd59108a0080ca0
A convenience action to run the l10n-bump task.
--HG--
extra : rebase_source : d4fc6754a326b1e6a7758845cf56e3b9bba2f1cb
extra : histedit_source : be306dfea0422531372c6c6dab496e0950256a03
This is distinct from the default task because "dontbuild" is "false"
(or run a build). This job will run on merge day after the
central-to-beta merge. It will also run on comm-beta after updating
.gecko_rev.yml, which generally is one of the first things done when
preparing a new Thunderbird release.
--HG--
extra : rebase_source : d8aa3258539cddf0540dbdb10d3170d90387a793
extra : histedit_source : 5457188a41d9e540995297b1d810b73274b2737b
Sets up the l10n-bumper task to run in automation for Thunderbird.
Basic config here could run as a cron task or via "Add new jobs" action.
--HG--
extra : rebase_source : 1ed6e9fa54bdb8f14b106157443ff8f999da295c
extra : histedit_source : cab83a4a6c477c71738a8d583b7a8164fca77f3d%2Cf0f6bfb8905cd3d3256905b28a92eeae296dc73a
Set up a new win64 build job that cross-compiles on Linux using clang-cl
and Visual Studio libraries.
--HG--
extra : rebase_source : 1a285da397683ea3e7f63440de80f8a6e1fd168c
extra : histedit_source : 6f0af0f849fce00f949f25f592d19acad59adb14
ja-JP-mac langpacks stick around in upstreamArtifacts because of some of the
special cases in the Firefox transforms to handle langpacks in general and this
locale in particular. Since Thunderbird langpacks are not signed for now, check
that there are no stray entries in upstreamArtifacts sent to signing servers.
--HG--
extra : amend_source : 39517fea753df5d1c7f63f67ba111d4906e13e1c
Rob Lemley
Magnus Melin
Geoff Lankow
David Miller
David Miller
Jorg K