Removed as part of the multi_dep loader removal.
Differential Revision: https://phabricator.services.mozilla.com/D185116
--HG--
extra : __touch-noise__ : 896606548
extra : histedit_source : 10416469d739bd3dd440a9ba4fa8258f7a29c72e
The taskgraph commands use the mach virtualenv site. Prior to bug 1695312,
that virtualenv had it's sys.path extended with the Thunderbird Python module
paths. That's no longer the case.
This only extends sys.path for the taskgraph mach commands.
Differential Revision: https://phabricator.services.mozilla.com/D184496
--HG--
extra : rebase_source : 493bc082510355f2bb90f0c26f751d807f0401f8
extra : histedit_source : ff22b843db0bb70d06004ce954804c218b2e3d0c
release-update-verify-next tests on comm-esr115 will not include 102.x.y versions
when testing unless the regex matches.
Balrog rule 17775 facilitates these tests on the comm-release-localtest-next
channel. It will be updated at release time via the "thunderbird-release115-localtest-next"
alias.
Differential Revision: https://phabricator.services.mozilla.com/D183079
--HG--
extra : moz-landing-system : lando
Bug 1839789 migrates build tasks; the mingw image falls under that category sort
of. The ATN upload image just do and get it out of the way.
Differential Revision: https://phabricator.services.mozilla.com/D182284
--HG--
extra : amend_source : f083f3643cb0edc4eb97e637198bda52be5fcab5
Bug 1839789 migrates build tasks; the mingw image falls under that category sort
of. The ATN upload image just do and get it out of the way.
Differential Revision: https://phabricator.services.mozilla.com/D182284
--HG--
extra : moz-landing-system : lando
Partial revert of 9fa105a449ae from bug 1832571.
The regressing bug moved macOS build signing and notarization off the iscript
based mac minis and into signingscriptworker itself.
Too much of `comm_taskgraph.transforms.signing` was removed, specifically the
transform that removes upstreamArtifacts with an empty notartization format
from the scriptworker payload. That only ever applied to ja-JP-mac langpacks.
Differential Revision: https://phabricator.services.mozilla.com/D180123
--HG--
extra : moz-landing-system : lando
Currently both macosx64-sdk and macosx64-sdk-toolchain are the same, but they do
occasionally differ.
Differential Revision: https://phabricator.services.mozilla.com/D179501
--HG--
extra : moz-landing-system : lando
It seems safer to select signing by default, and notarization only on
select production projects, otherwise project branches such as toolchains
break because they end up requiring notarization jobs that are filtered
out by not being level 3.
Differential Revision: https://phabricator.services.mozilla.com/D179230
--HG--
extra : moz-landing-system : lando
This will replace the current macOS signing setup. It runs with signingscript
(Linux) vs iscript (macOS).
Differential Revision: https://phabricator.services.mozilla.com/D174663
--HG--
extra : amend_source : 0717bf7c63e1bc02fefc3d32ff9eb1fe9fc031dd
Build was mistakenly changed to use "linux64-rust-dev".
Differential Revision: https://phabricator.services.mozilla.com/D173842
--HG--
extra : amend_source : e90a7c745df0de81e5228b89074fea2af161ad62
Thunderbird does not have an Android port based on Gecko, so there is no
need to include the Android runtimes in the compilers used in CI.
Differential Revision: https://phabricator.services.mozilla.com/D173189
--HG--
extra : moz-landing-system : lando
This will trigger some sorting changes due to lack of support in ruff for isort's
custom classifications.
Depends on D172728
Differential Revision: https://phabricator.services.mozilla.com/D172729
--HG--
extra : moz-landing-system : lando
Override upstream default of tier 2 for Windows 11 tests to ensure that Windows
tests run on try-c-c builds.
Differential Revision: https://phabricator.services.mozilla.com/D172811
--HG--
extra : amend_source : 2a2caf1ff14b598d4fc1dc0f0e4d3c9d752a0b3b
These are set up as tier 2 for now to shake out the bugs with the tests.
Differential Revision: https://phabricator.services.mozilla.com/D171266
--HG--
extra : amend_source : 0a19a521d03fae39f4cf3120197a638a4e00fc06
Marionette tests have been disabled for some time as there are no tests for
Thunderbird that use it directly.
Depends on D171172
Differential Revision: https://phabricator.services.mozilla.com/D171173
--HG--
extra : moz-landing-system : lando
A copy is uploaded for every release candidate, should do the same for
dailies.
Differential Revision: https://phabricator.services.mozilla.com/D116240
--HG--
extra : moz-landing-system : lando
l10n-changesets.json contains the changesets from l10n-central repos and
comm-l10n needed to reproduce strings_all.tar.zst. This file will go into
the source directory on FTP for releases to aid downstream builders trying
to reproduce builds.
Depends on D168610
Differential Revision: https://phabricator.services.mozilla.com/D169257
--HG--
extra : moz-landing-system : lando
In order for pull_locale_source() to retrieve the correct revisions from the
various l10n-central repositories, self.l10n_revisions needs to be populated
with the data in browser/locales/l10n-changesets.json. That file was never
read, so self.l10n_revisions was an empty dict. That being the case,
pull_locale_source() helpfully fell-back to using "default" as the revision.
The fix turns out to be pretty simple, calling self.parse_locales_file()
with browser/locales/l10n-changesets.json fills in self.l10n_revisions with
all of the revisions. Then pull_locale_source() works as expected.
Differential Revision: https://phabricator.services.mozilla.com/D169256
--HG--
extra : moz-landing-system : lando
Requires D166748 on mozilla-central.
This also sets the directory and target SDK versions in the libotr job definition
rather than burying these variables in the build script.
Depends on D166880
Differential Revision: https://phabricator.services.mozilla.com/D166881
--HG--
extra : moz-landing-system : lando
Most of the package jobs are imported via the explicit list anyway, it's not
worth maintaining it. This will result in a net increase of one package that
Thunderbird doesn't utilize while avoiding future bustage.
Differential Revision: https://phabricator.services.mozilla.com/D166570
--HG--
extra : amend_source : 112e11f3cba2a50378adcf9c71a9d2a86c8c44a3
As it's about time to merge ash into comm-central, run some l10n repackaging
jobs on it to avoid surprises later. onchange-locales updated to align with
the top-ten "tier one" locales for Thunderbird.
Differential Revision: https://phabricator.services.mozilla.com/D164871
--HG--
rename : taskcluster/ci/shippable-l10n-pre/kind.yml => taskcluster/ci/l10n-pre/kind.yml
extra : moz-landing-system : lando
The conditional "if this exists, add to the job description" checks in
make_job_description are unnecessary. The docker-image should have been set in
the yaml under "worker" from the start, and the remaining checks won't ever
succeed with the yaml as used today.
Differential Revision: https://phabricator.services.mozilla.com/D164870
--HG--
extra : moz-landing-system : lando
Some of the gecko_taskgraph l10n transforms cause problems. It's easier to
be selective and only run what's needed rather than try to fix issues in the
job description after the fact.
comm_taskgraph's l10n transforms now import individual transform functions
from gecko_taskgraph.transforms.l10n and run them along with some comm-specific
l10n transforms.
Differential Revision: https://phabricator.services.mozilla.com/D164869
--HG--
extra : moz-landing-system : lando
Minimal port of D164082 to fix immediate bustage. Later pieces for M1 macOS
tests and msix-package tests will require additional work.
Differential Revision: https://phabricator.services.mozilla.com/D164517
--HG--
extra : amend_source : 59116f6d18af35c636a06a83232ceaa31c0e250a
The "ash_tasks" filter was too restrictive, and was filtering out all source-test
jobs right away because they do not have a "build-platform" attribute. To get
around that, create a filter for "source-test" jobs that is or'd with the
build_platforms filter.
Differential Revision: https://phabricator.services.mozilla.com/D163382
If a diff file is found after running the cross-channel script, get the head
revision and send an email with a link to it for easy review.
Differential Revision: https://phabricator.services.mozilla.com/D162418
Depends on D162417
The locales list needs to be different for release/beta builds, but that isn't
permitted by gecko_taskgraph. Some of the transforms for shippable-l10n need to
run before the gecko_taskgraph transforms, others after. This is handled by
creating two TransformSequence objects in a single file and arranging the kind
configuration accordingly.
The result is "locales-file" is now keyed by release-type.
Differential Revision: https://phabricator.services.mozilla.com/D162314
--HG--
extra : moz-landing-system : lando
The suite version bump should not be a manual step. Use the text replacement
functionality in merge-automation to do the version bump by calculating the right
old and new versions in the action decision task.
Differential Revision: https://phabricator.services.mozilla.com/D162120
--HG--
extra : amend_source : 222a46dd26c0eccb8ef569f7857ad2a35ad9fba9
Changes to l10n repackaging to use the string translations artifact from
shippable-l10n-pre rather than cloning l10n-central repositories itself.
Depends on D144219
Differential Revision: https://phabricator.services.mozilla.com/D144220
--HG--
extra : moz-landing-system : lando
shippable-l10n-pre combines l10n-central/{locales} with a l10n-comm monorepo
that contains all Thunderbird locales. It packages them into a taskcluster
artifact that will be used by shippable-l10n, which will no longer need to
run the "clone-locales" action.
Mercurial revisions for l10n-central repositories are taken from
browser/locales/l10n-changesets.json, while the actual locales are taken from
comm/mail/locales/{all-locales,shipped-locales} as appropriate.
This initial version does not have any support for l10n-comm being pinned
to a revision as would be needed for release builds.
Differential Revision: https://phabricator.services.mozilla.com/D144219
--HG--
extra : moz-landing-system : lando
Prep work for getting code-review results for comm-central code reviews in
Phabricator.
Differential Revision: https://phabricator.services.mozilla.com/D161504
--HG--
extra : moz-landing-system : lando
Thunderbird langpacks are not signed (intentionally) as is the case for Firefox.
The shippable-l10n-signing task will not have langpack artifacts.
Switch to using the unsigned langpacks from the shippable-l10n job. Since the
repackage transforms from gecko_taskgraph assume "shippable-l10n-signing" will
be the job kind producing the langpacks, another transform is used to set up the
fetch settings.
Differential Revision: https://phabricator.services.mozilla.com/D161220
--HG--
extra : rebase_source : 3774c5473af9cbfcb177cc40f19b96a590dce373
These lines should have been removed in bugs 1771178 and 1678441 respectively.
Depends on D160795
Differential Revision: https://phabricator.services.mozilla.com/D160796
--HG--
extra : moz-landing-system : lando
The l10n-cross-channel job in comm-central ran the wrong command before.
Differential Revision: https://phabricator.services.mozilla.com/D160660
--HG--
extra : amend_source : ab03be73ec150218e036552160f06279829f966e
Final configuration for the Thunderbird cross-channel quarantine automation
job.
This will also create the job, will add to .cron.yml later.
Differential Revision: https://phabricator.services.mozilla.com/D159894
--HG--
extra : moz-landing-system : lando
Final configuration for the Thunderbird cross-channel quarantine automation
job.
This will also create the job, will add to .cron.yml later.
Differential Revision: https://phabricator.services.mozilla.com/D159894
--HG--
extra : amend_source : fbb24c071a152ba6944e6a87f9cd203602c9db64
To avoid duplication of file lists between mozlint configs and taskgraph job
configs, for mozlint jobs use the include, exclude, extensions, and support-files
from the mozlint config to determine when to run.
Most of the work is handled by mozlint.pathutils.filterpaths.
Differential Revision: https://phabricator.services.mozilla.com/D158590
--HG--
extra : amend_source : b37f2c476fe190838a829d54a99e9ad14cf06d56
extra : absorb_source : 84cc10a8b1c5d58a9ba2bd187cfe04c25f205630
Works in conjunction with a Github Actions job that runs at 00:30 UTC. That job
downloads the "are-we-esmified-yet.json" artifact from the most recent run and
updates a JSON file that provides data for the graph and such.
Differential Revision: https://phabricator.services.mozilla.com/D158905
Download bouncer won't go from 105->107. Need to have a run that sets it to
106.0a1 first. After that's done, this can be backed out. Note that the bouncer
alias for nightly is new. It's never been "correct".
Differential Revision: https://phabricator.services.mozilla.com/D158139
Daily cron decision task failed because get_existing_tasks() was called in
gecko_taskgraph.decison.get_decision_parameters() prior to comm_head_rev and
comm_head_repository being added to parameters. The code that reads the associated
environment variables and sets those parameters runs towards the end of
gecko_taskgraph.decison.get_decision_parameters().
To work around that, the --include-push-tasks argument needed to be removed
from the cron decision commandline. To set the needed "existing_tasks" parameter,
introduce CRON_OPTIONS in comm_taskgraph.decision. For supported
target_tasks_methods, a parameters key and a callable accepting (parameters,
graph_config) arguments are iterated over, the callable executed, and
parameters[key] set with the result.
Differential Revision: https://phabricator.services.mozilla.com/D157847
--HG--
extra : moz-landing-system : lando
Moves get_decision_parameters() and associated code into comm_taskgraph.decision
to better mirror how upstream projects structure their taskgraph code.
Differential Revision: https://phabricator.services.mozilla.com/D157846
--HG--
extra : moz-landing-system : lando
This will allow the removal of "comm" specific arguments to "mach taskgraph
decision" that set the comm repository values. The patch takes a cue from
the Fenix project (https://github.com/mozilla-mobile/fenix) which sets taskgraoh
parameters that are not supported in upstream taskgraphfrom an environment
variable that is set in .taskcluster.yml.
Differential Revision: https://phabricator.services.mozilla.com/D157388
--HG--
extra : histedit_source : 231648313bc50bb395c55483800dad982424ed6e
mach decision doesn't have a --comm-base-rev argument yet, so try to guess a value.
Differential Revision: https://phabricator.services.mozilla.com/D156011
--HG--
extra : rebase_source : 2fc8697c40d1c549c82f48ca375618439e6efef4
extra : histedit_source : 630c4a8dbb6c7a0ae99e5088f5de8b48b74c3960
This is mostly to make sure lint checks run on *.mjs files. A few other additions
as well and removing libical from ThirdPartyPaths.txt since it's been removed
from the tree.
Differential Revision: https://phabricator.services.mozilla.com/D157515
--HG--
extra : moz-landing-system : lando
For now, mostly check strings files, some Python code, and documentation/README
files.
Some terms specific to Thunderbird are included in the ignored words list.
Differential Revision: https://phabricator.services.mozilla.com/D157496
--HG--
extra : moz-landing-system : lando
Reference jobs are imported from m-c gecko_taskgraph. There's a check to make
sure that what is named in c-c kind.yml files actually exists.
Bug 1790918 changed toolchain jobs so that toolchain-alias is now possibly keyed
by project. The value has not been resolved when the checking code runs though,
so need to call resolve_keyed_by when looking at toolchain-alias.
Differential Revision: https://phabricator.services.mozilla.com/D157546
--HG--
extra : moz-landing-system : lando
Changes in 1784232 imply that gecko_taskgraph.files_changed is going to be
dropped in favor of upstream taskgraph's copy, which does not know how to
work with the two-repo setup. This keeps Thunderbird CI builds going by
using optimization strategies that work with that setup.
Differential Revision: https://phabricator.services.mozilla.com/D156144
Depends on D156143
"when-files-changed" is internally rewritten as a "skip-unless-changed"
optimization. At some point, it's expected that the later is going to stop
working for the two-repository setup for Thunderbird builds. Tne
"skip-unless-changed-no-suite" optimization suits Thunderbird needs better
and will be kept working.
Differential Revision: https://phabricator.services.mozilla.com/D156143
Depends on D156011
The download bouncer has new support for the "thunderbird-nightly-latest"
products, similar to the aliases that exist for beta and release. Users
will be able to use URLs like
https://download.mozilla.org/?product=thunderbird-nightly-latest-SSL&os=linux64&lang=en-US
which will always point to the latest Daily build.
The bouncer-locations job is responsible for updating the download URL post
merge-day version bump.
Differential Revision: https://phabricator.services.mozilla.com/D154840
--HG--
extra : histedit_source : 7ce4df37d468ce52448062fcdcb719cdafb8fc54
If there was ever a change in the gecko toolchain build job for the macOS
SDK, Thunderbird would not have picked it up as there was nothing in the
index digest calculation to differentiate the new build from a pervious
one. Add in the task id of the gecko toolchain job to the digest calculation.
This way in the unlikely event of an SDK's content really changing, the new
version will get downloaded.
Additionally, a drive-by update to sync get_digest_data with the upstream
copy.
Differential Revision: https://phabricator.services.mozilla.com/D156325
--HG--
extra : moz-landing-system : lando
The download bouncer has new support for the "thunderbird-nightly-latest"
products, similar to the aliases that exist for beta and release. Users
will be able to use URLs like
https://download.mozilla.org/?product=thunderbird-nightly-latest-SSL&os=linux64&lang=en-US
which will always point to the latest Daily build.
The bouncer-locations job is responsible for updating the download URL post
merge-day version bump.
Differential Revision: https://phabricator.services.mozilla.com/D154840
--HG--
extra : amend_source : e3f1913d43c69036e6f2774902dbd7afc49e13aa
Ash is being used for some big Thunderbird UI projects. Create a target_tasks_method
for the project to run a reduced set of build platforms. linux64, macosx64, win64
Differential Revision: https://phabricator.services.mozilla.com/D155087
The import order problem has been identified, so this horrible hack can be
removed.
This patch depends on D152446 landing in mozilla-central.
Differential Revision: https://phabricator.services.mozilla.com/D152447
--HG--
extra : histedit_source : 65b949bd30b63562160390f6fc8fb91afd145941
The openpgp directory no longer needs to be scanned. Ignore the text file that's
inexplicably in the calendar directory.
Drive by - fix license lint yaml file per mozlint
Differential Revision: https://phabricator.services.mozilla.com/D147591
--HG--
extra : amend_source : 1fa232cd95fa30a32e065ebccc7145104b2434b1
extra : histedit_source : 9b39b2612f5943e9bbaeb1e37de1314aba80187d
macOS 10.12 and higher is still supported at runtime via -mmacosx-version-min.
Differential Revision: https://phabricator.services.mozilla.com/D131675
--HG--
extra : moz-landing-system : lando
Use of the run_on_releases transform is only needed when "run-on-releases" is
present in the job description.
Differential Revision: https://phabricator.services.mozilla.com/D147202
--HG--
extra : amend_source : 5ea929d30fca062b9776ecc3abee1d4fd849de92
extra : histedit_source : e5c6042af27bda0b85956e0daace8b6b7a959cb6
We generally use lower values for the background/update rate on early betas and
increase as we iterate. It's rare that we do more than 4 betas in a cycle. In
those cases, the default "null" value will not change the rate.
Differential Revision: https://phabricator.services.mozilla.com/D147109
--HG--
extra : moz-landing-system : lando
update_verify_config.py is mostly copied verbatim from gecko_taskgraph. The
changes are in INCLUDE_VERSION_REGEXES and MAR_CHANNEL_ID_OVERRIDE_REGEXES
which are modified to be more suitable for Thunderbird.
The "beta" INCLUDE regex will only match version numbers ending "bN". This
is to avoid trying to test updating a release version like 91.0 to a beta.
For Firefox, the "bN" is optional as they test updating release versions to
late betas.
Differential Revision: https://phabricator.services.mozilla.com/D145386
Depends on D145385
--HG--
extra : histedit_source : c32957330c914fc047ec8458482fc6fc13d15f9d
Replacing references to comm-esr91 with comm-esr102. As this patch is not
intended for uplift to comm-esr91, that's not a problem.
Opting to remove the "comm-bump-esr" block from config.yml. That is intended to
run with the c-central to c-beta merges. It's never been used and it's unlikely
that it will be since patch-level releases from Thunderbird's comm-esrXX occur
regularly. This would bump the version too early and force patch releases to
use a release branch unnecessarily.
Differential Revision: https://phabricator.services.mozilla.com/D145385
--HG--
extra : histedit_source : 74e42b2f60aa741f78ff4e426a25e466ce6f76ee
Fix try syntax issues with "-p macosx64" not working as expected on
try-comm-central.
Firefox try jobs replace macosx64 with macosx64-shippable. That's never worked
right on try-c-c because of subtle differences in the taskgraph configuration.
Shippable jobs are slower to build due to sccache not being used. macosx64-shippable
builds also build for aarch64 which is unnecessary considering the test hardware
is all Intel.
Differential Revision: https://phabricator.services.mozilla.com/D145681
--HG--
extra : amend_source : 58deadab05a121cb613fb7af76255baf2ab87fab
The functions in this file have not been used in some time.
Differential Revision: https://phabricator.services.mozilla.com/D144501
--HG--
extra : amend_source : 12ed5c9bd8f9ffc859cb0800cb52934542234c5d
No one wants to download a 275MB update every day.
Differential Revision: https://phabricator.services.mozilla.com/D144332
--HG--
extra : amend_source : 6ef7e8edf85868febaebdd05a649b066dbd3791a
In theory, there's some process that happens on the vendor side that will update
virus scanners to reduce false positives.
Differential Revision: https://phabricator.services.mozilla.com/D141695
--HG--
extra : histedit_source : 2657ba76e4993f217ca2b5464c63733958f6b333
Using this optimization on try-c-c builds just causes confusion. If a developer
pushes to try, builds should run. There should not be any algorithms overriding
what was asked for.
Differential Revision: https://phabricator.services.mozilla.com/D141141
--HG--
extra : moz-landing-system : lando
libotr.dll did not have debug symbols stripped prior to packaging due to not
really being integrated into the build. This resulted in Thunderbird shipping
an 11MB libotr.dll file.
Adding the "-s" argument to the link command brings the DLL size down to ~1.5MB
which is in-line with other platforms.
I verified that Linux and macOS builds of libotr do not have debug symbols in
the shipped builds.
Differential Revision: https://phabricator.services.mozilla.com/D140505
--HG--
extra : amend_source : edb30993a0e5a8053dd5c31d6f9225961691b25c
Rob Lemley
Daniel Darnell
Geoff Lankow
Magnus Melin
Sean Burke
Alessandro Castellani
Nicolai Kasper