Граф коммитов

308 Коммитов

Автор SHA1 Сообщение Дата
Rob Lemley 25bfed58e7 Bug 1816944 - Allow comm-mach commands to use sites from comm/python/sites. r=dandarnell
"Mutlh" commands are able to use Python "sites" from comm/python/sites in
addition to the already defined "Mach" sites in python/sites.
See README.md in this commit for usage information.

Differential Revision: https://phabricator.services.mozilla.com/D172508

--HG--
extra : moz-landing-system : lando
2023-03-21 21:54:55 +00:00
Rob Lemley 49c202e956 Bug 1816266 - Remove (moz|comm)(rel)?top(src|obj)dir from configure files. r=dandarnell
The only one of these left in use is commtopsrcdir. While not strictly needed,
it is used in m-c code in a few places to detect a Thunderbird build environment.
Without a decent replacement, keep commtopsrcdir around.

Differential Revision: https://phabricator.services.mozilla.com/D169565

--HG--
extra : moz-landing-system : lando
2023-02-15 19:52:11 +00:00
Rob Lemley b9055d0423 Bug 1805699 - Set GCP sccache bucket prefix for Thunderbird builds. r=dandarnell
Set a sccache bucket name prefix for GCP similar to the AWS one. Fixes broken
sccache configuration in CI.

Differential Revision: https://phabricator.services.mozilla.com/D164726
2022-12-14 19:17:39 +00:00
Rob Lemley 0a3539e523 Bug 1803829 - Reformat Python files to standard line length of 99 via black. r=aleca
Differential Revision: https://phabricator.services.mozilla.com/D164734

--HG--
extra : moz-landing-system : lando
2022-12-19 21:10:10 +00:00
Rob Lemley 3105a1a7dc Bug 1799140 - Fix isort lint warnings. r=aleca
Differential Revision: https://phabricator.services.mozilla.com/D164906

--HG--
extra : moz-landing-system : lando
2022-12-19 21:10:08 +00:00
Rob Lemley 7328667ae8 Bug 1801226 - rocbuild.notify utility package. r=dandarnell
Just a wrapper for Taskcluster email notifications.

Differential Revision: https://phabricator.services.mozilla.com/D162417
2022-11-18 16:31:49 +00:00
Martin Giger 7c126d3b7e Bug 1793643 - Add storybook for in-tree style documentation. r=aleca
This initial patch primarily concerns itself with adding the storybook infrastructure, but also provides example pages with our color variables and the pane-splitter widget.

Differential Revision: https://phabricator.services.mozilla.com/D158594

--HG--
extra : amend_source : 4d6ff06ab95fb1267d6cd1460196f6e5390c270b
2022-10-05 14:48:06 +00:00
Rob Lemley 8bd26d1c76 Bug 1779047 - mach tb-esmify command. r=aleca
Modification of "mach esmify" to work with comm-central.

Depends on D158164 in m-c.

Differential Revision: https://phabricator.services.mozilla.com/D155870

--HG--
extra : moz-landing-system : lando
2022-09-28 10:49:58 +00:00
Rob Lemley a980e65cc9 Bug 1772952 - Port bug 1562756: [macOS] Disable allow-dyld-environment-variables entitlement. r=#thunderbird-reviewers,mkmelin
Differential Revision: https://phabricator.services.mozilla.com/D148457

--HG--
extra : amend_source : 5324ff93fa9b60e5fe2e0fa88c9cd16a3c86d9d9
extra : absorb_source : 7edfb7c2e7750204c7623d1bd696671409812b54
2022-06-07 00:06:02 +00:00
Rob Lemley f05b6fbcb9 Bug 1763930 - Remove references to "six" from mozconfigure files. r=mkmelin
Differential Revision: https://phabricator.services.mozilla.com/D145097

--HG--
extra : amend_source : 3dd16c5dd8adb50d5c75e4c96a59a75a6e5435e0
2022-05-02 13:30:35 +03:00
Rob Lemley 5965e2ce51 Bug 1742711 - tb-l10n-x-channel mach command for comm-strings-quarantine. r=aleca
Thunderbird variant of "mach l10n-cross-channel". tb-l10n-x-channel generates
a single "comm-strings" repository containing all strings from the currently
active code repositories (comm-central, comm-beta, etc).
This mach command is mostly meant to run as a Taskcluster "cron" job and
will push changes to a "quarantine" repository for further review.
The URL for the quarantine repository is not final.

Differential Revision: https://phabricator.services.mozilla.com/D131977

--HG--
extra : moz-landing-system : lando
2022-04-22 23:20:34 +00:00
Geoff Lankow 8d258916e1 Bug 1761371 - Port bug 1724274: Move virtualenv dependency manifests to python/virtualenvs. rs=bustage-fix
--HG--
extra : amend_source : 40727671c985bd20c06667874764e367f25b3040
2022-03-25 11:11:52 +13:00
Rob Lemley b01c4d680c Bug 1747879 - Do not set MOZ_SOURCE environment variables in build jobs. r=darktrojan
Debug .sym files contained incorrect VCS references due to MOZ_SOURCE_REPO
and MOZ_SOURCE_CHANGESET being set in the environment reffering to the
Thunderbird repository.
mozconfigure will handle setting these values in the buildconfig.
See D135299.

Differential Revision: https://phabricator.services.mozilla.com/D135392
2022-01-13 19:15:30 +00:00
Rob Lemley 302fcbb457 Bug 1747231 - Port bug 1730712: Fix mach virtualenv initialization. rs=bustage-fix 2021-12-22 12:40:25 -05:00
Rob Lemley 214d2d15ca Bug 1731160 - mach initialization for Thunderbird mach commands. r=darktrojan
Creating mach commands in comm-central. The initialize function
calls the mozilla-central mach initialize first, then modifies
the returned mach.driver.

This implementation allows for new command categories and new mach
command modules. Mach settings providers can also be added in the
mach_commands files.

"mach commlint" is implemented, it just calls "mach lint", but with the
Thunderbird lint configurations in comm/tools/lint.

Requires bug 1731158 in mozilla-central.

Differential Revision: https://phabricator.services.mozilla.com/D125984

--HG--
extra : amend_source : 2699448d31d7e5ec062f6daddb12394301417fb7
2021-11-30 21:37:52 +02:00
Geoff Lankow 89bf5aac20 Backed out two changesets (bug 1731160) so that mach works again.
This change isn't necessarily the problem, bug it's much easier to reverse than bug 1731158 on mozilla-central.

--HG--
extra : amend_source : 93c8fe228eb06f214a31837204d953f30dee19ed
extra : histedit_source : 0d6ab90e92afd47c0baad03606fc3894b54d16ed%2C73b086c097ca95e626c03f35726ce3546ef48706
2021-11-30 18:29:39 +13:00
Rob Lemley 1488c776c1 Bug 1731160 - Follow-up: Black linter reformatting. rs=linting 2021-11-29 14:43:40 -05:00
Rob Lemley 8807e513f4 Bug 1731160 - mach initialization for Thunderbird mach commands. r=darktrojan
Creating mach commands in comm-central. The initialize function
calls the mozilla-central mach initialize first, then modifies
the returned mach.driver.

This implementation allows for new command categories and new mach
command modules. Mach settings providers can also be added in the
mach_commands files.

"mach commlint" is implemented, it just calls "mach lint", but with the
Thunderbird lint configurations in comm/tools/lint.

Requires bug 1731158 in mozilla-central.

Differential Revision: https://phabricator.services.mozilla.com/D125984

--HG--
extra : moz-landing-system : lando
2021-11-29 18:49:17 +00:00
Mitchell Hentges 3c3edcbac1 Bug 1712133 - Remove filename prefix from virtualenv pths r=rjl
Specifying a filename for `sys.path` modifications is
no longer necessary - if a path needs to be on the
Python `sys.path`, then just mark it with `pth:` for
it to go into a `.pth` file in the virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D117934

--HG--
extra : moz-landing-system : lando
2021-06-17 23:15:59 +00:00
Rob Lemley bfcf1f3c91 Bug 1652638 - Unittests for comm_taskgraph.parameters. r=justdave
Differential Revision: https://phabricator.services.mozilla.com/D83860
2021-05-21 00:38:07 +00:00
Rob Lemley 8db3ac3850 Bug 1681607 - [one-repo] Add Mercurial sparse profiles. r=justdave
Some Taskcluster jobs such as the decision task and toolchain builds
do not need the entire source tree checked out. Those jobs use mercurial
sparse profiles to only check out what is needed. Thunderbird builds
mostly use the same profiles as Firefox; these are the new ones that
are required with one-repo.
Note that currently, there are no sparse checkout profiles on any
Thunderbird repository. Adding these files will not affect current
operations.

Differential Revision: https://phabricator.services.mozilla.com/D110432
2021-03-31 16:49:32 +00:00
Rob Lemley 74c6535302 Bug 1672798 - Run black formatting on mozbuild and mozconfigure files. r=mkmelin
Bringing some sanity to our Python scripts.

Differential Revision: https://phabricator.services.mozilla.com/D95402

--HG--
extra : rebase_source : 7eed46d79663fa1f261bd64d9bc1c83c4867bfc4
extra : histedit_source : b8b700c76ab2fee92eb426b5a5b69dc86376e60f
2020-10-30 14:28:33 -04:00
Rob Lemley 94b17a5d1c Bug 1672798 - Run black formatting on all python files. r=mkmelin
Bringing some sanity to our Python scripts.

Differential Revision: https://phabricator.services.mozilla.com/D95400

--HG--
extra : rebase_source : 932e2174a7322a3e2dcde9bf002093e3f895a73f
extra : histedit_source : 6bb0f8818d40de39811c621d6bf12026af999bf6
2020-10-30 13:41:24 -04:00
Magnus Melin 5adff3b0d0 Bug 1621633 - add comm/python/l10n to python path so that ./mach fluent-migration-test will work. r=aleca 2020-05-12 16:01:57 +03:00
Rob Lemley cd060ea195 Bug 1625033 - Create build artifact to generate "Built from" links in Treeherder. r=darktrojan CLOSED TREE
Treeherder is getting an update later this week that affects the "Built from" links that
appear in the Job Details panel. Rather than parsing log files, a build artifact will be
used to display these links.
The artifact is a JSON file in the suggested format.

--HG--
extra : histedit_source : 2baf9841620fdaed198efa23431a04060ab3c1c7
2020-04-28 20:42:30 -04:00
Rob Lemley 83cbd28a24 Bug 1621782 - Import RNP sources into comm-central. r=kaie
Modifications are documented in README.rnp and update-rnp.sh

Differential Revision: https://phabricator.services.mozilla.com/D70738

--HG--
rename : third_party/README.libotr => third_party/README.rnp
extra : moz-landing-system : lando
2020-04-14 22:28:53 +00:00
Rob Lemley ad8b83b437 Bug 1628506 - Port bug 1622972: Switch mach configure to Python 3. rs=bustage-fix
Replace the use of system_encoding with six.ensure_text.
2020-04-08 18:29:48 -04:00
Rob Lemley 4383529935 Bug 1622972 - Fix python-compatibility test errors. r=darktrojan
Fixes for mozlint Python-compatibility test. These files all needed some
future imports.
2020-03-22 12:37:52 +02:00
Magnus Melin d5bf9af402 Backed out changeset 24aae04385e0 (bug 1621633) for breaking cross-channel generation 2020-03-16 08:57:24 +02:00
Magnus Melin bd5464e182 Bug 1621633 - make "./mach fluent-migration-test" work for Thunderbird. r=rjl DONTBUILD 2020-03-14 12:57:43 +02:00
Rob Lemley f7eebc78a4 Bug 1574409 - Use Firefox's mozconfig.cache for Thunderbird. r=darktrojan
This goes with a change to Firefox's build/mozconfig.cache to use a prefix
variable when setting up Sccache buckets on AWS. This will eliminate code
duplication which has caused broken builds in the past.
Thunderbird builds only run on AWS currently so GCP configuration is not
needed.

--HG--
extra : rebase_source : 0b5c334763d196ff3ede0e8edbe1b9b9e3dbcaf4
2019-08-16 03:15:46 -04:00
Rob Lemley 7986779514 Bug 1609987 - Initial support for extending taskgraph with hooks. r=darktrojan
The comm_taskgraph.register function will get called early in the Decision
task. The Fenix project uses this to add functionality in key places via
hooks that aid in customizing the taskgraph.
This is just initial support, extension modules will be added as needed.

--HG--
extra : rebase_source : 5e87d819b40350c1549fdee0a680a5917c91ec84
2020-01-18 14:48:22 -05:00
Rob Lemley 22b95b6daf Bug 1595248 - Port bug 1593041: Add com.apple.security.smartcard entitlement. r=darktrojan
Needed for clients of some CryptoTokenKit.framework API's, per SmartCardServices(7).
2019-11-14 11:46:55 -05:00
Jorg K d240bad229 Bug 1463266 - fix typos in comm-central using codespell. rs=comment-only,typo-fix 2019-10-21 23:07:47 +02:00
Rob Lemley d4b7ecc832 Bug 1586617 - create macOS entitlements.xml specific to Thunderbird requirements. r=darktrojan
Thunderbird has been using Firefox's entitlements files since the Apple's
hardened runtime became a necessity with notarization.
However, Thunderbird cannot access macOS's addressbook for contacts when
running macOS Mojave or Catalina, necessitating this change.
2019-10-11 00:00:17 -04:00
Rob Lemley 7a16820ae8 Bug 1578806 - Fix platform.ini creation when building on macOS. r=darktrojan
The version of sed on macOS does not support the '-i' (edit in-place) option,
causing builds fail. Replacing use of sed with Python.

Fix an off-by-one bug in source_repos.py.
2019-09-04 23:11:04 -04:00
Rob Lemley e6cebe9f6a Bug 1578920 - Bug 1507754 follow-up: fix mach configure failures on local builds. r=darkrojan DONTBUILD
- Change the "hg" command used to identify a revision to the one used by
  Firefox in build/variables.py.
- If "hg" still fails, don't abort the entire configure process.
- Only terminate configure in automation when source repository information
  cannot be determined.
2019-09-04 17:39:40 -04:00
Rob Lemley 75e5401539 Bug 1507754 - Generate proper sourcestamp.txt for source tar files. r=darktrojan DONTBUILD
Build correct sourcestamp.txt in source code tar files.
This builds upon previous commits in this bug using the same urls and revision
hashes that were calculated in the configure process rather than trying to
figure it out again, incorrectly.

This does run as a separate task in Taskcluster, but "mach configure" is one of
the steps that runs before "make source-package" so we can use
"import buildconfig" for this.
2019-08-28 14:34:50 -04:00
Rob Lemley 2649b77be1 Bug 1507754 - Generate source-repo.h with complete source repository data. r=darktrojan
source-repo.h is the file where Thunderbird gets source repository information.
It gets used in the build process, and it used in the app most notably on
about:buildconfig.

In order to accomodate code in the Mozilla tree which is going to look for
MOZ_SOURCE_REPO and MOZ_SOURCE_CHANGESET and assume they are for the app being
built, continue to #define those and also #define values specific to each
repository. This will keep the Thunderbird code that needs to use source-repo.h
easier to read.

This works because comm/mail/app.mozbuild is "included" from the toplevel
moz.build file and therefore is part of the same context. Just overwrite
GENERATED_FILES['source-repo.h'].script with our new script. The EXPORTS
and GENERATED_FILES pieces carry over and do not need to be part of app.mozbuild.
Note that the path to our script is relative to $topsrcdir not app.mozbuild
because it's included, not addded with DIR.

--HG--
extra : rebase_source : 81f667a2ee3ed4ad6a08ec8de39e754845c20d06
2019-08-26 21:31:11 -04:00
Rob Lemley cf7c68b7b8 Bug 1507754 - Check source repositories and changesets during configure. r=darktrojan
PACKAGERS: if you update application.ini, platform.ini, or source-repo.h
in some way during your process, you might need to change something.

Make sure that the source repositories for both Mozilla and Comm can be found
during mach configure and abort if they cannot.

For Taskcluster builds, there are various environment variables that can be
relied upon.

Local builds present a challenge. Chances are those variables are not set.

I came up with a set of checks and keep trying until something works.
For comm-* code:
 - Look for MOZ_SOURCE_REPO and MOZ_SOURCE_CHANGESET environment vars. This
   is counter-intuitive, but it's the current status-quo for Taskcluster
   builds. Those variables are set to the comm values.
 - Next, try use the Mercurial source checkout itself. Uses the same technique
   as Mozilla code does in build/variables.py.
 - Last, try to use a file named "sourcestamp.txt". That file is part of
   our source tar files that get built for releases.
 - Finally, if those MOZ_SOURCE environment variables were not set, set them.
   This is needed because old-configure will look for them and set buildconfig
   variables with them when it runs later during the configure process.
 - Additionally, set MOZ_COMM_SOURCE_REPO and MOZ_COMM_SOURCE_CHANGESET in
   buildconfig. Code in the comm- tree should prefer those values over the
   generic MOZ_SOURCE_* values that the Mozilla code will look at.

For the Gecko/Mozilla source repository information, it's almost the same
process.
- Check for GECKO_SOURCE_REPO and GECKO_SOURCE_REV environment variables first.
  Taskcluster sets these based on comm/.gecko_rev.yml.
- Next, try comm/.gecko_rev.yml itself. PyYAML is not required as the file is
  pretty simple to parse. Release builds are pinned to a specific revision hash,
  so we can use that. Builds from comm-central pin to "default" though, so
  next try running "hg id" in $topsrcdir to get the revision hash.
- If for some reason there's no .gecko_rev.yml and it's not a Mercurial checkout,
  try the sourcestamp.txt file.
- Set MOZ_GECKO_SOURCE_REPO and MOZ_GECKO_SOURCE_CHANGESET in buildconfig.

mach configure should fail if any one of those values cannot be determined.
The error message will suggest setting the environment variables; ideally
that is not necessary.

--HG--
extra : rebase_source : 0f17f25956c679f63b775b15d5a0f0726bb659cb
2019-08-26 21:20:54 -04:00
Rob Lemley c10fecb3aa Bug 1574115 Follow up: Fix path to sccache executable. rs=bustage-fix
--HG--
extra : amend_source : ae677ba2450760f1703b72b15b7601bec87d3661
extra : histedit_source : 2c73527d893017980079fc32af287b2facdea2c5
2019-08-16 01:14:10 -04:00
Rob Lemley abf689ec0b Bug 1543725 - Enable marionette tests on Windows/Linux. r=darktrojan CLOSED TREE DONTBUILD
This is the remaining pieces for enabling marionette tests with macOS disabled for now.

--HG--
extra : amend_source : 64f0811234f60ec986791c83deb114e8040a347e
2019-07-25 19:05:51 -04:00
Jorg K a993de14e9 Bug 1543725 - Backed out 2 changesets for perma-failures on Mac. a=backout DONTBUILD
Backed out changeset 7a364236efd0 (bug 1543725)
Backed out changeset f5f85315ba00 (bug 1543725)
2019-07-06 07:49:54 +02:00
Samuel Thibault 29c49c2bbc Bug 1543725 - Add marionette support to Thunderbird, empty for now. r=rjl,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D27104
2019-06-03 19:42:29 +00:00
Jorg K d92af58186 Backed out 2 changesets (bug 1543725) for build bustage. a=backout
Backed out changeset 63e4680def0f (bug 1543725)
Backed out changeset c76024e437fd (bug 1543725)
2019-06-05 22:28:34 +02:00
Samuel Thibault 0526032ff5 Bug 1543725 - Add marionette support to Thunderbird, empty for now. r=rjl,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D27104
2019-06-03 19:42:29 +00:00
Jorg K 371235b2dc Backed out changeset 4058126a02ed (bug 1543725) for build bustage. a=backout 2019-06-05 19:48:11 +02:00
Samuel Thibault 0b1d3e9fc7 Bug 1543725 - Add marionette support to Thunderbird, empty for now. r=rjl,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D27104
2019-06-03 19:42:29 +00:00
Rob Lemley 5fa37f3b29 Port bug 1553339 - Abandon "2" in sccache toolchain artifacts. r=jorgk
Remove from C-C's copy of mozconfig.cache as well.
2019-05-23 19:07:50 -04:00
Jorg K 3dbbf11e34 Bug 1475060 - remove most files under build/ since they are no longer used. r=tomprince 2018-07-14 00:06:58 +02:00