Граф коммитов

290 Коммитов

Автор SHA1 Сообщение Дата
Mitchell Hentges 3c3edcbac1 Bug 1712133 - Remove filename prefix from virtualenv pths r=rjl
Specifying a filename for `sys.path` modifications is
no longer necessary - if a path needs to be on the
Python `sys.path`, then just mark it with `pth:` for
it to go into a `.pth` file in the virtualenv.

Differential Revision: https://phabricator.services.mozilla.com/D117934

--HG--
extra : moz-landing-system : lando
2021-06-17 23:15:59 +00:00
Rob Lemley bfcf1f3c91 Bug 1652638 - Unittests for comm_taskgraph.parameters. r=justdave
Differential Revision: https://phabricator.services.mozilla.com/D83860
2021-05-21 00:38:07 +00:00
Rob Lemley 8db3ac3850 Bug 1681607 - [one-repo] Add Mercurial sparse profiles. r=justdave
Some Taskcluster jobs such as the decision task and toolchain builds
do not need the entire source tree checked out. Those jobs use mercurial
sparse profiles to only check out what is needed. Thunderbird builds
mostly use the same profiles as Firefox; these are the new ones that
are required with one-repo.
Note that currently, there are no sparse checkout profiles on any
Thunderbird repository. Adding these files will not affect current
operations.

Differential Revision: https://phabricator.services.mozilla.com/D110432
2021-03-31 16:49:32 +00:00
Rob Lemley 74c6535302 Bug 1672798 - Run black formatting on mozbuild and mozconfigure files. r=mkmelin
Bringing some sanity to our Python scripts.

Differential Revision: https://phabricator.services.mozilla.com/D95402

--HG--
extra : rebase_source : 7eed46d79663fa1f261bd64d9bc1c83c4867bfc4
extra : histedit_source : b8b700c76ab2fee92eb426b5a5b69dc86376e60f
2020-10-30 14:28:33 -04:00
Rob Lemley 94b17a5d1c Bug 1672798 - Run black formatting on all python files. r=mkmelin
Bringing some sanity to our Python scripts.

Differential Revision: https://phabricator.services.mozilla.com/D95400

--HG--
extra : rebase_source : 932e2174a7322a3e2dcde9bf002093e3f895a73f
extra : histedit_source : 6bb0f8818d40de39811c621d6bf12026af999bf6
2020-10-30 13:41:24 -04:00
Magnus Melin 5adff3b0d0 Bug 1621633 - add comm/python/l10n to python path so that ./mach fluent-migration-test will work. r=aleca 2020-05-12 16:01:57 +03:00
Rob Lemley cd060ea195 Bug 1625033 - Create build artifact to generate "Built from" links in Treeherder. r=darktrojan CLOSED TREE
Treeherder is getting an update later this week that affects the "Built from" links that
appear in the Job Details panel. Rather than parsing log files, a build artifact will be
used to display these links.
The artifact is a JSON file in the suggested format.

--HG--
extra : histedit_source : 2baf9841620fdaed198efa23431a04060ab3c1c7
2020-04-28 20:42:30 -04:00
Rob Lemley 83cbd28a24 Bug 1621782 - Import RNP sources into comm-central. r=kaie
Modifications are documented in README.rnp and update-rnp.sh

Differential Revision: https://phabricator.services.mozilla.com/D70738

--HG--
rename : third_party/README.libotr => third_party/README.rnp
extra : moz-landing-system : lando
2020-04-14 22:28:53 +00:00
Rob Lemley ad8b83b437 Bug 1628506 - Port bug 1622972: Switch mach configure to Python 3. rs=bustage-fix
Replace the use of system_encoding with six.ensure_text.
2020-04-08 18:29:48 -04:00
Rob Lemley 4383529935 Bug 1622972 - Fix python-compatibility test errors. r=darktrojan
Fixes for mozlint Python-compatibility test. These files all needed some
future imports.
2020-03-22 12:37:52 +02:00
Magnus Melin d5bf9af402 Backed out changeset 24aae04385e0 (bug 1621633) for breaking cross-channel generation 2020-03-16 08:57:24 +02:00
Magnus Melin bd5464e182 Bug 1621633 - make "./mach fluent-migration-test" work for Thunderbird. r=rjl DONTBUILD 2020-03-14 12:57:43 +02:00
Rob Lemley f7eebc78a4 Bug 1574409 - Use Firefox's mozconfig.cache for Thunderbird. r=darktrojan
This goes with a change to Firefox's build/mozconfig.cache to use a prefix
variable when setting up Sccache buckets on AWS. This will eliminate code
duplication which has caused broken builds in the past.
Thunderbird builds only run on AWS currently so GCP configuration is not
needed.

--HG--
extra : rebase_source : 0b5c334763d196ff3ede0e8edbe1b9b9e3dbcaf4
2019-08-16 03:15:46 -04:00
Rob Lemley 7986779514 Bug 1609987 - Initial support for extending taskgraph with hooks. r=darktrojan
The comm_taskgraph.register function will get called early in the Decision
task. The Fenix project uses this to add functionality in key places via
hooks that aid in customizing the taskgraph.
This is just initial support, extension modules will be added as needed.

--HG--
extra : rebase_source : 5e87d819b40350c1549fdee0a680a5917c91ec84
2020-01-18 14:48:22 -05:00
Rob Lemley 22b95b6daf Bug 1595248 - Port bug 1593041: Add com.apple.security.smartcard entitlement. r=darktrojan
Needed for clients of some CryptoTokenKit.framework API's, per SmartCardServices(7).
2019-11-14 11:46:55 -05:00
Jorg K d240bad229 Bug 1463266 - fix typos in comm-central using codespell. rs=comment-only,typo-fix 2019-10-21 23:07:47 +02:00
Rob Lemley d4b7ecc832 Bug 1586617 - create macOS entitlements.xml specific to Thunderbird requirements. r=darktrojan
Thunderbird has been using Firefox's entitlements files since the Apple's
hardened runtime became a necessity with notarization.
However, Thunderbird cannot access macOS's addressbook for contacts when
running macOS Mojave or Catalina, necessitating this change.
2019-10-11 00:00:17 -04:00
Rob Lemley 7a16820ae8 Bug 1578806 - Fix platform.ini creation when building on macOS. r=darktrojan
The version of sed on macOS does not support the '-i' (edit in-place) option,
causing builds fail. Replacing use of sed with Python.

Fix an off-by-one bug in source_repos.py.
2019-09-04 23:11:04 -04:00
Rob Lemley e6cebe9f6a Bug 1578920 - Bug 1507754 follow-up: fix mach configure failures on local builds. r=darkrojan DONTBUILD
- Change the "hg" command used to identify a revision to the one used by
  Firefox in build/variables.py.
- If "hg" still fails, don't abort the entire configure process.
- Only terminate configure in automation when source repository information
  cannot be determined.
2019-09-04 17:39:40 -04:00
Rob Lemley 75e5401539 Bug 1507754 - Generate proper sourcestamp.txt for source tar files. r=darktrojan DONTBUILD
Build correct sourcestamp.txt in source code tar files.
This builds upon previous commits in this bug using the same urls and revision
hashes that were calculated in the configure process rather than trying to
figure it out again, incorrectly.

This does run as a separate task in Taskcluster, but "mach configure" is one of
the steps that runs before "make source-package" so we can use
"import buildconfig" for this.
2019-08-28 14:34:50 -04:00
Rob Lemley 2649b77be1 Bug 1507754 - Generate source-repo.h with complete source repository data. r=darktrojan
source-repo.h is the file where Thunderbird gets source repository information.
It gets used in the build process, and it used in the app most notably on
about:buildconfig.

In order to accomodate code in the Mozilla tree which is going to look for
MOZ_SOURCE_REPO and MOZ_SOURCE_CHANGESET and assume they are for the app being
built, continue to #define those and also #define values specific to each
repository. This will keep the Thunderbird code that needs to use source-repo.h
easier to read.

This works because comm/mail/app.mozbuild is "included" from the toplevel
moz.build file and therefore is part of the same context. Just overwrite
GENERATED_FILES['source-repo.h'].script with our new script. The EXPORTS
and GENERATED_FILES pieces carry over and do not need to be part of app.mozbuild.
Note that the path to our script is relative to $topsrcdir not app.mozbuild
because it's included, not addded with DIR.

--HG--
extra : rebase_source : 81f667a2ee3ed4ad6a08ec8de39e754845c20d06
2019-08-26 21:31:11 -04:00
Rob Lemley cf7c68b7b8 Bug 1507754 - Check source repositories and changesets during configure. r=darktrojan
PACKAGERS: if you update application.ini, platform.ini, or source-repo.h
in some way during your process, you might need to change something.

Make sure that the source repositories for both Mozilla and Comm can be found
during mach configure and abort if they cannot.

For Taskcluster builds, there are various environment variables that can be
relied upon.

Local builds present a challenge. Chances are those variables are not set.

I came up with a set of checks and keep trying until something works.
For comm-* code:
 - Look for MOZ_SOURCE_REPO and MOZ_SOURCE_CHANGESET environment vars. This
   is counter-intuitive, but it's the current status-quo for Taskcluster
   builds. Those variables are set to the comm values.
 - Next, try use the Mercurial source checkout itself. Uses the same technique
   as Mozilla code does in build/variables.py.
 - Last, try to use a file named "sourcestamp.txt". That file is part of
   our source tar files that get built for releases.
 - Finally, if those MOZ_SOURCE environment variables were not set, set them.
   This is needed because old-configure will look for them and set buildconfig
   variables with them when it runs later during the configure process.
 - Additionally, set MOZ_COMM_SOURCE_REPO and MOZ_COMM_SOURCE_CHANGESET in
   buildconfig. Code in the comm- tree should prefer those values over the
   generic MOZ_SOURCE_* values that the Mozilla code will look at.

For the Gecko/Mozilla source repository information, it's almost the same
process.
- Check for GECKO_SOURCE_REPO and GECKO_SOURCE_REV environment variables first.
  Taskcluster sets these based on comm/.gecko_rev.yml.
- Next, try comm/.gecko_rev.yml itself. PyYAML is not required as the file is
  pretty simple to parse. Release builds are pinned to a specific revision hash,
  so we can use that. Builds from comm-central pin to "default" though, so
  next try running "hg id" in $topsrcdir to get the revision hash.
- If for some reason there's no .gecko_rev.yml and it's not a Mercurial checkout,
  try the sourcestamp.txt file.
- Set MOZ_GECKO_SOURCE_REPO and MOZ_GECKO_SOURCE_CHANGESET in buildconfig.

mach configure should fail if any one of those values cannot be determined.
The error message will suggest setting the environment variables; ideally
that is not necessary.

--HG--
extra : rebase_source : 0f17f25956c679f63b775b15d5a0f0726bb659cb
2019-08-26 21:20:54 -04:00
Rob Lemley c10fecb3aa Bug 1574115 Follow up: Fix path to sccache executable. rs=bustage-fix
--HG--
extra : amend_source : ae677ba2450760f1703b72b15b7601bec87d3661
extra : histedit_source : 2c73527d893017980079fc32af287b2facdea2c5
2019-08-16 01:14:10 -04:00
Rob Lemley abf689ec0b Bug 1543725 - Enable marionette tests on Windows/Linux. r=darktrojan CLOSED TREE DONTBUILD
This is the remaining pieces for enabling marionette tests with macOS disabled for now.

--HG--
extra : amend_source : 64f0811234f60ec986791c83deb114e8040a347e
2019-07-25 19:05:51 -04:00
Jorg K a993de14e9 Bug 1543725 - Backed out 2 changesets for perma-failures on Mac. a=backout DONTBUILD
Backed out changeset 7a364236efd0 (bug 1543725)
Backed out changeset f5f85315ba00 (bug 1543725)
2019-07-06 07:49:54 +02:00
Samuel Thibault 29c49c2bbc Bug 1543725 - Add marionette support to Thunderbird, empty for now. r=rjl,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D27104
2019-06-03 19:42:29 +00:00
Jorg K d92af58186 Backed out 2 changesets (bug 1543725) for build bustage. a=backout
Backed out changeset 63e4680def0f (bug 1543725)
Backed out changeset c76024e437fd (bug 1543725)
2019-06-05 22:28:34 +02:00
Samuel Thibault 0526032ff5 Bug 1543725 - Add marionette support to Thunderbird, empty for now. r=rjl,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D27104
2019-06-03 19:42:29 +00:00
Jorg K 371235b2dc Backed out changeset 4058126a02ed (bug 1543725) for build bustage. a=backout 2019-06-05 19:48:11 +02:00
Samuel Thibault 0b1d3e9fc7 Bug 1543725 - Add marionette support to Thunderbird, empty for now. r=rjl,whimboo
Differential Revision: https://phabricator.services.mozilla.com/D27104
2019-06-03 19:42:29 +00:00
Rob Lemley 5fa37f3b29 Port bug 1553339 - Abandon "2" in sccache toolchain artifacts. r=jorgk
Remove from C-C's copy of mozconfig.cache as well.
2019-05-23 19:07:50 -04:00
Jorg K 3dbbf11e34 Bug 1475060 - remove most files under build/ since they are no longer used. r=tomprince 2018-07-14 00:06:58 +02:00
Jorg K f4a4b3f638 Bug 1471061 - Follow-up: Remove MOZ_ADDON_SIGNING from build/mozconfig.common. r=me DONTBUILD 2018-07-10 12:29:00 +02:00
Tom Prince 2b97015111 Bug 1453870: Remove check-sync task and metadata; r=Fallen
Differential Revision: https://phabricator.services.mozilla.com/D934

--HG--
extra : rebase_source : 789dfdf3ff80bb92d554ca05d19de691c27c0835
2018-04-12 21:11:43 -06:00
Tom Prince 6f242c1cc1 Bug 1366607: Drop support for building with comm-central in automation mozconfigs; r=Fallen
Differential Revision: https://phabricator.services.mozilla.com/D930

--HG--
extra : rebase_source : f1ab070dc59479676674e5e32967a73a201ceb50
2018-04-12 21:25:40 -06:00
Jorg K a24058021b Port bug 1453317: Update VS2017 used in automation to version 15.6.6. rs=bustage-fix 2018-04-12 09:29:54 +02:00
Frank-Rainer Grahl 4226635f7f Bug 1445189 - Use VS2017 15.6 for Windows x86 builds. r=jorgk
--HG--
rename : build/win32/mozconfig.vs2015-win64 => build/win32/mozconfig.vs2017
2018-03-13 13:30:00 +01:00
"Edmund Wong ext:(%22) 15be4c8687 Bug 1450257 - Set LLVM_CONFIG in mozconfig.stylo and have platform mozconfigs read from this file again
--HG--
rename : suite/config/mozconfigs/win64/release-l10 => suite/config/mozconfigs/win64/release-l10n
2018-04-10 10:14:34 +08:00
Jorg K 62edb50a14 Bug 1445189 - Port bug 1424281: Use Visual Studio 2017 15.6.0 for Windows builds. rs=bustage-fix 2018-03-13 11:40:39 +01:00
Tom Prince 5545b4a65a Add sync exception for mozconfig.linux* (PKG_CONFIG_LIBDIR is needed on buildbot); rs=bustage-fix 2018-01-30 09:24:08 -07:00
Tom Prince 7e348137ff Backed out changeset fb09e4b27ed4 (Port bug 1431251: Remove PKG_CONFIG_LIBDIR from mozconfigs); rs=bustage-fix 2018-01-30 09:21:32 -07:00
Jorg K 796dea8a05 Keep build files in sync (Port bug 1431251: Remove PKG_CONFIG_LIBDIR from mozconfigs). rs=bustage-fix DONTBUILD 2018-01-30 11:13:49 +01:00
Jorg K 7c4fc53b79 Keep build files in sync (Port bug 1429947: Unset WIN64_LINK and WIN64_LIB in in-tree mozconfigs during an artifact build). rs=bustage-fix 2018-01-27 11:12:02 +01:00
Tom Prince 5da6e2caca Bug 1432611: Remove build/macosx/cross-mozconfig.common from comm-central; r=frg
MozReview-Commit-ID: 4UA305JUMAu

--HG--
extra : rebase_source : b1713055d33c37fcb9888ed743558e3e65ad44a6
extra : amend_source : 0133d6764f5ee20f676c43152e4977c288187962
extra : histedit_source : 9ae7db78b829a52e2a95c97d9b1a93b6fbcccd11
2018-01-23 11:20:00 -07:00
Jorg K 5841c5aded Keep build files in sync (Port bug 1430036: Don't set PKG_CONFIG_LIBDIR when building on Debian). rs=bustage-fix 2018-01-12 23:54:20 +01:00
Jorg K a7e4674bca Keep build files in sync (Port 1427339: Make mozconfig.stdcxx work with both CentOS and Debian-built GCCs). rs=bustage-fix 2018-01-06 11:32:22 +01:00
Tom Prince 3a5df63ac7 No bug: Sync build filles: remove unused `build/win32/mozconfig.vs2017; r=me DONTBUILD
--HG--
extra : uncommit_source : 0653bb72371c
extra : amend_source : 5b8f5b366bdc8edbd9faeadf83c274edc74247f5
2018-01-05 13:42:34 -07:00
Tom Prince 7d87de3301 Bug 1423801: Use comm-central sccache buckets; r?Fallen
MozReview-Commit-ID: Hiuze3ySTh9

--HG--
extra : rebase_source : 00a3312ebcc12ab7339d2b23c3903f334e8cbdbb
2018-01-03 16:40:38 -07:00
Tom Prince cc8d4ce99e Bug 1426892: Use ccache on buildbot; r?Fallen.
MozReview-Commit-ID: FwVfmH4ae6S

--HG--
extra : rebase_source : 99925631eb06d90ed7366d647f7691ea6a08672c
2017-12-21 12:12:42 -07:00
Jorg K 3a1c4beb93 Keep build files in sync (Port bug 1427404: Always export PATH when passing it through mk_add_options). rs=bustage-fix 2018-01-04 11:06:48 +01:00