Граф коммитов

2973 Коммитов

Автор SHA1 Сообщение Дата
Nathan Froyd e2533026b6 Bug 1461926 - delete unneeded managing of dist/idl from the tup backend; r=mshal
We don't need to install anything in dist/idl anymore.
2018-05-17 10:16:46 -04:00
Mike Shal 642a32a948 Bug 1461795 - Use FileAvoidWrite when writing mozinfo.json; r=chmanchester
Since MozbuildObject.from_environment() reads from mozinfo.json, tup
picks up that file as a dependency for anything that imports buildconfig
(eg: all generated files). Using FileAvoidWrite when creating
mozinfo.json will help avoid unnecessary work after re-running configure
in the tup backend.

MozReview-Commit-ID: EEOPQYJA1MV

--HG--
extra : rebase_source : 136a0579090776dc55ea5cee870574f13cc27c58
2018-05-14 17:30:21 -04:00
Dorel Luca 0d2ff9e60d Merge mozilla-inbound to mozilla-central. a=merge 2018-05-16 00:54:22 +03:00
Nathan Froyd 9bd5c61497 Bug 1459721 - part 8 - pass full paths for IDL files to xpidl-process.py; r=chmanchester
The build system knows at build-backend time where to find each IDL
file; making xpidl-process.py rediscover this by requiring
xpidl-process.py to search through directories to find input IDL files
is silly.  To rememdy this, we're going to modify things so full paths
are passed into the script.  Those paths can then be used directly, with
no searching.
2018-05-15 10:05:23 -04:00
Nathan Froyd 33635829ac Bug 1459721 - part 7 - remove dist_idl install manifest; r=chmanchester
We no longer need to install the IDL files to the objdir for
processing. \o/
2018-05-15 10:05:23 -04:00
Nathan Froyd 2f6686cbec Bug 1459721 - part 5 - explicitly specify include directories for xpidl files; r=chmanchester
The previous patch required us to pass a single -I argument pointing at
$(DIST)/idl so IDL include statements would work correctly.  This patch
lifts that limitation and explicitly points xpidl-process.py at the
locations of all the IDL source directories to search for included IDL
files.  Invocations of xpidl-process.py no longer depend on IDL files
being copied to the objdir.
2018-05-15 10:05:24 -04:00
Nathan Froyd 236d75aaae Bug 1459721 - part 4 - explicitly specify input directories for xpidl modules; r=chmanchester
Building on the last patch, we can change the build process to pass in
the directories where the input IDL files can be found.  It is
convenient to pass in just the relative source directory paths, to
encourage people to not look in the object directory and to make the
command lines slightly shorter.

xpidl-process.py still assumes that included IDL files can be found by
looking in a single directory.  We add a single -I argument to the
invocation of xpidl-process.py to accommodate this short-sightedness.
2018-05-15 10:05:24 -04:00
Nathan Froyd 31e67ea398 Bug 1459721 - part 3 - enable multiple input paths for xpidl-process.py; r=chmanchester
The current IDL build setup assumes that all IDL files can be found in a
single directory.  This setup requires that all IDL files be copied to a
single directory, which is suboptimal in terms of disk I/O and also
complicates things like generating IDL files at build time.

As a first step in moving away from this state of affairs,
xpidl-process.py needs to be taught that the input IDL files could
potentially be found in multiple directories.  The current setup can
just specify $(DIST)/idl as the lone directory to examine.  Future
patches will change this to examine multiple directories.
2018-05-15 10:05:24 -04:00
Nathan Froyd f07a68f051 Bug 1459721 - part 2 - remove install_target member from XPIDLManager.modules; r=chmanchester
This member is unused, so we might as well dispense with it.
2018-05-15 10:05:24 -04:00
Nathan Froyd 1567073b56 Bug 1459721 - part 1 - remove allow_existing keyword arg from register_idl; r=chmanchester
This method is only called in one place, and it doesn't pass
allow_existing.  Whatever ugly thing this keyword was working around
doesn't exist anymore, so let's get rid of it.
2018-05-15 10:05:24 -04:00
Mike Shal 8f1ede4723 Bug 1454912 - Revert "Bug 1218999 - Update mtimes when building a GENERATED_FILES target, even when contents don't change."; r=nalexander
We no longer want to update mtimes of FileAvoidWrites so that downstream
rules aren't triggered if the files aren't changed. Since the .stub file
target of GENERATED_FILES are always touched, make won't continually
rebuild them.

MozReview-Commit-ID: GxrFgCJTYk

--HG--
extra : rebase_source : f4412af1dc29142b76f7695627ba3354baf84edd
2018-05-09 16:51:04 -04:00
Mike Shal 8d4c5d5849 Bug 1454912 - Use a .stub file as the target for all GENERATED_FILES rules; r=nalexander
The make backend was treating the first output of a GENERATED_FILES rule
specially, since it was the target of the rule containing the script
invocation. We want the outputs of GENERATED_FILES rules to be
FileAvoidWrite so that we avoid triggering downstream rules if the
outputs are unchanged, but if the target of the script invocation is
FileAvoidWrite, then make may continually re-run the script during a
no-op build.

The solution here is to use a stub file as the target of the script
invocation which will always be touched when the script runs. Since
nothing else in the build depends on the stub, we don't need to
FileAvoidWrite it. All actual outputs of the script can be
FileAvoidWrite, and make can properly avoid work for files that haven't
changed.

MozReview-Commit-ID: 3GejZw2tpqu

--HG--
extra : rebase_source : 2b9be82f893e89a4c2f254f05b1e8b9a0f9c631b
2018-05-09 08:24:31 -04:00
Mike Shal 6ecfac2683 Bug 1454912 - Only output dependencies for GENERATED_FILES with scripts; r=nalexander
Some GENERATED_FILES entries don't have .scripts associated with them
(notably midl on Windows builds). In this case, we don't want to
generate dependencies automatically since they will be handled by the
Makefiles.

MozReview-Commit-ID: AXmN2Unk9AY

--HG--
extra : rebase_source : 1f06672add87c46ae199189fcae27b721e008f9e
2018-05-09 16:53:19 -04:00
Mike Shal ae545cfb52 Bug 1461488 - trim tup's display of commands with many outputs; r=chmanchester
Some commands produce a large number of output files, such as
make-system-wrappers.py, which has over 1000 outputs. The GeneratedFile
handler in the tup backend displayed all the outputs, which makes the
build output unreadable, and breaks 'tup graph'. This patch displays
only the first 3 outputs and truncates the rest.

MozReview-Commit-ID: 5AnrmMe0Nyx

--HG--
extra : rebase_source : 1a6766be36aef4603c1e5333cfc13af006369966
2018-05-11 15:55:00 -04:00
Myk Melez 1c99762628 Bug 1459661 - require cargo-vendor version 0.1.14. r=kats
MozReview-Commit-ID: FRSzL74N8vY

--HG--
extra : rebase_source : 39fa35ce687793db28c0bc47466bdd4af491aeaf
2018-05-14 21:28:39 -07:00
Andi-Bogdan Postelnicu c8262a2d3f Bug 1459862 - Mach static-analysis autotest - run tests in parallel. r=gps
MozReview-Commit-ID: LxTmytjaPAn

--HG--
extra : rebase_source : 4492b34f9ba0ab3f7b44693f5f3c548a9af4bc0e
2018-05-08 12:36:57 +03:00
Andi-Bogdan Postelnicu 0374067886 Bug 1432410 - Add tests in tree to make sure we don't regress with clang-tidy on static-analisys. Tests wrote in part by :sylvestre. r=gps
MozReview-Commit-ID: IWxzKfWNIHG

--HG--
extra : rebase_source : d2bd65c66541e5d6e8d5cc721b117f0a3e7716e8
2018-05-03 20:06:16 +03:00
Andrew Halberstadt 970f7e41b1 Bug 1458571 - Use base testing/profiles in raptor, r=rwood
This gets raptor to use the newly created "perf" profile that talos
also uses. There is a single pref that raptor sets that we can't set
in talos. To that end, this also creates a "raptor" specific profile.

This means to set a pref in talos and raptor, edit:
testing/profiles/perf/user.js

To set a pref in raptor only, edit:
testing/profiles/raptor/user.js

The performance of extensions can now be tested by dropping the
extension into:
testing/profiles/perf/extensions

MozReview-Commit-ID: LEJeytmmiFF

--HG--
extra : rebase_source : 0d2a6b18868f8cc6ff198ef868ad0324b57b1dc2
2018-05-04 11:19:49 -04:00
Andrew Halberstadt afea2c586c Bug 1458571 - Use base testing/profiles in talos, r=rwood
This moves all of the global prefs that were previously defined
in testing/talos/talos/config.py, into a new "perf" profile under
testing/profiles/perf/user.js.

This perf profile will be shared with raptor, so changes to one
framework will result in changes to the other.

MozReview-Commit-ID: JRxZEDlPu6b

--HG--
extra : rebase_source : 38f61eb6f9dd3e8dd9e0425ffe32dbdf845fcf65
2018-05-09 15:06:53 -04:00
Andrew Halberstadt 11734ea63e Bug 1454640 - [mozbuild] Ability to find sphinx variables relevant to a given path r=mshal
The current mechanism for reading SPHINX variables assumes we always want to
read metadata for the entire tree. Now that we have the ability to rebuild
specific subtrees, this assumption is false.

This patch allows us to specify a path that find_sphinx_variables can use to
filter down the set of moz.build variables it will traverse, yielding only
moz.builds that could potentially impact the specified path.

MozReview-Commit-ID: ALrCFLFgMLH

--HG--
extra : source : 22f2dc60e6d859d3ca411826c77002d87c1a49bd
2018-04-17 11:51:37 -04:00
Andrew Halberstadt 03da91b713 Bug 1454640 - [docs] Use a single SphinxManager instance across all rebuilds r=mshal
In the mozbuild.sphinx extension, we create a new SphinxManager instance each
time. However this isn't ideal now that we can rebuild the docs within the same
interpreter using the livereload server.

This makes use of a singleton so that we can share state not only between
multiple invocations of sphinx-build, but also with the mach command. This will
be taken advantage of more heavily in future commits in this series.

MozReview-Commit-ID: 7ERYeN5BPeI

--HG--
extra : source : 8309212d820bcca29aa95b7892d39940437f2aa8
2018-04-18 12:56:55 -04:00
Coroiu Cristina 5dfcabfb35 Backed out 6 changesets (bug 1454640) for bustage at build/src/security/manager/ssl/nsNSSComponent.cpp on a CLOSED TREE
Backed out changeset d03f75986f62 (bug 1454640)
Backed out changeset 47fc3e223867 (bug 1454640)
Backed out changeset 22f2dc60e6d8 (bug 1454640)
Backed out changeset 30b4083534b5 (bug 1454640)
Backed out changeset 8309212d820b (bug 1454640)
Backed out changeset 9942d2df3719 (bug 1454640)
2018-05-10 23:12:38 +03:00
Andrew Halberstadt cb800e2585 Bug 1454640 - [mozbuild] Ability to find sphinx variables relevant to a given path r=mshal
The current mechanism for reading SPHINX variables assumes we always want to
read metadata for the entire tree. Now that we have the ability to rebuild
specific subtrees, this assumption is false.

This patch allows us to specify a path that find_sphinx_variables can use to
filter down the set of moz.build variables it will traverse, yielding only
moz.builds that could potentially impact the specified path.

MozReview-Commit-ID: ALrCFLFgMLH

--HG--
extra : rebase_source : d0c26a006bb4dbc429be5eedad7825d4412dc2a4
2018-04-17 11:51:37 -04:00
Andrew Halberstadt 09c473ae93 Bug 1454640 - [docs] Use a single SphinxManager instance across all rebuilds r=mshal
In the mozbuild.sphinx extension, we create a new SphinxManager instance each
time. However this isn't ideal now that we can rebuild the docs within the same
interpreter using the livereload server.

This makes use of a singleton so that we can share state not only between
multiple invocations of sphinx-build, but also with the mach command. This will
be taken advantage of more heavily in future commits in this series.

MozReview-Commit-ID: 7ERYeN5BPeI

--HG--
extra : rebase_source : 44aee637ea9b828b43b82e8639ddc3cc7f68c797
2018-04-18 12:56:55 -04:00
Csoregi Natalia f034c0ab5d Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-10 12:52:31 +03:00
Cosmin Sabou ea5feeedb6 Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-05-10 01:16:27 +03:00
Cosmin Sabou 5470a81920 Merge mozilla-central to autoland. a=merge
--HG--
extra : rebase_source : 2f2bf3dc60329bfb92eab3401b92f4eadf0bf8c3
2018-05-09 20:31:27 +03:00
Cosmin Sabou a916fb7c3e Merge inbound to mozilla-central. a=merge 2018-05-09 20:27:38 +03:00
Kris Maglione 4900714df7 Bug 1457321: Part 1 - Add bundled dictionaries to built_in_addons.json. r=ted,rhelmer
MozReview-Commit-ID: GxCSXXaz8kz

--HG--
extra : rebase_source : a334cfbeee786aeaca373b5a7fc8107fa44c2243
2018-04-27 15:42:55 -07:00
Nika Layzell 9206a422c3 Bug 1455722 - Don't use FileAvoidWrite for writing .xpt files. r=mccr8
Unfortunately, FileAvoidWrite causes us to re-generate .xpt files every time we
build if a dependency of the .xpt files doesn't affect their output.

The easiest solution is to stop performing this option until we get a better
build backend like `tup` which can handle problems like this.
2018-04-30 15:15:00 -04:00
Michael Kaply ce0446bbdc Bug 1352539 - Move default search engine to list.json. r=florian
MozReview-Commit-ID: Kpz4Xb7nZ16

--HG--
extra : rebase_source : 6d4e48f27dfe4e07fb145c77ff2bb1c10cfab97c
2018-04-20 12:48:02 -05:00
Nick Alexander 6def81e643 Bug 1459979 - Sort artifact candidate hg revisions by local integer revision. r=froydnj
This works around a situation observed with old hg versions (hg 4.2?)
with mozilla-unified.  I don't know why we haven't witnessed it more
generally, since the sort order was textual and should have caused
issues.

MozReview-Commit-ID: DBtfRJ3NJGR

--HG--
extra : rebase_source : b8605e34341e2c3a40f424688ecef1dbac4dc58e
2018-05-07 16:06:14 -07:00
Mike Shal 122fa76f08 Bug 1456603 - Enable check_unchanged=True for more rules in the tup backend; r=chmanchester
Enabling this flag on rules that produce many small outputs (especially
header files that may trigger many other rules) can help reduce
incremental build time. It probably doesn't make sense to have this
enabled for .o files and linker rules, because those are less likely to
be unchanged when an input file changes, and are also larger so the time
to diff them can be more significant.

MozReview-Commit-ID: BbJaMCqPU6z

--HG--
extra : rebase_source : 31c8be252c26d3aa85e4390cf27f3ec027e88c00
2018-05-08 16:41:00 -04:00
Rob Wood 6802d07a28 Bug 1455872 - Build support for the new raptor performance framework; r=gps
MozReview-Commit-ID: FBvXwkYfz0o

--HG--
extra : rebase_source : eb611d916d1bfda47321f6f424eeefa5598c1f83
2018-05-02 16:42:41 -04:00
Rob Wood ced102a09b Bug 1455872 - Add taskcluster configs for raptor on OSX; r=jmaher
MozReview-Commit-ID: I67InZTEziy

--HG--
extra : rebase_source : b18672eca2d3922367d3e4e50ff4b451a06e479e
2018-04-24 10:30:42 -04:00
Nathan Froyd 0de7ff8ffa Bug 1459988 - disallow MSVC 15.7+ from being used to build Firefox; r=ted.mielczarek 2018-05-09 17:26:32 -04:00
Chris Manchester 526c8d5347 Bug 1459074 - Do not fail when installing tests if the install manifest for test harness files is missing. r=mshal
MozReview-Commit-ID: 4zp0eANlO9G

--HG--
extra : rebase_source : 7cc26b54becb14090f9a0b6155c7024c03a3b447
2018-05-07 11:49:14 -07:00
Nick Alexander 00dc996ad3 Bug 1444546 - Post: Remove add_java_jar and support. r=froydnj
MozReview-Commit-ID: J6E2ZOs9r3P

--HG--
extra : rebase_source : 0e68f776e95e0fd2fec4607435d030acc68ca0ad
2018-03-06 14:48:20 -08:00
Csoregi Natalia d69aac5687 Merge inbound to mozilla-central. a=merge 2018-05-05 12:47:28 +03:00
Tom Prince 6f56e02f9f No bug: Fix some python linting errors; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1127

--HG--
extra : source : cf3337b33f9e2c99e94196f81c4baad7d00b8e7e
extra : histedit_source : efcdccb727ef3eb7a0734ca4e6b795ad982ba67f
2018-05-03 10:42:05 -06:00
Tom Prince 9be271f7c9 Bug 1458700: [taskgraph] Move `load_graph_config` into `taskgraph.config`; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D1123

--HG--
extra : source : 38407a04fc43074648430482c6d4b0860cb9473d
extra : histedit_source : 09c671d2923789aae334e3c8df8510a1a9f07bd0
2018-05-02 19:28:43 -06:00
Brian Grinstead e68a4059c7 Bug 1458588 - Create objdir/tmp if it doesn't exist during mach run;r=ahal
This fixes `./mach run --temp-profile` after a clobber.

MozReview-Commit-ID: 7xoH5RCSpXx

--HG--
extra : rebase_source : b26f54b6ac4b0d9020fb803f9fb8c51ea51f511d
2018-05-02 09:26:13 -07:00
Cosmin Sabou ce9ff94ffe Merge inbound to mozilla-central. a=merge 2018-05-02 17:58:43 +03:00
Ms2ger 9031e5b372 Bug 1457488 - Improve error message with lower-case environment variable; r=chmanchester 2018-05-02 11:59:32 +02:00
Brian Grinstead 70be31f665 Bug 1457963 - Add a --temp-profile argument to `mach run` that creates a new temp profile directory;r=ahal
MozReview-Commit-ID: LI6a9KBNXer

--HG--
extra : rebase_source : 44095e02ff3ad74cabbf723a671283ecd450e978
2018-05-01 12:13:40 -07:00
Chris Manchester 042bdc1c1b Bug 1372381 - Install TEST_HARNESS_FILES in the tup backend. r=mshal
MozReview-Commit-ID: 3PTtvoh8D9L

--HG--
extra : rebase_source : e24ca24070361e8fea00bc4e642af24087838e59
2018-04-30 11:10:44 -07:00
Chris Manchester 352cc3c613 Bug 1372381 - Compile host libraries, host programs, and simple programs in the Tup backend. r=mshal
MozReview-Commit-ID: 2AcpqiOqSSf

--HG--
extra : rebase_source : 13fe899a0487350345a66da04e4771aefbc86aeb
2018-04-30 11:10:44 -07:00
Chris Manchester 5ee980ae1b Bug 1372381 - Temporarily skip certain problematic binaries in the Tup backend. r=mshal
MozReview-Commit-ID: 7lopI8UQPSZ

--HG--
extra : rebase_source : 55b838e878cdaf20a5981f0f17f6bfc5b34a033a
2018-04-30 11:10:21 -07:00
Chris Manchester 22900f8fb9 Bug 1372381 - Generate automation.py with GENERATED_FILES rather than Makefile.in r=mshal
This commit also removes "DEFAULT_APP", which is unused.

MozReview-Commit-ID: 5YYaC5LJqUn

--HG--
extra : rebase_source : 45f0f8f11698890fae0dcca71174f88dbdb412c8
2018-04-30 11:08:59 -07:00
arthur.iakab 5bf85a2548 Backed out 4 changesets (bug 1372381) for artifact build bustages
Backed out changeset 56c7ffeaa9fd (bug 1372381)
Backed out changeset 4e0f7fe818d0 (bug 1372381)
Backed out changeset 92a96d6b599b (bug 1372381)
Backed out changeset 620bdfafd42f (bug 1372381)

--HG--
extra : rebase_source : f3f465077a9a4198c88caf8977a02b384ccbef01
2018-05-01 01:39:08 +03:00
Chris Manchester 6c7cbb9b46 Bug 1372381 - Install TEST_HARNESS_FILES in the tup backend. r=mshal
MozReview-Commit-ID: 3PTtvoh8D9L

--HG--
extra : rebase_source : f303ae4e88e5639d65ff01bdf6b1649b2a89ed77
2018-04-30 11:10:44 -07:00
Chris Manchester 71b3013b7d Bug 1372381 - Compile host libraries, host programs, and simple programs in the Tup backend. r=mshal
MozReview-Commit-ID: 2AcpqiOqSSf

--HG--
extra : rebase_source : 2963c711931d3520cff3e4db1bb34b2a8c7dcaba
2018-04-30 11:10:44 -07:00
Chris Manchester 4710745e17 Bug 1372381 - Temporarily skip certain problematic binaries in the Tup backend. r=mshal
MozReview-Commit-ID: 7lopI8UQPSZ

--HG--
extra : rebase_source : 93d5428f76baa5f4fd00bcd9fe7a88e50b6a18db
2018-04-30 11:10:21 -07:00
Chris Manchester d0a6e686c9 Bug 1372381 - Generate automation.py with GENERATED_FILES rather than Makefile.in r=mshal
This commit also removes "DEFAULT_APP", which is unused.

MozReview-Commit-ID: 5YYaC5LJqUn

--HG--
extra : rebase_source : 11a5264758ab3b2d8faef1e50a666981988457f2
2018-04-30 11:08:59 -07:00
Mike Shal 48a4717d97 Bug 1437593 - Update tup backend to support new python virtualenv; r=chmanchester
MozReview-Commit-ID: 59o9KMQDPbs

--HG--
extra : rebase_source : ac9f88bd6da61fbd224da07b6c297e6bd529a4b2
2018-04-27 17:28:21 -04:00
Dorel Luca 70e79e52cd Backed out 11 changesets (bug 1437593) for Doc linting failure. CLOSED TREE
Backed out changeset 0f3dbbd73ed4 (bug 1437593)
Backed out changeset 64c84cf90e8b (bug 1437593)
Backed out changeset 36c66615886f (bug 1437593)
Backed out changeset dfafbe7770ad (bug 1437593)
Backed out changeset 900f32450a74 (bug 1437593)
Backed out changeset d6fe456bb39c (bug 1437593)
Backed out changeset 4842e4b68d82 (bug 1437593)
Backed out changeset e024b3d775fd (bug 1437593)
Backed out changeset ce9e3951357a (bug 1437593)
Backed out changeset afaeac146ff8 (bug 1437593)
Backed out changeset 88954bcf6ca2 (bug 1437593)
2018-04-28 12:02:02 +03:00
Dave Hunt ab659de0d1 Bug 1437593 - Move initial virtual environment to _virtualenvs/init; r=ted
MozReview-Commit-ID: LP8NVz3tZZg

--HG--
extra : rebase_source : 0ddf9cd58d7258c17ffbed01b435fb58142df7c5
2018-03-28 12:55:04 +01:00
Xidorn Quan 1c8dc43017 Bug 1457524 part 1 - Use a list for rust tests. r=froydnj
MozReview-Commit-ID: 6A0hHClXDUE

--HG--
extra : rebase_source : 827bb569642aa2ad834b94f08af3f60b68552de4
2018-05-02 11:51:25 +10:00
Dave Hunt 628826a671 Bug 1437593 - Allow pip requirements to be installed from vendored packages; r=gps
MozReview-Commit-ID: VarZNeeBYy

--HG--
extra : rebase_source : 72a45dd97df763d8efcb8eadf525b43f9365a8e7
extra : source : 4535a1c9225f035dd3e92268ece850c1ebf99ff0
2018-03-27 13:56:44 +01:00
Dave Hunt 4afca33e96 Bug 1437593 - Move initial virtual environment to _virtualenvs/init; r=ted
MozReview-Commit-ID: LP8NVz3tZZg

--HG--
extra : rebase_source : 990c0301a43a1870a69548a23aeddcf9fe3fe8a8
2018-03-28 12:55:04 +01:00
Dave Hunt 3903838e6a Bug 1437593 - Add support for using Pipfiles for managing virtual environment dependencies; r=ted
MozReview-Commit-ID: GWFJZfYWi5Y

--HG--
extra : rebase_source : 3b357bb6e39f8d008ebb982293c21fe3036dac8e
2018-03-27 12:59:40 +01:00
Dave Hunt 9f1dc3ec97 Bug 1437593 - Add support for using Pipfiles for managing virtual environment dependencies; r=ted
MozReview-Commit-ID: GWFJZfYWi5Y

--HG--
extra : rebase_source : 5b63da69ea4ce5b9149d07661088677ef996e98b
2018-03-27 12:59:40 +01:00
Dave Hunt b81f7638ad Bug 1437593 - Allow pip requirements to be installed from vendored packages; r=gps
MozReview-Commit-ID: VarZNeeBYy

--HG--
extra : rebase_source : 3c0824f154ec288a241a23213b337962b1e2cd76
2018-03-27 13:56:44 +01:00
Gurzau Raul 677f146915 Backed out 11 changesets (bug 1437593) for SpiderMonkey failures on a CLOSED TREE
Backed out changeset e4b2357330b4 (bug 1437593)
Backed out changeset 8cb34c11ad45 (bug 1437593)
Backed out changeset ab27411c53c2 (bug 1437593)
Backed out changeset c90a0961f52a (bug 1437593)
Backed out changeset 60114a93b6b1 (bug 1437593)
Backed out changeset d12eec17c51c (bug 1437593)
Backed out changeset 2f83246cb0b1 (bug 1437593)
Backed out changeset 19b7273e375c (bug 1437593)
Backed out changeset cf026c071b73 (bug 1437593)
Backed out changeset c7fa833eff1d (bug 1437593)
Backed out changeset 828caab5032d (bug 1437593)
2018-04-27 02:20:39 +03:00
Dave Hunt 37e3c0c222 Bug 1437593 - Move initial virtual environment to _virtualenvs/init; r=ted
MozReview-Commit-ID: LP8NVz3tZZg

--HG--
extra : rebase_source : 7cc28c398da611f318bba5377d9ad1f18944e1e4
2018-03-28 12:55:04 +01:00
Dave Hunt 8d13e7718a Bug 1437593 - Add support for using Pipfiles for managing virtual environment dependencies; r=ted
MozReview-Commit-ID: GWFJZfYWi5Y

--HG--
extra : rebase_source : 5b63da69ea4ce5b9149d07661088677ef996e98b
2018-03-27 12:59:40 +01:00
Dave Hunt 9bff0f3d88 Bug 1437593 - Allow pip requirements to be installed from vendored packages; r=gps
MozReview-Commit-ID: VarZNeeBYy

--HG--
extra : rebase_source : 3c0824f154ec288a241a23213b337962b1e2cd76
2018-03-27 13:56:44 +01:00
Noemi Erli 2d255bc4f8 Backed out 2 changesets (bug 1446923) for bustages in /python/mozbuild/mozbuild/test/frontend/test_emitter.py on a CLOSED TREE
Backed out changeset b9a5aab21d71 (bug 1446923)
Backed out changeset bc5ab6e2db10 (bug 1446923)
2018-04-27 00:16:23 +03:00
vprabhu 21473d0c83 Bug 1446923 - Removed old references to chrome-metro r=jlund
MozReview-Commit-ID: 4GpsuQf0N12

--HG--
extra : rebase_source : 05c950b097e5ffcfccc6528100b1c5b87bc3fe68
2018-03-20 19:23:21 +05:30
Mike Shal 072ebf303e Bug 1425540 - Support --dry-run in the tup backend; r=chmanchester
Now that bug 1454771 has simplified the TupBackend class, it is much
easier to pass in the self.dry_run flag into BackendTupfile to avoid
writing out Tupfiles when --dry-run is used.

MozReview-Commit-ID: 4WDgXNyYuiQ

--HG--
extra : rebase_source : e0997a65f4aecd0927f77cfb13fd6c5063fd4c36
2018-04-25 21:18:39 -04:00
Andreea Pavel a21531022b Merge mozilla-inbound to mozilla-central. a=merge
--HG--
rename : toolkit/components/extensions/test/xpcshell/test_ext_browserSettings.js => toolkit/components/extensions/test/xpcshell/test_ext_proxy_config.js
2018-04-26 09:04:59 +03:00
Chris Manchester 60c3c10391 Bug 1454771 - Add mozconfig variables to the environment when running tup. r=mshal
MozReview-Commit-ID: BneMu8DfKLY

--HG--
extra : rebase_source : b4b306885f79336295cc8ce458597f0414319f2a
2018-04-25 14:55:42 -07:00
Chris Manchester efa96c69f0 Bug 1454771 - Move tup invocation from Makefile.in to mach. r=mshal
MozReview-Commit-ID: HkhK4oe93Vm

--HG--
extra : rebase_source : cbfc0b05deae9ca5b871952bfb771320f7d51d9e
2018-04-25 14:50:18 -07:00
Chris Manchester 64b21be6a1 Bug 1455504 - Normalize library paths to work around windows incremental linking bug. r=ted
MozReview-Commit-ID: DuZaGMKVZrn

--HG--
extra : rebase_source : 93e468ae60bd5731fc3ccc71c006465a6e294f8f
2018-04-24 16:39:36 -07:00
arthur.iakab 51e6939ace Backed out changeset 8645b620dad4 (bug 1455504) on request of aklotz. 2018-04-26 00:57:35 +03:00
Chris Manchester 76e65666bf Bug 1455504 - Normalize library paths to work around windows incremental linking bug. r=ted
MozReview-Commit-ID: DuZaGMKVZrn

--HG--
extra : rebase_source : 1bf407a2439714e126c7c40503f47bfa8559977a
2018-04-24 16:39:36 -07:00
Geoff Brown b0abf7f6dd Bug 1445716 - Add new Android test task geckoview-junit, but do not run it yet; r=jmaher
Add geckoview-junit test task to taskcluster and mozharness configs.
https://developer.mozilla.org/en-US/docs/Mozilla/Geckoview-Junit_Tests
2018-04-25 09:10:26 -06:00
Myk Melez 07946d0eeb Bug 1323557 - preserve vendored crates when re-vendoring; r=ted.mielczarek
`mach vendor rust` currently removes third_party/rust before `cargo update`,
which prevents modifying vendored crates for local testing and try pushes.
It's also unnecessary.  So this patch removes the code that removes the dir.

MozReview-Commit-ID: IE0FZ3of8Py

--HG--
extra : rebase_source : 5236e2decd95f4c83b34430d5423b80e84acdf07
2018-04-20 11:53:10 -07:00
Joel Maher b6b767f893 Bug 1425929 - test-verify jobs should pick a virtualization appropriate to the test. r=gbrown 2018-04-24 10:20:19 -04:00
Justin Wood d289c494d6 Bug 1455100 - Make devedition its own language pack addon id, by using MOZ_LANGPACK_EID again. r=nalexander,Pike
MozReview-Commit-ID: z1SJmCQflq

--HG--
extra : rebase_source : 4d5b6941f907e0e062a7f4466a246696290823fe
2018-04-19 14:48:11 -04:00
Dorel Luca 3409e8f9fb Merge mozilla-central to autoland
--HG--
rename : testing/mochitest/tests/SimpleTest/SpawnTask.js => testing/mochitest/tests/SimpleTest/AddTask.js
rename : testing/mozharness/mozharness/mozilla/testing/verify_tools.py => testing/mozharness/mozharness/mozilla/testing/per_test_base.py
extra : rebase_source : 6f474049dab2c2979e13ea87114b82d2b04715d0
2018-04-21 02:03:27 +03:00
Dorel Luca 65669dae30 Merge mozilla-inbound to mozilla-central. a=merge 2018-04-21 02:00:04 +03:00
Gregory Szorc b78a4e45de Bug 1446019 - Improve error message for LOCAL_INCLUDES pointing to topobjdir; r=froydnj
The old message is ambiguous as to why it failed. The new one tells
you why and hopefully gives you enough info to fix it.

MozReview-Commit-ID: 9cBpYLpCFmt

--HG--
extra : rebase_source : cf0899e8c5f5330d31c645cba27d1bd3fb19e814
2018-03-15 09:43:35 -07:00
Andrew Halberstadt 853598e23e Bug 1410424 - [mozbuild] Add a 'quiet' argument to VirtualenvManager.install_pip_requirements r=mshal
Some requirements.txt are very large and result in a lot of package already
installed messages. Would be nice to hide this.

MozReview-Commit-ID: FQecuePM0zZ

--HG--
extra : rebase_source : 58eaa7324775cfaa39077871be0be0ef39ad7c11
2018-04-06 10:23:49 -04:00
Mike Hommey fd130aa298 Bug 1455065 - Shell quote environment variable values when dumping them in dump_env.py. r=mshal
The mozconfig output parsing code already handles shell quoted strings
to some extent (except for bug 818377), because that's what `set`
outputs. By quoting environment variable values, we avoid a bunch of
problems with "weird" values.

--HG--
extra : rebase_source : 7a45b99c3fee807da395fc42352296b000b7535f
2018-04-19 07:26:28 +09:00
Chris Manchester df340972e4 Bug 1449965 - Output directories during the build as we compile object files. r=ted
MozReview-Commit-ID: K4RrObGHXIC

--HG--
extra : rebase_source : 09e66caa36cd6bac1d5ac4bbf300ab4ee93fce27
2018-04-19 00:16:57 -07:00
Mike Shal b3030acebe Bug 1454825 - Tup backend: Handle dependent GENERATED_FILES better; r=chmanchester
Work around the fact that tup is bad at handling out-of-order rules by
delaying them based on what outputs we've already seen in rule().

MozReview-Commit-ID: G2tyeQr7MTh

--HG--
extra : rebase_source : d854b8b1633243177e03698c12271b11e06b0963
2018-04-17 19:52:39 -04:00
Mike Shal eb518d8912 Bug 1454826 - Tup backend: Use PYTHONDONTWRITEBYTECODE=1 instead of -B; r=froydnj
MozReview-Commit-ID: GJiqcfe2819

--HG--
extra : rebase_source : ac28c8bbc4c86f2a7242b51295c74eeedd71bd00
2018-04-17 19:51:56 -04:00
Mike Shal d744090885 Bug 1454811 - Update Tup backend due to chages in bug 1444745; r=chmanchester
The xpidl-process.py invocation now takes a --bindings-conf parameter,
and the final generated .cpp file uses a new python script and was
moved from xpcom/typelib/xpt/XPTInfo.cpp to
xptcom/reflect/xptinfo/xptdata.cpp

MozReview-Commit-ID: C3vK3VzgG6Q

--HG--
extra : rebase_source : d4a6b87a9fdde76d60aaf3876e8200e551ec958b
2018-04-18 08:52:41 -04:00
Nika Layzell be8b24333a Bug 1444991 - Part 1: Read webidl's Bindings.conf, and pass it into xpidl, r=mccr8
This information is read in order to handle correctly selecting the native
type and header files for WebIDL types.
2018-04-17 19:20:58 -04:00
Nika Layzell 95b7d44e5d Bug 1444745 - Part 3: Replace the XPT file format with a JSON based one, r=mccr8
This patch adds a python script based on the old typelib.py script which takes
in a parsed XPIDL file, and generates a json-based XPT file to use as a build
intermediate. I did my best to keep the generated format simple.
2018-04-17 19:20:53 -04:00
Nika Layzell 4d3a49a4fb Bug 1445668 - Don't hide includes when -showIncludes is explicitly passed to cl.exe, r=gps 2018-04-10 17:49:51 -04:00
Chris Manchester b53e658206 Bug 1451521 - Generate built_in_addons.json in the Tup backend. r=mshal
MozReview-Commit-ID: LdYtRMopfJM

--HG--
extra : rebase_source : 24db64ad56a928ea28408c92434c8966dfc9a3dd
2018-04-06 14:38:05 -07:00
Chris Manchester beec30d4f3 Bug 1451529 - Install shared libs in the Tup backend. r=mshal
MozReview-Commit-ID: Jn9Uk5XmFxJ

--HG--
extra : rebase_source : 3a23b7e8530c6215614dccfb12e0b2cc799d63f4
2018-04-04 15:28:39 -07:00
David Teller abfa5517f9 Bug 1437004 - Introducing BinSource parser generator;r=froydnj,jorendorff
This crate contains a parser generator as a Rust crate. The parser generator is used to generate
BinSource-auto.h, BinSource-auto.cpp, BinToken.h. As of this changeset, to limit yak shaving,
the parser generator is not part of the build system. Making it part of the build system
is delegated to bug 1439645.

MozReview-Commit-ID: 1lODDSIsz8W

--HG--
extra : rebase_source : 2b09675167c12e33f5951ea00dc6df54dad11832
2018-04-05 15:21:17 +02:00
Mike Shal e44a8cb1da Bug 1450877 - Update tup backend to support new XPIDL model; r=chmanchester
We no longer build .xpts in dist/bin/components and list them in an
interfaces file. Instead, they are build as intermediate files, and a
new XPTInfo.cpp is generated from *.xpt.

MozReview-Commit-ID: J05oYFK3adc

--HG--
extra : rebase_source : ad2bebfcb7877430b78441af1f41aac30c1607a9
2018-04-03 11:30:11 -04:00
Andrew McCreight e80864c94c Bug 1438688, part 3 - Remove XPT files from the packaging process. r=glandium
Now that XPT files are not loaded from files at runtime, code for
packaging XPT files can be removed.

This means that a couple of test XPIDL interfaces will get shipped in
builds to users that weren't before, but I don't think that matters
much.

This also puts XPT files into the local objdir for the XPIDL makefile,
instead of dist/bin, because they are no longer part of the
distribution.

MozReview-Commit-ID: 7gWj8KWUun3

--HG--
extra : rebase_source : 65bac47c2cd1a20b3c675a01b44a25a1d2d3ab7a
2018-03-05 14:27:29 -08:00
Jeff Gilbert afd77f7fd5 Bug 1444274 - Require GCC 6.1+. - r=glandium
MozReview-Commit-ID: 7alNSIhhbLI
2018-04-02 17:05:43 -07:00
Justin Wood 4540d3a335 Bug 1441359 - Make langpack version include buildid. r=mshal
For Automated submission to AMO we need unique language pack versions for every submitted build.

This will produce versions that are not valid for AMO on nightly (61.0a1buildid2018...) but that's ok, we're not ready to
submit these automatically on the nightly channel yet, they do still install fine into Firefox manually.

On beta/release/esr the version will however be ok for AMO "60.0buildid2018..." and will be reasonably unique per push.

This patch has the intent that, outside of automation, users who don't set a buildid get a langpack version without that
specified (rather than a buildid being automatically generated for them).

The releng scriptworker (addonscript) that will do the publishing to AMO will additionally sanity check that the string
'buildid' is present in the version part, so we don't accidentally break this functionality in production.

This patch is also intended to be uplifted to Gecko 60 to support ESR60 needs.

MozReview-Commit-ID: KuvwMyD6bwd

--HG--
extra : rebase_source : 04ecd87a15d5640f510b1f6123ba9467ccc4592a
2018-03-29 14:10:47 -04:00
Mike Shal 379ad678f3 Bug 1449623 - Export MOZ_BUILD_DATE for buildid.h; r=chmanchester
MozReview-Commit-ID: HnlTcIKQwJC

--HG--
extra : rebase_source : 912a6dd3d2cf5e4761c4ae602e2d952a4e79c36f
2018-03-28 14:30:02 -04:00
Mike Shal 40c491ba27 Bug 1449623 - Rework exports in the tup backend; r=chmanchester
In some cases we need to export other environment variables, so make it
easier to track them.

MozReview-Commit-ID: 82OOlRTdhH0

--HG--
extra : rebase_source : 1256098d1bdae9ab13bfe5a149ee33d509ead3f4
2018-03-27 17:26:56 -04:00
Chris Manchester dce6a4a7b6 Bug 1382982 - Accept artifacts from autoland when performing an artifact build in automation. r=nalexander
MozReview-Commit-ID: cVd8GqSuAn

--HG--
extra : rebase_source : d9530d1a25a9956c422021226a062f232b240b80
2018-03-28 11:22:34 -07:00
Geoff Lankow 29234a8525 Bug 1444219 - Remove unnecessary call to MozbuildObject.from_environment r=froydnj
MozReview-Commit-ID: 4KP2H9HVQbG

--HG--
extra : rebase_source : b2a7a8b8c382ad00487081c3ec99b7dc095283ba
2018-03-11 21:55:45 +13:00
Chris Manchester d4fc213fdc Bug 1419892 - Link programs and libraries in the tup backend. r=mshal
MozReview-Commit-ID: 26Yb0QdCn5H

--HG--
extra : rebase_source : 830253545964b14780fe5330fd33f1bd050a89ee
2018-03-26 15:29:51 -07:00
Andi-Bogdan Postelnicu 62c9697c80 Bug 1447817 - correlate mach static-analysis documentation with configuration file. r=sylvestre
MozReview-Commit-ID: FB296IBeKOk

--HG--
extra : rebase_source : 625ddccd273739c87fd47fac068f8c56f188b4d0
2018-03-24 13:01:04 +02:00
Chris Manchester fcf16fe1e7 Bug 1445398 - Do not re-generate buildid.h for every Tup build. r=mshal
MozReview-Commit-ID: ErkTDOU8lYH

--HG--
extra : rebase_source : 085b0cb43b625fbb2691aa6bc788b62549927a02
2018-03-22 16:03:12 -07:00
David Major a96f691565 Bug 1447728 Part 1: Add CC_TYPE to mozinfo. r=ted 2018-03-22 11:40:00 -04:00
arthur.iakab 24af737f4c Merge inbound to mozilla-central. a=merge 2018-03-22 01:46:39 +02:00
Emilio Cobos Álvarez 24cf27d33c Bug 1447611: Remove --enable-stylo and --enable-stylo-build-bindgen. r=froydnj
Will remove the prefs and stuff in a followup.

MozReview-Commit-ID: HVyfbHOEQYI
2018-03-21 19:13:26 +01:00
Csoregi Natalia d6c6d38406 Backed out 4 changesets (bug 1447611) for mass failures due to --enable-stylo removal. CLOSED TREE
Backed out changeset c6193142bbcf (bug 1447611)
Backed out changeset 01ada1c5a95f (bug 1447611)
Backed out changeset 86c9fed44da2 (bug 1447611)
Backed out changeset bb84ac6e1468 (bug 1447611)
2018-03-21 19:01:07 +02:00
Emilio Cobos Álvarez 330ddd82bf Bug 1447611: Remove --enable-stylo and --enable-stylo-build-bindgen. r=froydnj
Will remove the prefs and stuff in a followup.

MozReview-Commit-ID: HVyfbHOEQYI
2018-03-21 17:24:41 +01:00
Marco Zehe 2d82c3eb62 Bug 1447632 - Make sure that TLB files are included in Windows artifact builds, r=ted.mielczarek
MozReview-Commit-ID: 6hdEqaJvuZl

--HG--
extra : rebase_source : 80fd3d6fdb1dc3db5be8a0133bc64f5526592f2d
2018-03-21 14:17:50 -04:00
Chris Manchester 0a830e8691 Bug 1429875 - Implement OBJ_SUFFIX overriding for the profile generation phase on linux in mozbuild. r=glandium
MozReview-Commit-ID: 8PtgxfbxuE

--HG--
extra : rebase_source : fd8934ee2c70883e30a7b51d4b64944d3ce7e6ee
2018-03-20 16:44:12 -07:00
Chris Manchester de12a7992b Bug 1429875 - Remove expandlibs and instead generate list files in the mozbuild backend. r=glandium
MozReview-Commit-ID: 5eLwnh1HHGj

--HG--
extra : rebase_source : cd308adc4542be0f9b33b64d31a2d0dc0310fcd4
2018-03-20 16:31:05 -07:00
Chris Manchester 47f253d6f9 Bug 1429875 - Add a unit test for linkage variables in the make backend. r=glandium
MozReview-Commit-ID: HREobMhWTwg

--HG--
extra : rebase_source : a4d96b8a0b02790633ff65b320585334493e84ae
2018-03-20 16:31:05 -07:00
Chris Manchester 3f63e1bbdb Bug 1429875 - Add a "name" property to Library and Program objects that corresponds to the output basename. r=glandium
MozReview-Commit-ID: J4gt1fGUzOa

--HG--
extra : rebase_source : 94491f7e9d6f2afb44fcae9627f206292481405c
2018-03-20 16:31:05 -07:00
Mike Shal c6aa9fc9af Bug 1447329 - fix preprocessor jar.mn entries in the tup backend; r=chmanchester
The source filename should only be used as the destination filename if
we don't have a target_basename entry for the file. For most cases
there is no difference, but in browser/components/places/jar.mn, the
same source file (bookmarkProperties.xul) is used to two different
destination files (bookmarkProperties.xul and bookmarkProperties2.xul).

MozReview-Commit-ID: LCwncq4wxtU

--HG--
extra : rebase_source : 0a86da0879d4e516013c664fbc0eb422d4be9efa
2018-03-19 20:20:24 -04:00
Nick Alexander 93c505b07a Bug 1443208 - Pre: Add force flag to GENERATED_FILES. r=ted.mielczarek
The forces on the system are such that I really need to be able to
FORCE a few RecursiveMake targets in order to make Android and Gradle
use GENERATED_FILES and LOCALIZED_GENERATED_FILES.  Over time, I hope
to avoid FORCE, but that time is not now.

MozReview-Commit-ID: 453FpnihSRK

--HG--
rename : python/mozbuild/mozbuild/test/backend/data/generated-files/foo-data => python/mozbuild/mozbuild/test/backend/data/generated-files-force/foo-data
rename : python/mozbuild/mozbuild/test/backend/data/generated-files/generate-bar.py => python/mozbuild/mozbuild/test/backend/data/generated-files-force/generate-bar.py
rename : python/mozbuild/mozbuild/test/backend/data/generated-files/generate-foo.py => python/mozbuild/mozbuild/test/backend/data/generated-files-force/generate-foo.py
rename : python/mozbuild/mozbuild/test/backend/data/generated-files/moz.build => python/mozbuild/mozbuild/test/backend/data/generated-files-force/moz.build
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/en-US/localized-input => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-force/en-US/localized-input
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/foo-data => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-force/foo-data
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/generate-foo.py => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-force/generate-foo.py
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/moz.build => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-force/moz.build
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/non-localized-input => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-force/non-localized-input
rename : python/mozbuild/mozbuild/test/frontend/data/generated-files/moz.build => python/mozbuild/mozbuild/test/frontend/data/generated-files-force/moz.build
rename : python/mozbuild/mozbuild/test/frontend/data/localized-generated-files/moz.build => python/mozbuild/mozbuild/test/frontend/data/localized-generated-files-force/moz.build
extra : rebase_source : 6820ac4b377ac596cafbdf065112738376cc473e
2018-03-08 16:04:06 -08:00
Emilio Cobos Álvarez 48957d62c0 Bug 1446954: Cleanup !stylo and styloVsGecko test expectations. r=xidorn
MozReview-Commit-ID: J2glxiCWBVn
2018-03-20 11:29:51 +01:00
Ted Mielczarek e2218ff804 bug 1255485 - add some tests for building programs in dist/bin. r=nalexander
MozReview-Commit-ID: 94uOsInnWmT
2018-01-17 11:19:19 -05:00
Ted Mielczarek dcdf597820 bug 1255485 - build PROGRAMs directly in dist/bin instead of copying them. r=nalexander
Historically we built all our binaries in directories in the objdir, then
symlinked them into dist/bin. Some binaries needed to be copied instead
so that certain relative path lookups work properly, so we resorted to
sprinkling `NSDISTMODE=copy` around Makefiles.

This change makes it so we build PROGRAMs (not any other sort of targets)
directly in dist/bin instead. We could do the same for our other targets
with a little more work.

There were several places in the tree that were copying built binaries to
some other place and needed fixup to match the new location of binaries.

On Windows pdb files are left in the objdir where the program was
originally linked. symbolstore.py needs to locate the pdb file both to
determine whether it should dump symbols for a binary and also to copy
the pdb file into the symbol package. We fix this by simply looking for
the pdb file in the current working directory if it isn't present next
to the binary, which matches how we invoke symbolstore.py.

MozReview-Commit-ID: 8TOD1uTXD5e
2018-01-10 14:26:12 -05:00
Sebastian Hengst d247fb5f4e Bug 1445763 - Update moz.build meta data with "Firefox Build System". r=froydnj
MozReview-Commit-ID: 3FrWJ6441pe

--HG--
extra : rebase_source : c8f1dc45041132252e28869ada6a386270267431
2018-03-14 21:44:46 +01:00
Jan Beich b2c12ddb46 Bug 1445193 - Use notify-send on Tier3 platforms as well. r=gps
MozReview-Commit-ID: 4ONdrhqc6zf

--HG--
extra : rebase_source : 6773d64fb7dc3cfa56c148a9b455ac03e81b465d
2018-03-13 10:29:11 +00:00
Ryan VanderMeulen 0bd3547b12 Bug 1424281 - Require Visual Studio 2017 15.6.0 and Win SDK 10.0.15063.0 to build on Windows. r=froydnj
--HG--
extra : rebase_source : 0de2c47bb978ae92128fc00390649a327612890f
2018-03-12 19:24:44 -04:00
Ryan VanderMeulen dde54aa578 Bug 1424281 - Use Visual Studio 2017 15.6.0 for Windows builds. r=froydnj
--HG--
extra : rebase_source : 2d5abb19c1f2b2e2f142b849bd4d0ba9ab46ccbe
2018-03-12 19:24:44 -04:00
Nick Alexander c9cc551b04 Bug 1444534 - Part 1: Allow "locales/en-US" relative paths in localized inputs. r=ted.mielczarek
This cleans up a few things, including simplifying the look of
backend.mk by keeping the relsrcdir in MERGE_RELATIVE_FILE similar to
the source path in the tree.  Before, the locales/ floated around,
which is hard to understand but doesn't matter, since it's stripped by
MERGE_RELATIVE_FILE.

This also tests both relative and topsrcdir-absolute paths.

MozReview-Commit-ID: 1v3y9xGiNfL

--HG--
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/inner/locales/en-US/localized-input => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/locales/en-US/localized-input
extra : rebase_source : 302d7cb638974fc5ec71513f47ce98222c5e3bb6
2018-03-08 14:12:44 -08:00
Matt Brubeck f4e41f6114 Bug 1443271 - Remove outdated comment from vendor_rust.py. r=ted
MozReview-Commit-ID: s9CnYvQcJP

--HG--
extra : rebase_source : 8256ce6a7534ffd78ec796dbb1c246c5d12c6c9a
2018-03-05 12:03:15 -08:00
Nick Alexander 713d88d96a Bug 1443204 - Pre: Clean-up unused Android data structures in mozbuild frontend. r=chmanchester
MozReview-Commit-ID: 5ympxk0jSJq

--HG--
extra : rebase_source : cc368d42eed182cc595858effd08517c6ec25168
2018-03-06 14:53:04 -08:00
Gregory Szorc 1c982ae418 Bug 1439727 - Purge untracked files in python/ and third_party/python/; r=nalexander
`mach clobber python` currently purges Python files with known
extensions globally.

The python/ and third_party/python/ directories may also contain random
ignored/untracked files. Let's purge those as well.

Note: if someone has untracked but not ignored files, this will delete
them. This is possibly unwanted. But people shouldn't have untracked
but not ignored files sitting around in VCS. We don't run this command
by default, so I think it is safe to be aggressive in our purging of
these untracked files.

MozReview-Commit-ID: 8ql8QR6lP6j

--HG--
extra : rebase_source : 644eccee25913502ed4daa55e54aec9618ebe547
2018-03-07 15:06:21 -08:00
Gregory Szorc da0cad58ef Bug 1439727 - Add a docstring for `mach clobber`; r=nalexander
This makes `mach help clobber` more useful.

MozReview-Commit-ID: GsIUqhUzVGP

--HG--
extra : rebase_source : bde88c0f9275a6dded83b8332faf2188583f663e
2018-03-07 08:49:13 -08:00
Gregory Szorc d2a511149f Bug 1439727 - Also delete .pyd files; r=nalexander
`mach clobber python` is supposed to remove autogenerated Python files.
Let's add .pyd files (compiled C extensions on Windows) to the list
for good measure.

MozReview-Commit-ID: EbHvBYB7hj3

--HG--
extra : rebase_source : 2736c3d1077c6f371df20b3854840612693117f8
2018-03-07 08:44:18 -08:00
Cosmin Sabou af65a84060 Backed out 2 changesets (bug 1443204) for build bustages at mozbuild/test/frontend/test_emitter.py on a CLOSED TREE
Backed out changeset eb1dfa51050f (bug 1443204)
Backed out changeset e3a7560b4206 (bug 1443204)
2018-03-07 23:58:00 +02:00
Nick Alexander a03b697b4d Bug 1443204 - Pre: Clean-up unused Android data structures in mozbuild frontend. r=chmanchester
MozReview-Commit-ID: 5ympxk0jSJq

--HG--
extra : rebase_source : cc0f5ab2f4f3b4b39bae7baa96ebaea2b7738e23
2018-03-06 14:53:04 -08:00
Dorel Luca 4884b868ae Backed out changeset 5ceb1365ae75 (bug 1421734) for build Bustage on MinGW 2018-03-07 05:45:52 +02:00
Chris AtLee 698a2a7006 Bug 1421734 - Download and unpack toolchain artifacts in parallel; r=nalexander
MozReview-Commit-ID: BMe6zqIqNHP

--HG--
extra : rebase_source : f347fe9de0117fc858a3de7be2079445af374929
2018-02-12 15:07:36 -05:00
Nick Alexander 82f173d48c Bug 1443222 - Remove python/mozbuild/mozbuild/backend/templates. r=froydnj
MozReview-Commit-ID: FXqLPrAQpNF

--HG--
extra : rebase_source : 4f134f13c06acfec78a2bfb7d9127a27dc21a9ee
2018-03-05 10:26:29 -08:00
Matt Brubeck be08cdcdc1 Bug 1381576 - Use a Cargo workspace for rust crates. r=ted
MozReview-Commit-ID: K6B9SifddXu

--HG--
extra : source : bbae7807c164273f6bb123d680a4fc31202d7a61
extra : amend_source : 53505e25f63a8eb228e62a0a9f3bd3ed98950296
extra : histedit_source : 597464181d4b79f5ac1a511d23e2a05aefb266da%2C63b89f3699e0e9598c8355e7293f10795acc80e7
2018-03-01 14:33:35 -08:00
shindli 0ba01aed1b Backed out 3 changesets (bug 1381576) for Bugzilla linting failure on a CLOSED TREE
Backed out changeset 3bc1743ad418 (bug 1381576)
Backed out changeset bbae7807c164 (bug 1381576)
Backed out changeset 1ea18b70b170 (bug 1381576)
2018-03-02 21:17:20 +02:00
Matt Brubeck c94fb26dea Bug 1381576 - Use a Cargo workspace for rust crates. r=ted
MozReview-Commit-ID: K6B9SifddXu

--HG--
extra : rebase_source : 75fae593e8765ec5b1e616d10eda0bc52f1f7194
extra : histedit_source : 21b38586bcc4576fce5eadff9a3c77ccf5e21341
2018-03-01 14:33:35 -08:00
Nick Alexander d825eb0d47 Bug 1439742 - Allow {AB_CD} and {AB_rCD} in LOCALIZED_GENERATED_FILES. r=ted.mielczarek
There are a lot of choices and moving pieces in this commit.  I elected
to include the mechanics and the target use case in the same commit so
that readers can compare and contrast the implementation and final
expression in one review window.

- Initially, I wanted to make the {AB_CD} substitutions in
LOCALIZED_FILES and not in LOCALIZED_GENERATED_FILES.  However, I ran
into conceptual blockers doing this.  Fundamentally, LOCALIZED_FILES
is FINAL_TARGET_FILES, and my use case should _not_ be putting files
anywhere near dist/bin.  In addition, LOCALIZED_FILES
(FINAL_TARGET_FILES) is handled using manifests, which would need to
grow locale-aware functionality to handle this.  That's not desirable.
In addition, if we use manifests, then we lose the powerful locality
of |mach build mobile/android{/base}| re-generating changed
locale-dependent resources.  This is similar to how the build system
plumbs dist/idl manifest processing throughout the build: we're
repairing local workflows after moving work into a global process.
For these reasons, this doesn't support {AB_CD} in LOCALIZED_FILES.

- There is even another layer of complexity!  There are two axes
involved with these files: AB_CD controls localization and the Make
target controls destination.  For the record, it is:

regular builds - AB_CD unset
multi-locale builds - AB_CD set
single-locale repacks - AB_CD set

For the record, the existing logic (before any changes) is:

regular builds - Make target is `libs` in mobile/android/base/locales
multi-locale builds - Make target is `chrome-%` in mobile/android/base/locales
single-locale repacks - Make target is `libs` in mobile/android/base/locales

This commit adds targets for both destinations, and uses Make
chrome-%:: and libs:: magic to control what is invoked in the various
situations.  Tricky!

- I added MERGE_RELATIVE_FILES in order to be able to follow-up this
patch with more patches that will get rid of
m/a/base/locales/{moz.build,Makefile.in} altogether, and fold this work
into m/a/base.  As it stands, we're already reaching from
m/a/base/locales all the way out to
mobile/locales/.../region.properties, so the existing code doesn't
follow the layout expected between mozilla-central and
l10n-central/$(AB_CD).  But that'll impedance will get worse as we
improve the build system dependencies, not better, so we should grow
support for localized resources that aren't exactly as expected.

- I chose to follow Python's syntax for string substitutions.  I
would have preferred to mark files that should be localized with a
leading '%'... but I took that for filesystem absolute paths in
moz.build files already.  I also considered @AB_CD@ to echo the
preprocessor, but didn't want to open the door to an expecation that
_all_ preprocessor DEFINEs will work in the way {AB_CD} does.

- The generate_*py script changes required a bit of a hack to "turn
off" locale dependent resources.  This would have been nicer if we had
marked localized resources with '%'... but we didn't.  See the
--fallback flag.  The real reason this is needed is that we're doing
work which is more like the work of compare-locales (merging
locale-dependent resources) at build-time rather than repack time.  I
don't know why that's the case -- probably when we (I) implemented it,
compare-locales and the whole l10n process was entirely opaque.  It's
not worth changing it now, so we use this --fallback flag approach.

- I didn't get to tup support.  This should gently fail without
breaking tup builds: any {AB_CD} substitutions just won't be
expanded.  I haven't a clue how this should work in tup in the future
(or, more generally, how to make any sense of repacks without
declaring the full set of expected locales at configure time.)

- strings.xml can't be a LOCALIZED_PP_FILES, since we need to
customize the output location based on AB_rCD, and since we need a
little more flexibility than PP_FILES gives for our inputs.

MozReview-Commit-ID: MyfIkNSEzt

--HG--
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/en-US/localized-input => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/en-US/localized-input
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/foo-data => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/foo-data
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/generate-foo.py => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/generate-foo.py
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/en-US/localized-input => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/inner/locales/en-US/localized-input
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/moz.build => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/moz.build
rename : python/mozbuild/mozbuild/test/backend/data/localized-generated-files/non-localized-input => python/mozbuild/mozbuild/test/backend/data/localized-generated-files-AB_CD/non-localized-input
extra : rebase_source : 816b6f220758f2bb3bdd3ec81a2cb02269c6de5b
2018-02-21 17:12:17 -08:00
Mike Shal e43bc408dc Bug 1441275 - ignore js/src/shell OBJDIR_FILES in the tup backend; r=chmanchester
Without linking support in the tup backend, we don't produce a js
binary, so we can't copy it via OBJDIR_FILES yet.

MozReview-Commit-ID: AxqhHi84HIg

--HG--
extra : rebase_source : 1011bc6296be81646004a6bd6572193c34f367d8
2018-02-22 16:15:18 -05:00
Ralph Giles ef7e020a97 Bug 1440449 - Remove codegen-units limit for debug builds. r=froydnj
Starting with Rust 1.24, the default codegen-units limit is 16,
with jobserver control to avoid overprovisioning. Remove our
previous fixed limit of 4 threads for debug builds.

For release, retain codegen-units=1 to make sure we get the
most complete optimization results.

Thanks to Simon Sapin for the suggestion.

MozReview-Commit-ID: FmYF4DcmBvt

--HG--
extra : rebase_source : 307ad8fad2874636adb3ce95a5cd47339e83f40c
2018-02-22 11:58:50 -08:00
Nick Alexander daf2cc6ccf Bug 1440428 - Remove Proguard JAR entirely. r=jchen
The Proguard dependency is now managed by Gradle.

MozReview-Commit-ID: EOvKSE5z28P

--HG--
extra : rebase_source : 760b117f500cc639cc8c24e9c02933990f358dd7
2018-02-26 11:37:41 -08:00
Nick Alexander 665e41ac95 Bug 1440432 - Remove AAR exploding from configure. r=jchen
The moz.build Java JAR definitions are, of course, broken, but they
will be removed soon enough.

MozReview-Commit-ID: KIxqLDwd9I7

--HG--
extra : rebase_source : 8312b3f125793f73d3e835d1c0a5c7cabd4ebc0c
2018-02-23 12:16:51 -08:00
Nick Alexander b9e726131c Bug 1440757 - Don't invoke aapt in mobile/android/base/Makefile.in. r=jchen
I choose to clean a bunch of ANDROID_* moz.build cruft here, too,
since it's just passing dependencies between moz.build and
Makefile.in.  The replacement for all of this is to just use
GENERATED_FILES in moz.build, but it'll still take some work to get to
that.  (Why does this stuff exist?  GENERATED_FILES didn't exist and
was resisted when I built this stuff.)

MozReview-Commit-ID: D3GJqJNL0Ih

--HG--
extra : rebase_source : 07351f9d3702cfc42c58bd317885d07882c45c3a
2018-02-23 11:57:28 -08:00
Nick Alexander 03710dc7d0 Bug 1440743 - Part 2: Remove most of MOZ_BUILD_MOBILE_ANDROID_WITH_GRADLE. r=jchen
This is the easy stuff -- everything but mobile/android/base/Makefile.in.

MozReview-Commit-ID: 5x2z97AHUrR

--HG--
extra : rebase_source : 531fd41d367cad071b209b85ca5b5602fd7cbf7b
2018-02-22 11:45:51 -08:00
Nick Alexander 1ff0250889 Bug 1440433 - Part 2: Remove ANDROID_APK_{NAME,PACKAGE}. r=jchen
The last APK produced using the ANDROID_APK_* moz.build/Makefile.in
mechanism was Robocop, so we can get rid of these now.

MozReview-Commit-ID: 9b08ZvvOAoC

--HG--
extra : rebase_source : ac4fea057bf6e731b0f26a1b6902f17a7362076d
2018-02-22 13:36:49 -08:00
Chris Manchester 7dfc0e5eaf Bug 1436959 - Use the correct case-insensitive sorted iterator when sorting lists in generated GN moz.build files. r=dminor
MozReview-Commit-ID: 9NY4cPF1awQ

--HG--
extra : rebase_source : d57ebb30ebbc1921bea02407466fa139a4d5beb4
2018-02-22 12:04:53 -08:00
Gurzau Raul 6ef84d63ec Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-04-20 12:15:48 +03:00
Cosmin Sabou e9186f7449 Merge mozilla-central to inbound. a=merge CLOSED TREE
--HG--
rename : testing/mozharness/mozharness/mozilla/testing/verify_tools.py => testing/mozharness/mozharness/mozilla/testing/per_test_base.py
2018-04-20 01:38:32 +03:00