Граф коммитов

2780 Коммитов

Автор SHA1 Сообщение Дата
Luis de Bethencourt 48d0873809 Bug 1140088 - Update git URL to github; r=froydnj
git.mozilla.org has been decommissioned.

DONTBUILD because comment-only fixes are safe.
2017-04-25 14:46:52 +01:00
Cameron McCormack 14afe3c7a2 Bug 1257451 - Make |mach run| use --debugger-args instead of --debugparams, like the mochitest/reftest commands do. r=gps
MozReview-Commit-ID: ChB9KjNKbHO

--HG--
extra : rebase_source : 223097b1bef76fc5134d15af8cf68ed5e57fe961
2017-04-21 13:17:31 +10:00
Mike Hommey 34e619d1c1 Bug 1357323 - Remove support for gonk in the build system. r=gps
Everything depending on the widget being gonk can go away, as well as
everything depending on MOZ_AUDIO_CHANNEL_MANAGER, which was only
defined on gonk builds under b2g/ (which goes away in bug 1357326).

--HG--
extra : rebase_source : 9f0aeeb7eea8417fa4e06d662d566d67ecaf2a24
2017-04-18 16:56:09 +09:00
Mike Hommey 75fd170e4c Bug 1357326 - Remove things relying on the b2g* MOZ_BUILD_APP in the build system. r=gps
--HG--
extra : rebase_source : 2471f47ad07d8b90098f90db3ead2e26648cea9f
2017-04-18 18:39:53 +09:00
Mike Hommey 9620fd514e Bug 1356937 - Avoid `mach artifact toolchain` failing to get taskcluster artifacts when they are not directly under public/. r=gps
--HG--
extra : rebase_source : aeb7a54dea393a97c8597412e45520a2215f9cc5
2017-04-17 09:47:56 +09:00
Chris Manchester c0c9bf46a0 Bug 1247567 - Include per-source flags in the CompileDB. r=glandium
MozReview-Commit-ID: Ivm4DeG8z94

--HG--
extra : rebase_source : 036629e4aefed04be78452d4c1cb88e8009da35e
2017-04-14 16:02:25 -07:00
Mike Hommey 81ecb91908 Bug 1356976 - Don't make `mach artifact toolchain` return an error code when there is nothing to download. r=gps
There can be cases where there is simply nothing to download, especially
with the --for-job argument. So we just stop erroring out when nothing
was downloaded.

However, if the user explicitly requested a particular file(s) via the
command line and there is nothing to download, we still emit an error
code.

--HG--
extra : rebase_source : 143c15c9711bbfbbfdc110da14f3738132d53ed4
2017-04-17 16:02:25 +09:00
Mike Hommey 59c62bd61c Bug 1356934 - Don't assume the path to the taskcluster config is relative to topsrcdir. r=gps
--HG--
extra : rebase_source : 4f9f30f563b60649f4fe26836c766e16d4b54491
2017-04-17 09:05:13 +09:00
Alex Gaynor fcd28c5b2a Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati

--HG--
extra : rebase_source : 81ba8bfee0ca96979cf8e30d75cdd47f06bc10ea
2017-04-07 14:53:19 -04:00
Sebastian Hengst e7317789ad Backed out changeset 225683fed1d1 (bug 1294641) for breaking crashtests, reftests and Windows builds. r=backout on a CLOSED TREE 2017-04-17 16:29:52 +02:00
Alex Gaynor fd11319799 Bug 1294641 - whitelist reads from the .app directory in the macOS sandbox r=froydnj,haik
This patch does a few things:
a) Adds the resources location from the .app directory to the read whitelist
b) When it's a non-packaged build, mach run (and various mach tests) set an environment variable for the repo location which we allow reads from.

r=haik,froydnj

MozReview-Commit-ID: KNvAoUs5Ati

--HG--
extra : rebase_source : f637acff32fc8582732de932503dd696abc57877
2017-04-07 14:53:19 -04:00
Mike Hommey d9e412fe4d Bug 1356524 - Add a `mach artifact toolchain` option to get artifacts from taskcluster builds. r=gps
Now that we have automated build jobs that produce toolchains, we want
to avoid the burden of uploading them to tooltool and then update the
tooltool manifests. But we don't have build jobs for all the possible
toolchains, so we allow `mach artifact toolchain` to get a mix of
tooltool and taskcluster artifacts.

For taskcluster artifacts, we can give a list of job names (conveniently
automatically normalized to begin with 'toolchain-' and end with '/opt')
for which the artifacts will be downloaded, in place of any tooltool
package with the same name (if a tooltool manifest is given).

The taskcluster artifacts that we download are the ones matching the
contents of the tree the command is run with, per the resources declared
for the corresponding toolchain build job (in
taskcluster/ci/toolchain*.yml)

So for example, a linux64 build could call the following command:
  mach artifact toolchain --tooltool-manifest \
    browser/config/tooltool-manifests/linux64/releng.manifest \
    --from-build linux64-gcc

and get the right gcc corresponding to the build-gcc script in tree,
along with the other non-gcc files from the tooltool manifest.

Things are however planned to be even more convenient, but some commands
can already benefit from this form (even without a tooltool manifest).
See e.g. bug 1328454.

--HG--
extra : rebase_source : b12ed77bef529eb8d67476aceac0166bdfe2eeed
2017-04-14 11:34:53 +09:00
Mike Hommey 29eb575e7e Bug 1356524 - Only add Authorization header when sending requests to the tooltool url. r=gps
We're going to potentially use the same download manager for tooltool
and taskcluster artifacts, and we don't want to send the tooltool
authentication header to the taskcluster requests.

--HG--
extra : rebase_source : 79a0afdbf06cb05d7792f413ab1f6715b2a9fe2e
2017-04-14 10:28:42 +09:00
Gregory Szorc 81cd3ec73b Bug 1334525 - Handle tuple types and WPT manifests correctly; r=chmanchester
beb43155b7a6 changed WPT items to be 3-tuples instead of 2-tuples.
This broke test_defaults_for_path().

MozReview-Commit-ID: 7M0RcQ7bOIU

--HG--
extra : rebase_source : 28e44e5206abb7939d540ba809ec71325ead341c
2017-04-12 15:15:36 -07:00
Mike Hommey a8cb87ea48 Bug 1356142 - Use mozbuild.util.mkdir instead of os.makedirs for the artifact cache directory. r=gps
At the same time, make the artifact cache directory not indexed, and
move the directory creation to the base classes that actually use it.

--HG--
extra : rebase_source : 62994499afceb5166c0041148dcc702f87166fdc
2017-04-13 16:35:20 +09:00
Mike Hommey 7b4adcc548 Bug 1355731 - Add a mach command wrapping tooltool. r=gps
The ultimate goal is to have a generic command that pulls relevant
toolchains from either tooltool or taskcluster artifacts.

This introduces the command and makes it work to allow to wrap tooltool
in most places where it's used currently, with the ability to replace
tooltool_wrapper.sh as well.

--HG--
extra : rebase_source : f63178282f00f8698a148db484f0276c99d61f7b
2017-04-12 17:42:17 +09:00
Mike Hommey f3a3f6081e Bug 1355731 - For artifacts cache, use the file name from the url if it looks like a hash digest. r=gps
--HG--
extra : rebase_source : ef48b50df8f1063c8ed9c27ecf04b17388b69512
2017-04-12 16:26:20 +09:00
Mike Hommey 4d1881e4dd Bug 1355731 - Move tooltool to mozbuild.action. r=gps
--HG--
rename : taskcluster/docker/recipes/tooltool.py => python/mozbuild/mozbuild/action/tooltool.py
extra : rebase_source : 6278d8692956a67f37fd788df894657d6eeb53e8
2017-02-22 17:20:41 +09:00
Wes Kocher 20dd5f52c2 Merge m-c to autoland, a=merge 2017-04-13 17:35:34 -07:00
Wes Kocher 514e230373 Merge inbound to central, a=merge 2017-04-13 17:24:01 -07:00
Mike Hommey aedebf3f44 Bug 1356064 - Remove the mach artifact print-cache subcommand. r=nalexander
--HG--
extra : rebase_source : b044acc420285ec050196efdf737e59d60269991
2017-04-13 09:50:57 +09:00
Mike Hommey a3c516ed4e Bug 1356064 - Remove the mach artifact last subcommand. r=nalexander
It has been broken for a while (bug 1341205).

--HG--
extra : rebase_source : 85feaf001545642342c54af856fd4dfe6828b35d
2017-04-13 09:47:27 +09:00
Gregory Szorc f2e9cb2310 Bug 1355630 - Inline specialized version of relpath(); r=chmanchester
Profiling revealed that mozpath.relpath() accounted for a lot of CPU
time when operating on an input of ~42,000 paths.

Due to the nature of the paths we're operating on, we don't need the
full power of mozpath.relpath() here. Instead, we can implement a
specialized version that works given already normalized paths and the
knowledge that context paths must be ancestors of the current path
being examined.

This change drops execution time of a mach command feeding ~42,000
paths to this function from ~90s to ~24s. On an input with 9131 paths,
execution time dropped from ~8.8s to ~3.7s.

MozReview-Commit-ID: EGLiJa10Zj2

--HG--
extra : rebase_source : 8e9d7a957ea3d865a6f18a3b99cca2b22f7a0385
2017-04-11 16:46:55 -07:00
Gregory Szorc 009ab65975 Bug 1355630 - Memoize tests_defaults_for_path call; r=chmanchester
Calling self.test_defaults_for_path() from files_info() with tens
of thousands of paths resulted in a CPU explosion in various path
normalization functions. I don't think it was so much the complexity
of the operations as much as the volume.

For an input with 9131 elements, this reduces execution time of a
mach command from ~25.7s to ~8.8s. With ~42,000 inputs, execution time
drops from <it took too long and I gave up> to ~90s.

MozReview-Commit-ID: pjQQByi2Bc

--HG--
extra : rebase_source : b8307a92e494f128ba3cf29348bc7996cfea4221
2017-04-11 16:24:42 -07:00
Gregory Szorc 4a47739a31 Bug 1355630 - Use a set for membership testing; r=chmanchester
With ~42,000 entries in relpaths, this change drops execution time
of this loop from ~23s to ~0.01s.

MozReview-Commit-ID: Afm245tjWUQ

--HG--
extra : rebase_source : 86ee525b0539c80e47e4326a3f111a3fc84d0a6e
2017-04-11 15:25:13 -07:00
Nathan Froyd 2989feb7d7 Bug 1353810 - add a --enable-rust-debug option; r=chmanchester
For people working on Rust code, compiling in debug mode (Cargo's "dev"
profile) is convenient: debug assertions are turned on, optimization is
turned off, and parallel compilation inside of rustc itself can be
used.  These things make the build faster and the debugging experience
more pleasant.

To obtain that currently, one needs to --enable-debug at the Gecko
toplevel, which turns on debug assertions for the entire browser, which
makes things run unreasonably slowly.  So it would be desirable to be
able to turn *off* debug mode for the entirety of the browser, but turn
on debug mode for the Rust code only.

Hence this added switch, --enable-rust-debug, which does what it
suggests and defaults to the value of --enable-debug.  For our own
sanity and because we judge it a non-existent use case, we do not
support --enable-debug --disable-rust-debug.
2017-04-12 21:49:25 -04:00
Wes Kocher 2986c817dc Merge autoland to central, a=merge CLOSED TREE 2017-04-12 15:13:30 -07:00
Axel Hecht d5c1373ef0 bug 1344782, update compare-locales to 1.2.3, r=flod
Dropped support for python 2.6
Removed support for bookmarks.html
Better internal APIs

Intermediate versions had incompatibilities with old versions
of python 2.7, but 1.2.3 does not.

MozReview-Commit-ID: LfKhr8qWe28

--HG--
extra : rebase_source : 21fc39d45f22f4a6ae10523a87b0e6068f268439
2017-04-12 15:26:40 +02:00
Petr Sumbera 0e17adee7c Bug 1354510 - Firefox build should recognize Solaris. r=glandium
--HG--
extra : rebase_source : 2bec2709a26a5295e723b0ecc424b0d648715bb7
2017-04-11 00:01:32 -07:00
Mike Shal 5b62b8c036 Bug 1337145 - Remove python components used for EME generation; r=glandium
MozReview-Commit-ID: G8OhcbStQkG

--HG--
extra : rebase_source : ad7434cf729c3257bcc3911a4d25ba0145384939
2017-04-10 13:40:03 -04:00
Chris Manchester 5c47bb8d2e Bug 1337986 - Dump symbols during the compile tier. r=ted
This commit moves symbol dumping to the compile tier, to be run via "syms"
targets. Tracking files are used for the sake of incremental builds, because
dump_syms may genearate multiple outputs whose paths are not known ahead of
time.

Minimal changes to symbolstore.py are made here. More extensive
simplifications will be made in a future commit on the basis of symbolstore.py
handling one file at a time.

MozReview-Commit-ID: 3mOP8A6Y7iM

--HG--
extra : rebase_source : bfe97afcdfc05b9e79f01577701c83e8b00eb4e9
2017-02-10 08:34:08 -08:00
Chris Manchester 4db8e0b54a Bug 1337986 - Generate "syms" targets for directories containing programs or shared libraries. r=glandium
This creates "syms" targets that depend on the corresponding "target" for
directories containing shared libraries or programs. These targets are added
to the main compile graph in automation, and can be invoked through a special
"symbols" target. A future commit will use these targets to dump symbols for
shared libraries and programs during the compile tier.

MozReview-Commit-ID: KLuvmqsK4Zj

--HG--
extra : rebase_source : 8d76b999cb6fac8f11168ac6ebfb58774dfc2d3c
2017-04-10 10:27:49 -07:00
Simon Sapin 8f7b8a3663 Bug 1352815 - "codegen-units = 4" for Rust code in debug mode r=froydnj
MozReview-Commit-ID: IIFVmijY4B3

--HG--
extra : rebase_source : 1722dba55a1759f15b82532c13f1e61affd28e9b
2017-04-02 14:17:44 +02:00
Sebastian Hengst 548852b3a4 merge mozilla-central to autoland. r=merge a=merge 2017-04-07 22:16:26 +02:00
Carsten "Tomcat" Book 3a762886de Merge mozilla-central to mozilla-inbound 2017-04-07 15:33:03 +02:00
Michael Layzell 981693a30f Bug 1320179 - Part 2: Add the nserror rust crate and generate NS_ERROR codes, r=froydnj
MozReview-Commit-ID: FFU6WfEqev
2017-04-06 18:37:25 -04:00
Ralph Giles 1d688bb86c Bug 1354221 - Remove dead code in _process_rust_library. r=froydnj
These variables are ignored in favour or reading the same values
from the passed in libdef object.

MozReview-Commit-ID: 8Xkkd68clNN

--HG--
extra : rebase_source : 767c15f1b59a6f48d09411c4f2e64eff9f8b4cc6
2017-04-06 10:59:46 -07:00
Locke Chen 29b6845e6b Bug 1350229 - Removing Preview side panel. r=rickychien
MozReview-Commit-ID: aDksj7VKAp

--HG--
extra : rebase_source : b0c19cc8fc7b41fed7909f3a1ee56a16ee0f4468
2017-04-07 23:31:18 +08:00
Michael Layzell fb7949544e Bug 1347290 - Set sgr0 to '' if blessings.tigetstr('sgr0') returns None, r=gps
MozReview-Commit-ID: vP4izM2RwP
2017-04-06 17:44:30 -07:00
Utkarsh Anand ecd3979b25 Bug 1353460 Asked the user to restart the shell before building from source. r=rillian
When downloading rust manually, it's mandatory to restart the shell,
as the script does not export the PATH environment variable.
This fix also ensures that the rust version in PATH is modern enough for a successful build.

MozReview-Commit-ID: HdLpiLPBLW7

--HG--
extra : rebase_source : dc087c36e89fd6d2957fd1e03af42229de914d5a
2017-04-06 08:27:57 +05:30
Ting-Yu Chou e529a580e1 Bug 1333003 part 5 - Include ASan runtime dll in common.tests.zip. r=ted
MozReview-Commit-ID: AzPdxaWwJn4

--HG--
extra : rebase_source : ce80d8569b7abc3afe3ca4bba653f030d16d8ffc
2017-03-10 12:09:17 +08:00
Chris AtLee b7af545070 Bug 1351071: Get rid of pre-generated startup cache r=glandium
MozReview-Commit-ID: BcWcqEKwGBv

--HG--
extra : rebase_source : 4bd21805a89359a5a2ed7ffd2ee2b76cf1e9e634
2017-04-04 09:26:25 -04:00
Carsten "Tomcat" Book 14e0b51ace merge mozilla-inbound to mozilla-central a=merge 2017-04-04 12:35:03 +02:00
Justin Wood 71acec2f03 Bug 1185666 - Move DMG unpack logic to a python script, support linux. r=mshal
MozReview-Commit-ID: inKT2BWof4

--HG--
extra : rebase_source : 3fa0861bd363a8b22002111fe55ab2d248d85d6c
extra : source : e1df7b730858ba0170004a5b705f2bc484f9e2b0
2017-03-28 21:46:19 -04:00
Axel Hecht b1ae66a84b bug 1336406, update http -> https in compare-locales docs, r=aryx
Ride-along fix to change http://mxr to https://dxr, too.

MozReview-Commit-ID: 2H6aGv9nuKv

--HG--
extra : rebase_source : 63e83e193747f6b56d7bee9a368d200eac15bc86
2017-04-03 14:55:28 +02:00
Chris Manchester 4ada59b662 Bug 1349640 - Upload a mapping for headers in dist/include for the benefit of code coverage builds. r=mshal
MozReview-Commit-ID: 5q9I5S1QOt9

--HG--
extra : rebase_source : e893e9b2ea1ef2cbfe1cfd8e92af71e79f1615a2
2017-03-29 11:43:16 -07:00
Mike Hommey d559ffb37a Bug 1343718 - Limit artifact downloads by size rather than by number. r=chmanchester
This adds a unit test for the expected behavior, and adds the modules
from mach_bootstrap.py that are missing in the virtualenv for the test
to run.

--HG--
extra : rebase_source : e34d0474cfb6c8c5ce9cd847b96de88906191923
2017-04-12 16:17:52 +09:00
Mike Hommey a07b022268 Bug 1343718 - Don't display download progress when we don't know the download size in advance. r=chmanchester
In most cases, the HTTP response for the download will contain the
content-length, but if some error happens (e.g. authentication error),
there might not be one, and the download fails with a TypeError for a
division by None, instead of failing with a more friendly error message
about the HTTP error.

--HG--
extra : rebase_source : f179142e69c9ca09b05ad2ff942753fd84da6a69
2017-03-01 11:16:27 +09:00
Mike Hommey 2f47399ef6 Bug 1343718 - Avoid requiring an objdir when simply importing mozbuild.artifacts. r=chmanchester
--HG--
extra : rebase_source : 99daff7ae1e2d1072f19c96a3c1777498e63342f
2017-03-01 11:15:15 +09:00
Mike Shal 306a525fa2 Bug 1347576 - Add a 'mach repackage' command, with OSX dmg support; r=chmanchester
This is the initial support of 'mach repackage', which can take an
existing tarball and create a DMG on either an OSX host or on a Linux
host with cross-OSX tools. Configure is needed in order to find the
tools necessary to create the DMG. On a Linux cross-compiled environment
with tooltool, this can be as simple as:

export MKFSHFS=$topsrcdir/hfsplus-tools/newfs_hfs
export DMG_TOOL=$topsrcdir/dmg/dmg
export HFS_TOOL=$topsrcdir/dmg/hfsplus
ac_add_options --disable-compile-environment

MozReview-Commit-ID: 6t2rlXpwUvu

--HG--
extra : rebase_source : 39f2f9ecac9d7e5af197f1b5dea70cd307acf488
2017-03-10 18:36:23 -05:00