Граф коммитов

5023 Коммитов

Автор SHA1 Сообщение Дата
Tom Prince fcc513bfe6 No bug: [try-staging] Allow partial generation to access https URLS on try; r=sfraser
The nightly partial generation code generates URLs with https:// so they should
be accepted as well.

Differential Revision: https://phabricator.services.mozilla.com/D15311

--HG--
extra : moz-landing-system : lando
2019-01-02 15:18:50 +00:00
ffxbld 1a0579d51b No Bug, taskcluster/docker/funsize-update-generator pipfile-update. r=sfraser
Differential Revision: https://phabricator.services.mozilla.com/D15508

--HG--
extra : moz-landing-system : lando
2019-01-02 15:17:53 +00:00
Razvan Maries 3e7afaa5b5 Merge mozilla-inbound to mozilla-central a=merge 2019-01-01 11:44:07 +02:00
Bob Clary 45ab4c31ef Bug 1501584 - Run jittests for opt js shell for arm7, arm64 on android-hw-p2, r=jmaher. 2018-12-31 14:15:30 -08:00
Gregory Szorc 7db2ec0def Bug 1512188 - Consolidate VCS checkout from args logic; r=tomprince,dustin
We create a minimal wrapper function to call collect_vcs_options()
and vcs_checkout().

We could consolidate this logic into vcs_checkout(). But I don't have
strong feelings about doing that.

Differential Revision: https://phabricator.services.mozilla.com/D13821

--HG--
extra : moz-landing-system : lando
2018-12-31 18:50:34 +00:00
Gregory Szorc 2bf175f722 Bug 1512188 - Collect hg store path in collect_vcs_options(); r=tomprince,dustin
One step closer to making all state gathering and normalization in one
place.

Differential Revision: https://phabricator.services.mozilla.com/D13819

--HG--
extra : moz-landing-system : lando
2018-12-31 18:54:14 +00:00
Gregory Szorc 952e5d5655 Bug 1512188 - Move base repo normalization into collect_vcs_options(); r=tomprince,dustin
This is a generic normalization and doesn't need to be Firefox
specific.

Differential Revision: https://phabricator.services.mozilla.com/D13817

--HG--
extra : moz-landing-system : lando
2018-12-31 18:54:31 +00:00
Gregory Szorc 426f2868cd Bug 1512188 - Collect environment variables into VCS options; r=tomprince,dustin
This makes behavior consistent across all VCS checkouts. I'm still not
a fan of using environment variables here. But at least this gets us
1 step closer to being able to plug alternate logic in without having
to update use of environment variables outside a single function.

Differential Revision: https://phabricator.services.mozilla.com/D13816

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:32 +00:00
Gregory Szorc b809920807 Bug 1512188 - make VCS checkout options generic; r=tomprince,dustin
We currently manage VCS checkout arguments as one-offs for each
project. This isn't scalable and results in a bit of copy-pasta.

Let's make the VCS checkout arguments generic so we can have the
same control for all repositories.

This commit focuses on consolidating the existing argument parser
code. It stops short of further unification, which will be done in
subsequent commits.

Differential Revision: https://phabricator.services.mozilla.com/D13815

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:30 +00:00
Tom Prince 94212a8c9a Bug 1512285: Stop checking out tools; r=nthomas,gps
This code was used by mozharness jobs to check out the tools repo.
However, those jobs aren't actually using the repository.

Differential Revision: https://phabricator.services.mozilla.com/D13855

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:28 +00:00
Gregory Szorc 1693cc73d8 Bug 1512188 - Rename --sparse-profile to --gecko-sparse-profile; r=tomprince,dustin
We have multiple source checkouts. --sparse-profile is ambiguous
as to which one it could refer to. Let's rename the argument so it
is prefixed with the repo/project we are checking out.

Differential Revision: https://phabricator.services.mozilla.com/D13814

--HG--
extra : moz-landing-system : lando
2018-12-31 18:52:26 +00:00
Gregory Szorc fe09099db1 Bug 1512188 - Rename --vcs-checkout to --gecko-checkout; r=tomprince,dustin
We now have multiple things we may check out. "vcs" meaning "gecko"
is not obvious. Let's change the terminology to be more specific.

Differential Revision: https://phabricator.services.mozilla.com/D13813

--HG--
extra : moz-landing-system : lando
2018-12-31 18:51:27 +00:00
Bogdan Tara 8fb34de423 Backed out 8 changesets (bug 1512285, bug 1512188) for fetch bustages CLOSED TREE
Backed out changeset 5e7aa7d98012 (bug 1512188)
Backed out changeset 55874a956ae1 (bug 1512188)
Backed out changeset ac6e2cd6eb32 (bug 1512188)
Backed out changeset f68df074eac1 (bug 1512188)
Backed out changeset f01d2662582f (bug 1512188)
Backed out changeset 35d74dd16706 (bug 1512285)
Backed out changeset 9e95b9bf1201 (bug 1512188)
Backed out changeset ac4a49eb95f5 (bug 1512188)
2018-12-29 07:56:56 +02:00
Gregory Szorc 555c86c76d Bug 1512188 - Consolidate VCS checkout from args logic; r=tomprince,dustin
We create a minimal wrapper function to call collect_vcs_options()
and vcs_checkout().

We could consolidate this logic into vcs_checkout(). But I don't have
strong feelings about doing that.

Differential Revision: https://phabricator.services.mozilla.com/D13821

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:45 +00:00
Gregory Szorc d87b04a55a Bug 1512188 - Collect hg store path in collect_vcs_options(); r=tomprince,dustin
One step closer to making all state gathering and normalization in one
place.

Differential Revision: https://phabricator.services.mozilla.com/D13819

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:38 +00:00
Gregory Szorc 7d0932f16a Bug 1512188 - Move base repo normalization into collect_vcs_options(); r=tomprince,dustin
This is a generic normalization and doesn't need to be Firefox
specific.

Differential Revision: https://phabricator.services.mozilla.com/D13817

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:36 +00:00
Gregory Szorc 8fb6cd08a8 Bug 1512188 - Collect environment variables into VCS options; r=tomprince,dustin
This makes behavior consistent across all VCS checkouts. I'm still not
a fan of using environment variables here. But at least this gets us
1 step closer to being able to plug alternate logic in without having
to update use of environment variables outside a single function.

Differential Revision: https://phabricator.services.mozilla.com/D13816

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:28 +00:00
Gregory Szorc 17d3010722 Bug 1512188 - make VCS checkout options generic; r=tomprince,dustin
We currently manage VCS checkout arguments as one-offs for each
project. This isn't scalable and results in a bit of copy-pasta.

Let's make the VCS checkout arguments generic so we can have the
same control for all repositories.

This commit focuses on consolidating the existing argument parser
code. It stops short of further unification, which will be done in
subsequent commits.

Differential Revision: https://phabricator.services.mozilla.com/D13815

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:26 +00:00
Tom Prince d5999f77d3 Bug 1512285: Stop checking out tools; r=nthomas,gps
This code was used by mozharness jobs to check out the tools repo.
However, those jobs aren't actually using the repository.

Differential Revision: https://phabricator.services.mozilla.com/D13855

--HG--
extra : moz-landing-system : lando
2018-12-29 05:22:38 +00:00
Gregory Szorc 8c1a7bccef Bug 1512188 - Rename --sparse-profile to --gecko-sparse-profile; r=tomprince,dustin
We have multiple source checkouts. --sparse-profile is ambiguous
as to which one it could refer to. Let's rename the argument so it
is prefixed with the repo/project we are checking out.

Differential Revision: https://phabricator.services.mozilla.com/D13814

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:17 +00:00
Gregory Szorc 8fc5669189 Bug 1512188 - Rename --vcs-checkout to --gecko-checkout; r=tomprince,dustin
We now have multiple things we may check out. "vcs" meaning "gecko"
is not obvious. Let's change the terminology to be more specific.

Differential Revision: https://phabricator.services.mozilla.com/D13813

--HG--
extra : moz-landing-system : lando
2018-12-29 05:13:09 +00:00
Tom Prince 80d4fb46b9 No bug: [taskgraph] Don't set `optimize_target_tasks` by branch; r=dustin
The only branch where it set differently is `try`/`try-comm-central`, but it gets
overriden there in `set_try_config`.

Differential Revision: https://phabricator.services.mozilla.com/D15478

--HG--
extra : moz-landing-system : lando
2018-12-28 21:13:48 +00:00
Dustin J. Mitchell 47fcc268c7 Bug 1492664 - update references in docs; r=froydnj
--HG--
extra : rebase_source : f3380ffab79969558e3d99029d27383f00765b93
extra : source : c82285d253de952fe6388e2ec5060057e2e8e80b
2018-09-25 19:06:08 +00:00
Dustin J. Mitchell ab2f0b15fa Bug 1492664 - update periodic-updates to use TASKCLUSTER_ROOT_URL; r=sfraser
--HG--
extra : rebase_source : fcdc425191c5220f385b68585428dd0a8ade65c1
extra : source : d9a7f2ce49c3634baab1535315f9ba9f8f3b14ea
2018-10-02 16:52:47 +00:00
Dustin J. Mitchell 522b4d59c5 Bug 1492664 - update funsize scripts to use TASKCLUSTER_ROOT_URL; r=sfraser
--HG--
extra : rebase_source : 2ba8033b5de5f556209c4955ec39946a403cd150
extra : source : 06c466ab432372eb645f07ca1ff215052492b358
2018-10-02 16:43:31 +00:00
Dustin J. Mitchell 8e7b665a05 Bug 1492664 - update pipfile-updates to use TASKCLUSTER_ROOT_URL; r=tomprince
--HG--
extra : rebase_source : a0b19a8f10f05ee3ce00e7d15d952d2acc19b8d7
extra : source : c1ea4a10cc8d3631d61c1172624373e3901debd7
2018-10-02 15:54:51 +00:00
Dustin J. Mitchell ffd4136773 Bug 1492664 - update diffoscope tasks to use TASKCLUSTER_ROOT_URL; r=glandium
--HG--
extra : rebase_source : c81ea68802e516744d10799d20059a3f019a4d23
extra : source : 4c63a04fdd47c7cb8dc7350ae7fd6d861b525a2d
2018-10-02 15:52:28 +00:00
Dustin J. Mitchell 60d0a26a65 Bug 1492664 - update fetch-content to use TASKCLUSTER_ROOT_URL; r=tomprince
--HG--
extra : rebase_source : ae5064b8cf13ee50b4db0299e4b7fad215902af1
extra : source : 742b038bb1dd39c029afce73eb3f5b683cb590f2
2018-10-02 14:40:39 +00:00
Dustin J. Mitchell baf08548f8 Bug 1492664 - update libdmg-hfsplus to use TASKCLUSTER_ROOT_URL; r=glandium
--HG--
extra : rebase_source : 3a6917e97cdeb2153425c96e06b1e5f85d1782f0
extra : source : 911b4b0fb6835fc7d0caaea5d64a590563ca3104
2018-12-10 20:14:52 +00:00
Dustin J. Mitchell bc68c63ae0 Bug 1492664 - move list_task_group to taskgraph.taskcluster.util; r=bstack
--HG--
extra : rebase_source : 2ceef629af09aa6264e30977426a527b234c43db
extra : source : 870c8cec99e5f81814a8064a785c4c96f5f1aeca
2018-10-02 14:19:11 +00:00
Dustin J. Mitchell 8f32bbe7eb Bug 1492664 - use taskcluster_urls to generate interactive URL; r=bstack
--HG--
extra : rebase_source : 24fd3ac54b923a5d7734d43404dc3f49fc83dd45
extra : source : 77699b51336b804336222192734922f76ea7ac10
2018-10-02 17:31:46 +00:00
Dustin J. Mitchell 0a5ad02fff Bug 1492664 - use taskcluster-urls to create taskcluster URLs; r=tomprince
--HG--
extra : rebase_source : 94fc30f53f75e67f221f15db1945640edf69537a
extra : source : 29f33f22fd8b6998276e10c10aac2e36e64af4bb
2018-09-25 20:31:44 +00:00
Tom Prince e58a5b2a19 Bug 1492664: Replace uses of `get_taskcluster_artifact_url` with `artifact-reference`; r=dustin
--HG--
extra : rebase_source : c08110089030074cf4a831ce8e94678da03704a6
extra : source : e7f30540870849cf6ba49957d37190fbd89b5f0d
2018-12-18 15:35:18 +00:00
Dustin J. Mitchell 543c3406d6 Bug 1492664 - use {artifact-reference: ..} in diffoscope; r=glandium
--HG--
extra : rebase_source : b88ab8abd497b3ff3bcacea60ece1dea4ce0bb8a
extra : source : 335a92b1f42444dbcc4057f14bafab7f73f59e66
2018-12-13 02:14:52 +00:00
Dustin J. Mitchell a88dc1dc6c Bug 1492664 - use {artifact-reference: ..} for l10n; r=aki
--HG--
extra : rebase_source : 7ffaaa44bfbe1e9510e5e929a0be4af1176e92cc
extra : source : c566f1c8dcdfe6fdf73b0c0d8da66a14a7bfec08
2018-12-10 20:38:49 +00:00
Dustin J. Mitchell 7b1592b76e Bug 1492664 - use {artifact-reference: ..} for symbol uploads; r=ted
--HG--
extra : rebase_source : 38f37588ff70e42b3b7081657dbce9940aa46a62
extra : source : c77ae59aba41a65f0e9d4896f9dfe3bf8a0e8353
2018-10-02 14:47:59 +00:00
Dustin J. Mitchell 536dc55522 Bug 1492664 - add {artifact-reference: ..}; r=tomprince
This provides an easy way to encode an artifact URL in static data such as
taskcluster/ci/nightly-l10n/kind.yml, without knowing in advance the format of
the URL.

--HG--
extra : rebase_source : 5b5229d96aad2916b1b3c8e72045c1d461fc1c02
extra : source : 9c35dd209c6b407bc3a45ce7b4c27272ef1bb486
2018-09-25 20:26:55 +00:00
Dustin J. Mitchell 1516eb0435 Bug 1492664 - set TASKCLUSTER_ROOT_URL and TASKCLUSTER_PROXY_URL; r=tomprince,glandium
Eventually, workers will provide these variables directly
(https://bugzilla.mozilla.org/show_bug.cgi?id=1460015).  But for now, this
ensures that TASKCLUSTER_ROOT_URL is set everywhere in production, and
TASKCLUSTER_PROXY_URL is set wherever the proxy is active.

The taskgraph Taskcluster utils module gets a `get_root_url()` that gets the
root URL for the current run, either from an environment variable in production
or, on the command line, defaulting to https://taskcluster.net for user
convenience.  When the production instance's URL changes, we can simply change
that default.

Other changes to use this function are reserved for later commits.

This changes the docker build process propagate TASKCLUSTER_ROOT_URL into the
docker images where necessary (using %ARG), specifically to create URLs for
debian repo paths.

--HG--
extra : rebase_source : 4f50e9d066da62a1887baabd8603844c85a32ee6
extra : source : 5ea6f03f845e49d503f5d0283557f54561c41654
2018-09-25 20:18:19 +00:00
Tom Prince bce106f4b1 Bug 1514087: [taskgraph] Add an option to not optimize target tasks in cron graphs; r=dustin
This allows the target tasks to include cached tasks, which by default, get
optimized out of the graph on on-`try` branches.

Differential Revision: https://phabricator.services.mozilla.com/D15278

--HG--
extra : moz-landing-system : lando
2018-12-26 14:43:34 +00:00
Nick Thomas 463964570d Bug 1492033 - Create partner repacks during esr60 releases r=tomprince
Supports partner builds on esr60 by re-arranging how we specify the manifest repositories, which are different for esr60 compared to beta+release. The defaults for enabling partners and EME-free now depend on the partner-urls definition in taskcluster/ci/config.yml.

This patch also adds support for partner & EMEfree repacks in try staging releases, for all the various release branches. It makes release_level available early in the decision task (for the release promotion action) where a Parameters object is not available. Signing worker type is no longer hard-coded, and we use level-1 secrets for querying Github (via bug 1513375).

Differential Revision: https://phabricator.services.mozilla.com/D15185

--HG--
extra : moz-landing-system : lando
2018-12-27 09:30:52 +00:00
Chris Manchester ccddf2ca6c Bug 1515512 - Require rustc 1.31. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D15396

--HG--
extra : source : f162598ad12cd59e1f653c541e6786b715b144fd
2018-12-27 02:22:54 +00:00
Cosmin Sabou c3c97ee7de Backed out changeset f162598ad12c (bug 1515512) on the suspicion of causing Linux asan browser chrome exceptions. 2018-12-27 07:43:08 +02:00
Chris Manchester ac40054b22 Bug 1515512 - Require rustc 1.31. r=glandium
Differential Revision: https://phabricator.services.mozilla.com/D15396

--HG--
extra : moz-landing-system : lando
2018-12-27 02:22:54 +00:00
Rob Lemley dcb9454741 Bug 1460487 - Set MOZ_SOURCE_CHANGESET appropriately for TB. r=dustin
Sets MOZ_SOURCE_CHANGESET to be the comm-* changeset when building
Thunderbird on Windows. This mirrors a change at line 196 that sets the
same when building for Linux and OSX.

Differential Revision: https://phabricator.services.mozilla.com/D15282

--HG--
extra : moz-landing-system : lando
2018-12-24 03:07:23 +00:00
Joel Maher 39d50eb76f Bug 1516452 - fix typo in taskgraph to 'dumps' instead of 'dums'. r=bc,Callek
fix typo in taskgraph to 'dumps' instead of 'dums'

Differential Revision: https://phabricator.services.mozilla.com/D15390

--HG--
extra : moz-landing-system : lando
2018-12-26 18:43:44 +00:00
Tom Prince 48317bb4df No bug: [taskgraph] Get hg branch name in a machine readable format; r=dustin
The original code include several extraneous newlines. Use a template instead,
to get a stable output format.

Differential Revision: https://phabricator.services.mozilla.com/D15309

--HG--
extra : moz-landing-system : lando
2018-12-25 14:25:19 +00:00
Tom Prince 83aee3f163 No bug: [taskgraph] Remove an unused global variable; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D14615

--HG--
extra : moz-landing-system : lando
2018-12-24 21:33:54 +00:00
Tom Prince ad61462a46 Bug 1515649: [taskgraph] Disable asan-reporter-nigthly via run-on-projects; r=dustin
Now that the upload-* kinds inherit `run-on-projects`, we don't need to special
case handling of them in target-tasks.

Differential Revision: https://phabricator.services.mozilla.com/D15153

--HG--
extra : moz-landing-system : lando
2018-12-22 16:55:28 +00:00
Tom Prince 1bec5769c4 Bug 1515649: [taskgraph] Inherit run-on-projects for upload-* kinds; r=dustin
We want these tasks to run if-and-only if the corresponding build does.

Differential Revision: https://phabricator.services.mozilla.com/D15152

--HG--
extra : moz-landing-system : lando
2018-12-24 21:23:47 +00:00
Tom Prince 9e30dfb033 Bug 1515649: [taskgraph] Remove `only-if-dependencies-run` optimization; r=dustin
The optimization doesn't actually do what it claims. For the optimization to be
considered, a task needs to be in the target graph, but then all the
dependencies will be too, which inhibits this optimization.

Differential Revision: https://phabricator.services.mozilla.com/D15151

--HG--
extra : moz-landing-system : lando
2018-12-22 16:55:28 +00:00