Граф коммитов

34 Коммитов

Автор SHA1 Сообщение Дата
Tom Prince 85e8be2031 Bug 1550816: Enforce consistent indenting in taskcluster yaml; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D30684

--HG--
extra : moz-landing-system : lando
2019-05-10 21:19:48 +00:00
Justin Wood 07e0d66261 Bug 1352113 - Shippable Builds - Support shippable where 'nightly' is used. r=aki
Makes most kinds that reference nightly attribute reference the shippable attribute.
Also makes most transforms that use nightly use shippable

Transfers dependencies/ownership for some things to shippable from nightly where it was harder to support both.

In no particular order, full list:
Send shippable attribute down to dep tasks.
Set tests as shippable attribute
Add new signing routes
Add shippable routes to repackage_routes transform
Adjust target tasks
Add shippable nightly-l10n
Add nightly-signing and as a side affect add repackage and repackage-signing
Add support for proper balrog platforms for shippable
Add shippable to the nightly sccache guard
Fix TC_PLATFORM_PER_FTP in partners.py to use shippable
Add shippable to mozharness_test variants
Only actually used for android which doesn't have shippable at this time.
Add shippable variant to beetmover transforms
Do nightly signing for mars on shippable
Support shippable in partner-repack transform
Support shippable in amo langpacks transform
Use proper signing for shippable tasks in repackage transforms
Set upload symbols to use shippable too
Use shippable as deps for geckodriver extraction
Use shippable as dep for autograph-stage signing
Do not run beetmover-l10n for shippable
Run shippable style jobs for repackage signing
Set build_platform for update verify and uvc to be shippable
Run repackage-msi for shippable
Add shippable to osx partner repack signing
add shippable to emefree repackage
add shippable to emefree repackage signing
add shippable to beetmover checksums
Add shippable to partner repack repackage signing
add partner repack beetmover
Add shippable to mar signing
Add shippable to mar-signing-l10n
add shippable to eme free beetmover checksums
Add shippable to upload-generated-sources
Add beetmover langpacks to shippable
Add repackage-l10n to shippable
Add shippable to partner repack chunk-dummy
Do eme free builds with shippable
Add signing of language packs to shippable
Add snap repackage for shippable
Add shippable for release-eme-free repack signing
Add partials for shippable
Add partner repack repackage for shippable
Add emefree beetmover for shippable
Add checksums-signing to shippable
Switch partner repacks to shippable
Add shippable to beetmover-repackage
Add secondary update verify configs for shippable
secondary update verify for shippable

Differential Revision: https://phabricator.services.mozilla.com/D24699

--HG--
extra : moz-landing-system : lando
2019-03-27 13:45:40 +00:00
Justin Wood 6b2c86f192 Bug 1352113 - Shippable Builds - make only-for-attributes accept any() instead of all() in the set. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D23130

--HG--
extra : moz-landing-system : lando
2019-03-27 13:45:32 +00:00
Cosmin Sabou a93c1714d4 Backed out 19 changesets (bug 1352113) for causing upload symbol bustages. CLOSED TREE
Backed out changeset 4943b23813fe (bug 1352113)
Backed out changeset 4b9413d05816 (bug 1352113)
Backed out changeset 3e2b6a495e8c (bug 1352113)
Backed out changeset 51ab82722846 (bug 1352113)
Backed out changeset 4b027c970719 (bug 1352113)
Backed out changeset 6b65273fab78 (bug 1352113)
Backed out changeset d7deec98601a (bug 1352113)
Backed out changeset b95b3f4e5243 (bug 1352113)
Backed out changeset 7cefe92f88d5 (bug 1352113)
Backed out changeset f64dfaf86a2e (bug 1352113)
Backed out changeset 686c228e3579 (bug 1352113)
Backed out changeset dd2eddef8b43 (bug 1352113)
Backed out changeset fc16a3ecfe68 (bug 1352113)
Backed out changeset b31cbe91bdf7 (bug 1352113)
Backed out changeset 694eac65a72e (bug 1352113)
Backed out changeset 6044aedac9c4 (bug 1352113)
Backed out changeset 456538d78b36 (bug 1352113)
Backed out changeset 01699fb72384 (bug 1352113)
Backed out changeset 4a2e544fea0d (bug 1352113)
2019-03-26 22:26:29 +02:00
Justin Wood 417805e566 Bug 1352113 - Shippable Builds - Support shippable where 'nightly' is used. r=aki
Makes most kinds that reference nightly attribute reference the shippable attribute.
Also makes most transforms that use nightly use shippable

Transfers dependencies/ownership for some things to shippable from nightly where it was harder to support both.

In no particular order, full list:
Send shippable attribute down to dep tasks.
Set tests as shippable attribute
Add new signing routes
Add shippable routes to repackage_routes transform
Adjust target tasks
Add shippable nightly-l10n
Add nightly-signing and as a side affect add repackage and repackage-signing
Add support for proper balrog platforms for shippable
Add shippable to the nightly sccache guard
Fix TC_PLATFORM_PER_FTP in partners.py to use shippable
Add shippable to mozharness_test variants
Only actually used for android which doesn't have shippable at this time.
Add shippable variant to beetmover transforms
Do nightly signing for mars on shippable
Support shippable in partner-repack transform
Support shippable in amo langpacks transform
Use proper signing for shippable tasks in repackage transforms
Set upload symbols to use shippable too
Use shippable as deps for geckodriver extraction
Use shippable as dep for autograph-stage signing
Do not run beetmover-l10n for shippable
Run shippable style jobs for repackage signing
Set build_platform for update verify and uvc to be shippable
Run repackage-msi for shippable
Add shippable to osx partner repack signing
add shippable to emefree repackage
add shippable to emefree repackage signing
add shippable to beetmover checksums
Add shippable to partner repack repackage signing
add partner repack beetmover
Add shippable to mar signing
Add shippable to mar-signing-l10n
add shippable to eme free beetmover checksums
Add shippable to upload-generated-sources
Add beetmover langpacks to shippable
Add repackage-l10n to shippable
Add shippable to partner repack chunk-dummy
Do eme free builds with shippable
Add signing of language packs to shippable
Add snap repackage for shippable
Add shippable for release-eme-free repack signing
Add partials for shippable
Add partner repack repackage for shippable
Add emefree beetmover for shippable
Add checksums-signing to shippable
Switch partner repacks to shippable
Add shippable to beetmover-repackage
Add secondary update verify configs for shippable
secondary update verify for shippable

Differential Revision: https://phabricator.services.mozilla.com/D24699

--HG--
extra : moz-landing-system : lando
2019-03-26 01:37:06 +00:00
Justin Wood ad86445b8c Bug 1352113 - Shippable Builds - make only-for-attributes accept any() instead of all() in the set. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D23130

--HG--
extra : moz-landing-system : lando
2019-03-26 01:37:04 +00:00
Justin Wood ba456c3323 Bug 1524394 - Disable Balrog Submission for Fennec on all channels. r=tomprince
This is Per https://github.com/mozilla-releng/releng-rfcs/pull/13

Differential Revision: https://phabricator.services.mozilla.com/D18279

--HG--
extra : moz-landing-system : lando
2019-02-01 00:23:31 +00:00
Justin Wood fdba6b25d0 Bug 1518570 - Update task cluster configuration for oak. r=tomprince
The intent is to land this on central, to minimize the merge conflicts on oak

Oak is going to be used for Updater testing so needs release keys and such, and does not need android.
This approach is different than the previous oak approach in that it amends how we calculate 'trunk' and 'release'
projects to include 'oak', and then makes full nightlies produced on each push.

Differential Revision: https://phabricator.services.mozilla.com/D17440

--HG--
extra : moz-landing-system : lando
2019-01-24 23:24:58 +00:00
Tom Prince 4f07d7aa2e Bug 1482395: [mozrelease] Generate whats new blob and populate it during release; r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D12708

--HG--
extra : moz-landing-system : lando
2018-11-26 17:51:23 +00:00
Nick Thomas 7f4f680548 Bug 1459116 - Disable job failed/exception notifications, r=rail
MozReview-Commit-ID: 39kxGWO6oyV

--HG--
extra : rebase_source : 73e4a62670965867c4856a8fdd935b9e91bbf4b6
2018-05-04 17:24:49 +12:00
Tom Prince b99da59110 Bug 1421062: Allow configuring the balrogworker to use per-project; r=aki
This allows non-trunk branches to use a staging balrog worker, and thunderbird
to use its own balrog scriptworker.

Differential Revision: https://phabricator.services.mozilla.com/D850

--HG--
extra : rebase_source : 8aedc197298d54f4f1a2a1ba168d7fbefc44ce1d
2018-04-04 13:47:22 -06:00
Aki Sasaki af3a7de077 bug 1438735 - balrog scriptworker push and schedule support. r=bhearsum
- add balrog submit-toplevel - this replaces the final portion of the updates builder.
- rename balrog transform to balrog_submit, because it's for balrog locale submission
  - make this default to the 'promote' phase. balrog and beetmover currently take the current
    phase, which isn't always the wanted behavior.
- rename balrog publish to balrog schedule
- add balrog secondary push and secondary scheduling, for RCs
- remove the release_updates transforms
- make the task.py balrog transforms smarter
- get rid of the release_balrog_publishing transforms; ad a generic worker_type transform
- add BALROG_ACTIONS to scriptworker.py
- add get_balrog_action_scope()
- remove the unused balrog channel scopes

MozReview-Commit-ID: 369ACiOAd5F

--HG--
rename : taskcluster/taskgraph/transforms/balrog.py => taskcluster/taskgraph/transforms/balrog_submit.py
extra : rebase_source : 9311522460ae6790af14a6b8b9600019702f8cbd
2018-02-15 18:14:26 -08:00
Nick Thomas 8fe6732ec1 Bug 1425571 - remove deprecated pulse-notify config for jobs that moved to tc-notify, r=aki
MozReview-Commit-ID: 2SPnApHlY2d

--HG--
extra : rebase_source : cf3e43009363827e36458b5e39476ff4f6df3311
2018-02-14 13:13:56 +13:00
Nick Thomas 193b9b5fb1 Bug 1425571 - switch to taskcluster-notify for all but the notify tasks, r=aki
MozReview-Commit-ID: EDmlXF7SIdv

--HG--
extra : rebase_source : 95855171d39b08222a10ddf4c8b00235364ff2d5
2018-02-14 12:57:50 +13:00
Aki Sasaki b8579cac05 bug 1423081 - add release balrog support. r=callek
MozReview-Commit-ID: 4P0E9hf3rIs

--HG--
extra : rebase_source : c2e5d6284bccffd12ac0c01022be2a3e4777ea2a
extra : histedit_source : 74de6fa3beb97a1e91335d2788231ff0346391c8
2017-12-05 19:17:43 -08:00
Steve Armand f9ec1d54e7 Bug 1414824 - Enable stricter linting in taskcluster yaml files. r=Callek
MozReview-Commit-ID: AX1cDUkwrBh

--HG--
extra : rebase_source : 4e3d0f5e4b7d1b4d2196c431ae03bc2e9b95387b
2017-11-11 00:36:41 -05:00
Wes Kocher e0340aa82f Backed out 2 changesets (bug 1342392) for bustage a=backout
Backed out changeset b0e86286b173 (bug 1342392)
Backed out changeset 01bf0c29331e (bug 1342392)

MozReview-Commit-ID: 71fcOZ2RgEp

--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 17:35:09 -07:00
Simon Fraser e47fe41362 Bug 1342392 Move partial update generation in-tree r=dustin,jlorenzo
--HG--
rename : taskcluster/docker/funsize-update-generator/Dockerfile => taskcluster/docker/partial-update-generator/Dockerfile
rename : taskcluster/docker/funsize-update-generator/Makefile => taskcluster/docker/partial-update-generator/Makefile
rename : taskcluster/docker/funsize-update-generator/README => taskcluster/docker/partial-update-generator/README
rename : taskcluster/docker/funsize-update-generator/dep.pubkey => taskcluster/docker/partial-update-generator/dep.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey => taskcluster/docker/partial-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey => taskcluster/docker/partial-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha1.pubkey => taskcluster/docker/partial-update-generator/release_sha1.pubkey
rename : taskcluster/docker/funsize-update-generator/release_sha384.pubkey => taskcluster/docker/partial-update-generator/release_sha384.pubkey
rename : taskcluster/docker/funsize-update-generator/requirements.txt => taskcluster/docker/partial-update-generator/requirements.txt
rename : taskcluster/docker/funsize-update-generator/runme.sh => taskcluster/docker/partial-update-generator/runme.sh
rename : taskcluster/docker/funsize-update-generator/scripts/funsize.py => taskcluster/docker/partial-update-generator/scripts/funsize.py
rename : taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 09:55:52 +01:00
Sebastian Hengst 21826b4be4 Backed out 2 changesets (bug 1342392) for adding .orig file and flake lint failures. r=backout on a CLOSED TREE
Backed out changeset bf0bcdc7482e (bug 1342392)
Backed out changeset 7f5ae5ff1181 (bug 1342392)

--HG--
rename : taskcluster/docker/partial-update-generator/Dockerfile => taskcluster/docker/funsize-update-generator/Dockerfile
rename : taskcluster/docker/partial-update-generator/Makefile => taskcluster/docker/funsize-update-generator/Makefile
rename : taskcluster/docker/partial-update-generator/README => taskcluster/docker/funsize-update-generator/README
rename : taskcluster/docker/partial-update-generator/dep.pubkey => taskcluster/docker/funsize-update-generator/dep.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha1.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/nightly_sha384.pubkey => taskcluster/docker/funsize-update-generator/nightly_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha1.pubkey => taskcluster/docker/funsize-update-generator/release_sha1.pubkey
rename : taskcluster/docker/partial-update-generator/release_sha384.pubkey => taskcluster/docker/funsize-update-generator/release_sha384.pubkey
rename : taskcluster/docker/partial-update-generator/requirements.txt => taskcluster/docker/funsize-update-generator/requirements.txt
rename : taskcluster/docker/partial-update-generator/runme.sh => taskcluster/docker/funsize-update-generator/runme.sh
rename : taskcluster/docker/partial-update-generator/scripts/funsize.py => taskcluster/docker/funsize-update-generator/scripts/funsize.py
rename : taskcluster/docker/partial-update-generator/scripts/mbsdiff_hook.sh => taskcluster/docker/funsize-update-generator/scripts/mbsdiff_hook.sh
2017-09-11 10:38:08 +02:00
Simon Fraser 71165165c4 Bug 1342392 Move partial update generation in-tree r=dustin,jlorenzo 2017-09-11 09:24:10 +01:00
Justin Wood ac3db7996c Bug 1386332 - Fix up label and description in nightly task graph entries. r=dustin
MozReview-Commit-ID: GjZ8qeAlQLY

--HG--
extra : rebase_source : b224278093b76d72e18d8760095c1ed354d4b290
2017-07-28 16:02:18 -04:00
Justin Wood 48b26bd31b Bug 1376550 - remove beetmover-repackage-l10n kind. r=dustin
Support OSX Signed nightlies (in the complete.mar too)

MozReview-Commit-ID: HkGRRm7k2Ra

--HG--
extra : rebase_source : a8fc5c76bdc623e4217840b7b75c39d0aa0b9051
2017-06-27 16:04:33 -07:00
Justin Wood 500657dba5 Bug 1373326 - Add beetmover and balrog to taskgraph. r=dustin
(For Landing more OSX Nightly Support from date to central)

MozReview-Commit-ID: BeXoChssNjF

--HG--
extra : rebase_source : 1f086e96411a7683b77cfecb6079b54ab9b0f643
2017-06-16 16:01:38 -04:00
Wes Kocher 60f7375fef Backed out 5 changesets (bug 1373326) for breaking the decision task a=backout
Backed out changeset 7f0177a71077 (bug 1373326)
Backed out changeset a678d4b0ee78 (bug 1373326)
Backed out changeset 2fdc6c2ad384 (bug 1373326)
Backed out changeset 97b785a31a3c (bug 1373326)
Backed out changeset a5fcfe57e6d4 (bug 1373326)

MozReview-Commit-ID: 9kcJzI1hFja
2017-06-20 17:43:37 -07:00
Justin Wood 964a509d0e Bug 1373326 - Add beetmover and balrog to taskgraph. r=dustin
(For Landing more OSX Nightly Support from date to central)

MozReview-Commit-ID: BeXoChssNjF

--HG--
extra : rebase_source : 1f086e96411a7683b77cfecb6079b54ab9b0f643
2017-06-16 16:01:38 -04:00
Dustin J. Mitchell 3c508e3d49 Bug 1340564: use an attribute to identify signed tasks; r=Callek
This is a more robust approach than using substring matching on task labels.

As an optimization, this simply avoids creating balrog tasks for unsigned beets
using only-for-attributes, rather than omitting them in a transform.

MozReview-Commit-ID: 8MNOxu0WgXo

--HG--
extra : source : 1aeb99ce3e6c2576b7b9b71c1cdf97a1d1889a49
2017-02-05 14:08:10 -05:00
Carsten "Tomcat" Book e2e90c1b4e Backed out changeset 1aeb99ce3e6c (bug 1340564) for hoping that fix the packageName issue
--HG--
extra : rebase_source : e3bb10d7ab090692114ccf3b20c5e6263fe14957
2017-05-12 15:59:56 +02:00
Dustin J. Mitchell a52ef5b1e8 Bug 1340564: use an attribute to identify signed tasks; r=Callek
This is a more robust approach than using substring matching on task labels.

As an optimization, this simply avoids creating balrog tasks for unsigned beets
using only-for-attributes, rather than omitting them in a transform.

MozReview-Commit-ID: 8MNOxu0WgXo

--HG--
extra : rebase_source : 9e93a996241bcb0d345c18813919a41320e95651
2017-02-05 14:08:10 -05:00
Justin Wood e79bb0b9f0 Bug 1357867 - Add balrog and beetmover support to cross compiled OSX, allow dependencies on repackage jobs. r=dustin
MozReview-Commit-ID: Frc0sMaC1o0

--HG--
extra : rebase_source : 2fd438259806204e42565502a807f7064d6fff0a
2017-04-19 15:49:55 -04:00
Justin Wood b8a15853be Bug 1355969 - Implement single_dep loader to replace many other loaders. r=dustin
MozReview-Commit-ID: Gk06jy1LYZI

--HG--
extra : rebase_source : f8a08c9e41bf64adb906b079374e05819e952b43
2017-04-12 13:37:37 -04:00
Dustin J. Mitchell 449d528cf3 Bug 1333255: rename taskgraph.task to taskgraph.loader; r=jonasfj
MozReview-Commit-ID: 6aPdGbxn0D1

--HG--
rename : taskcluster/taskgraph/task/__init__.py => taskcluster/taskgraph/loader/__init__.py
rename : taskcluster/taskgraph/task/balrog.py => taskcluster/taskgraph/loader/balrog.py
rename : taskcluster/taskgraph/task/beetmover.py => taskcluster/taskgraph/loader/beetmover.py
rename : taskcluster/taskgraph/task/beetmover_checksums.py => taskcluster/taskgraph/loader/beetmover_checksums.py
rename : taskcluster/taskgraph/task/checksums_signing.py => taskcluster/taskgraph/loader/checksums_signing.py
rename : taskcluster/taskgraph/task/post_build.py => taskcluster/taskgraph/loader/post_build.py
rename : taskcluster/taskgraph/task/repacks.py => taskcluster/taskgraph/loader/repacks.py
rename : taskcluster/taskgraph/task/signing.py => taskcluster/taskgraph/loader/signing.py
rename : taskcluster/taskgraph/task/test.py => taskcluster/taskgraph/loader/test.py
rename : taskcluster/taskgraph/task/transform.py => taskcluster/taskgraph/loader/transform.py
rename : taskcluster/taskgraph/task/base.py => taskcluster/taskgraph/task.py
extra : rebase_source : 42a183bae9aedfa04876d99a59119fd08bbf7d73
2017-03-09 19:00:49 -05:00
Dustin J. Mitchell 7e3408a70e Bug 1333255: always transform tasks; r=jonasfj
MozReview-Commit-ID: 3A5wzXKG0Yp

--HG--
extra : rebase_source : 10063aa354d18b08db182b41e9ae61f2f884becd
2017-03-09 16:40:33 -05:00
Dustin J. Mitchell b0117f4f53 Bug 1333255: use normal old functions to load tasks; r=jonasfj
Instead of using a class's static method, use a simple function, specified by
the `loader` key.

MozReview-Commit-ID: IeOl9qiSCXf

--HG--
extra : rebase_source : 72e0a9dd8385b250a46c9f4adf8a8a0e5b01c156
2017-03-09 23:14:40 -05:00
Justin Wood 18aa1bdfa6 Bug 1330668 - Schedule balrog submission tasks. r=dustin a=me
MozReview-Commit-ID: ASBDESDps8G
2017-01-12 21:01:54 -05:00