gecko-dev/taskcluster/ci
Gabriele Svelto 4b85e11596 Bug 1675263 - Refactor the scripts used to scrape Microsoft and Apple system symbols r=marco DONTBUILD
This patch changes a few different things:
- The Docker image used for both scrapers are now based off of our standard
  Debian 10 image instead of an old Ubuntu one
- Both images were changed to make it easy to work with them when an
  interactive task is used
- The python packages used by the scripts had their versions pinned and
  cryptographic hashes have been recorded so that they can be verified before
  running the task
- The dump_syms version used on Windows was bumped to include fixes that allow
  us to scrape public symbols from DLLs and EXEs that have no PDB file available
- The maximum open file limit of the Window scraper was bumped up to cope with
  runs where we gather plenty of symbols in one go
- Similarly the maximum number of symultaneous connections to a single symbol
  server has been limited to 4 to avoid being throttled
- The macOS Python tools were modified to work with Python 3

Differential Revision: https://phabricator.services.mozilla.com/D95853
2020-11-06 11:02:25 +00:00
..
addon Bug 1634204 - Upgrade Linux build docker images to Debian 8. r=froydnj 2020-05-06 14:16:03 +00:00
artifact-build Bug 1637542: Disable {linux64,win32,win64} opt and linux64 artifact builds on autoland. r=jmaher 2020-05-27 17:53:38 +00:00
balrog Bug 1617484 - Rename android-*-nightly to android-*-shippable. Don't actually promote yet. r=jlorenzo 2020-05-18 14:37:25 +00:00
beetmover-checksums Bug 1586748 - Re-enable build-signing for N and Ngv tasks and clean up unused fennec manifests/kinds r=mtabara 2019-10-10 17:53:54 +00:00
beetmover-geckoview Bug 1623082 - Add shippable attributes where there is nightly attributes in taskcluster/ci. r=aki 2020-05-18 14:38:19 +00:00
beetmover-repackage Bug 1617482 - Switch asan-reporter-nightly to shippable naming. Changes only nightly graph. r=aki 2020-05-18 14:35:28 +00:00
beetmover-snap
beetmover-source
bouncer-locations Bug 1623082 - Remove nightly attribute from jobs. r=aki 2020-05-18 14:38:41 +00:00
build Bug 1644574 - don't optimize out codeql-cpp. r=taskgraph-reviewers,bhearsum DONTBUILD 2020-10-21 20:06:33 +00:00
build-fat-aar Bug 1656465 - [taskgraph.optimize] Rename 'push-interval-{10,20}' strategies to 'expanded' and 'backstop' respectively, r=marco 2020-09-10 14:47:02 +00:00
build-notarization-part-1 Bug 1562412 - [3-task notarization] fix ./mach try release r=Callek 2020-02-26 21:51:11 +00:00
build-notarization-poller Bug 1562412 - [3-task notarization] fix ./mach try release r=Callek 2020-02-26 21:51:11 +00:00
build-signing Bug 1562412 - build-signing multi_dep. r=Callek 2020-02-25 03:31:29 +00:00
code-review Bug 1643504 - Upgrade code-review task to Debian buster. r=sylvestre,andi 2020-06-08 21:46:07 +00:00
condprof Bug 1669807 - Don't directly execute `virtualenv.py` in `condprof` scripts r=glandium 2020-10-08 15:18:20 +00:00
cron-bouncer-check Bug 1661673 - switch cron-bouncer to esr78. r=releng-reviewers,aki DONTBUILD 2020-09-04 20:54:05 +00:00
diffoscope Bug 1656465 - [taskgraph.optimize] Rename 'push-interval-{10,20}' strategies to 'expanded' and 'backstop' respectively, r=marco 2020-09-10 14:47:02 +00:00
docker-image Bug 1675263 - Refactor the scripts used to scrape Microsoft and Apple system symbols r=marco DONTBUILD 2020-11-06 11:02:25 +00:00
fetch Bug 1675263 - Refactor the scripts used to scrape Microsoft and Apple system symbols r=marco DONTBUILD 2020-11-06 11:02:25 +00:00
geckodriver-signing Bug 1577110: Switch geckodriver signing to use toolchain tasks r=tomprince 2020-05-08 18:03:50 +00:00
generate-profile Backed out changeset 2c30c54dea46 for not fixing bug 1671594 2020-10-17 13:35:04 +03:00
github-sync Bug 1638260 - Remove all the 'try' values in run-on-projects r=ahal 2020-05-15 15:01:19 +00:00
hazard Bug 1656465 - [taskgraph.optimize] Rename 'push-interval-{10,20}' strategies to 'expanded' and 'backstop' respectively, r=marco 2020-09-10 14:47:02 +00:00
instrumented-build Bug 1650208: run opt builds by default on autoland; shippable builds by default on central r=tomprince,ahal,marco 2020-07-27 16:25:40 +00:00
iris Bug 1616276 - Disable Iris test suite due to lack of resources, r=jmaher. 2020-02-22 16:04:50 +00:00
l10n Bug 1675086 - drop references to 'pgo' platforms for Linux and Windows. r=jmaher 2020-11-03 22:45:54 +00:00
l10n-bump Bug 1666321 - run l10n-bump as part of central-to-beta merge day. r=releng-reviewers,bhearsum DONTBUILD 2020-09-30 15:29:21 +00:00
mar-signing Bug 1617482 - Switch asan-reporter-nightly to shippable naming. Changes only nightly graph. r=aki 2020-05-18 14:35:28 +00:00
mar-signing-autograph-stage Bug 1623082 - Add shippable attributes where there is nightly attributes in taskcluster/ci. r=aki 2020-05-18 14:38:19 +00:00
mar-signing-l10n Bug 1617482 - Switch asan-reporter-nightly to shippable naming. Changes only nightly graph. r=aki 2020-05-18 14:35:28 +00:00
maybe-release Bug 1603106 - daily betas scheduled to be shipped instead of pushed. r=bhearsum 2019-12-11 17:08:23 +00:00
merge-automation Bug 1666321 - run l10n-bump as part of central-to-beta merge day. r=releng-reviewers,bhearsum DONTBUILD 2020-09-30 15:29:21 +00:00
openh264-plugin Bug 1620437: Remove android openh264 builds; r=Callek 2020-03-06 09:30:09 +00:00
openh264-signing
packages Bug 1648256 - Upgrade valgrind to latest release. r=firefox-build-system-reviewers,rstewart 2020-06-24 20:55:05 +00:00
partials Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
partials-signing
perftest Bug 1667151 - add support for pre-compiled scipy/numpy r=sparky 2020-11-05 17:16:34 +00:00
post-balrog-dummy Bug 1560134: Use built-in/succeed worker type for dummy jobs; r=dustin 2019-07-02 17:05:23 +00:00
post-beetmover-checksums-dummy Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo 2020-05-18 14:37:12 +00:00
post-beetmover-dummy Bug 1586748 - Re-enable build-signing for N and Ngv tasks and clean up unused fennec manifests/kinds r=mtabara 2019-10-10 17:53:54 +00:00
post-langpack-dummy Bug 1560134: Use built-in/succeed worker type for dummy jobs; r=dustin 2019-07-02 17:05:23 +00:00
python-dependency-update Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum 2020-03-05 13:49:24 +00:00
release-balrog-scheduling Bug 1661673 - remove esr68 references.r=releng-reviewers,aki DONTBUILD 2020-08-31 07:59:28 +00:00
release-balrog-submit-toplevel Bug 1634757 - Use v2 actions for balrog submittal. r=releng-reviewers,aki DONTBUILD 2020-09-16 02:36:04 +00:00
release-beetmover-push-to-release Bug 1653173: [release] Block push-to-release on update-verify being complete; r=RyanVM 2020-08-03 17:22:30 +00:00
release-beetmover-signed-langpacks Bug 1614999 - remove devedition-nightly references now that labels are renamed. r=aki 2020-02-21 19:52:58 +00:00
release-beetmover-signed-langpacks-checksums
release-beetmover-source-checksums
release-bouncer-aliases Bug 1661673 - make esr78 not next-esr.r=releng-reviewers,aki DONTBUILD 2020-09-04 20:35:04 +00:00
release-bouncer-check
release-bouncer-sub Bug 1661673 - remove esr68 references.r=releng-reviewers,aki DONTBUILD 2020-08-31 07:59:28 +00:00
release-early-tagging Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo 2020-05-18 14:37:12 +00:00
release-eme-free-repack Bug 1623082 - Remove nightly attribute from jobs. r=aki 2020-05-18 14:38:41 +00:00
release-eme-free-repack-beetmover Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-eme-free-repack-beetmover-checksums Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-eme-free-repack-notarization-part-1 Bug 1562412 - add release-{eme-free,partner-repack}-notarization-part-1 kind. r=nthomas 2020-02-25 03:37:37 +00:00
release-eme-free-repack-notarization-poller Bug 1562412 - [3-task notarization] - fix missing poller task r=Callek 2020-02-28 00:14:27 +00:00
release-eme-free-repack-repackage Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-eme-free-repack-repackage-signing Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-eme-free-repack-signing Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-final-verify
release-flatpak-push Bug 1623032 - upload flatpak in the "ship" phase, and push RCs to flathub beta. r=mtabara 2020-04-24 08:33:44 +00:00
release-flatpak-repackage Bug 1621053 - set proper branch when building Flatpaks. r=rail DONTBUILD 2020-03-10 20:29:52 +00:00
release-generate-checksums Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo 2020-05-18 14:37:12 +00:00
release-generate-checksums-beetmover
release-generate-checksums-signing
release-mark-as-shipped Bug 1644973 - remove Nazgul jobs as they become the new vanilla bouncer jobs. r=rail 2020-06-16 15:17:05 +00:00
release-notify-av-announce Bug 1532390 - Support av-vendor-announce. r=rail 2019-12-27 14:47:46 +00:00
release-notify-promote Bug 1644973 - remove Nazgul jobs as they become the new vanilla bouncer jobs. r=rail 2020-06-16 15:17:05 +00:00
release-notify-push Bug 1560134: Use built-in/succeed worker type for dummy jobs; r=dustin 2019-07-02 17:05:23 +00:00
release-notify-ship Bug 1644973 - remove Nazgul jobs as they become the new vanilla bouncer jobs. r=rail 2020-06-16 15:17:05 +00:00
release-notify-started Bug 1643504 - Upgrade release-notify-started tasks to Debian buster. r=Callek 2020-06-07 22:29:17 +00:00
release-partner-attribution Bug 1630809 - generate partner attribution task r=aki 2020-08-27 22:19:36 +00:00
release-partner-attribution-beetmover Bug 1630809 - generate beetmover tasks for partner attribution r=aki 2020-08-27 22:19:34 +00:00
release-partner-repack Bug 1614998 - Rename nightly-l10n-signing to shippable-l10n-signing. r=aki 2020-02-12 22:28:31 +00:00
release-partner-repack-beetmover Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-partner-repack-bouncer-sub Bug 1605275: [taskgraph] Use worker alias for bouncer workers; r=Callek 2020-01-23 16:54:55 +00:00
release-partner-repack-chunking-dummy Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-partner-repack-notarization-part-1 Bug 1562412 - add release-{eme-free,partner-repack}-notarization-part-1 kind. r=nthomas 2020-02-25 03:37:37 +00:00
release-partner-repack-notarization-poller Bug 1562412 - [3-task notarization] - fix missing poller task r=Callek 2020-02-28 00:14:27 +00:00
release-partner-repack-repackage Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-partner-repack-repackage-signing Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-partner-repack-signing Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-push-langpacks Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
release-secondary-balrog-scheduling Bug 1605275: [taskgraph] Use worker aliases for beetmover and balrog workers; r=Callek 2020-01-23 16:54:13 +00:00
release-secondary-balrog-submit-toplevel Bug 1605275: [taskgraph] Use worker aliases for beetmover and balrog workers; r=Callek 2020-01-23 16:54:13 +00:00
release-secondary-final-verify
release-secondary-flatpak-push Bug 1623032 - upload flatpak in the "ship" phase, and push RCs to flathub beta. r=mtabara 2020-04-24 08:33:44 +00:00
release-secondary-notify-ship Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo 2020-05-18 14:37:12 +00:00
release-secondary-snap-push Bug 1632584 - publish snaps as part of RC week. r=tomprince 2020-04-23 18:34:21 +00:00
release-secondary-update-verify
release-secondary-update-verify-config
release-snap-push Bug 1661673 - make esr78 not next-esr.r=releng-reviewers,aki DONTBUILD 2020-09-04 20:35:04 +00:00
release-snap-repackage Bug 1597928 - Snap repackage: Stop fetching scripts from the hg.mozilla.org archive endpoint r=jlund 2019-11-21 09:50:47 +00:00
release-source Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo 2020-05-18 14:37:12 +00:00
release-source-checksums-signing
release-source-signing
release-update-verify No bug: stop blocking release-update-verify on upload-symbols, because upload symbols is always included when builds are present from other work r=aki DONTBUILD 2020-09-11 19:13:17 +00:00
release-update-verify-config Bug 1661673 - make esr78 not next-esr.r=releng-reviewers,aki DONTBUILD 2020-09-04 20:35:04 +00:00
release-update-verify-config-next Bug 1661673 - remove esr68 references.r=releng-reviewers,aki DONTBUILD 2020-08-31 07:59:28 +00:00
release-update-verify-next Bug 1661673 - remove esr68 references.r=releng-reviewers,aki DONTBUILD 2020-08-31 07:59:28 +00:00
release-version-bump Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo 2020-05-18 14:37:12 +00:00
repackage Bug 1675086 - drop references to 'pgo' platforms for Linux and Windows. r=jmaher 2020-11-03 22:45:54 +00:00
repackage-l10n Bug 1646588 - Add esr78 support. r=aki 2020-06-18 19:57:20 +00:00
repackage-msi Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
repackage-signing Bug 1675086 - drop references to 'pgo' platforms for Linux and Windows. r=jmaher 2020-11-03 22:45:54 +00:00
repackage-signing-l10n Bug 1617482 - Switch asan-reporter-nightly to shippable naming. Changes only nightly graph. r=aki 2020-05-18 14:35:28 +00:00
repackage-signing-msi Bug 1617481 - Remove no-longer-used <platform>-nightly entries from kind.yml in more places. r=aki 2020-05-18 14:34:45 +00:00
repo-update Bug 1618188 - stop updating the mozilla-central copy of blocklist.xml, r=RyanVM 2020-03-09 11:58:32 +00:00
scriptworker-canary Bug 1649168: Add scriptworker-canary action and corresponding task; r=rail 2020-07-10 16:12:05 +00:00
searchfox Bug 1654845 - use new dump_syms for Mac builds; r=dmajor 2020-07-23 17:01:21 +00:00
shippable-l10n Bug 1653171: Run windows L10n repacks on linux; r=Callek 2020-08-04 18:47:55 +00:00
shippable-l10n-notarization-part-1 Bug 1562412 - add shippable-l10n-notarization-part-1 kind r=Callek 2020-02-25 03:32:28 +00:00
shippable-l10n-notarization-poller Bug 1562412 - [3-task notarization] - fix missing poller task r=Callek 2020-02-28 00:14:27 +00:00
shippable-l10n-signing Bug 1562412 - shippable-l10n-signing multi_dep. r=Callek 2020-02-25 03:34:24 +00:00
source-test Bug 1673419 - [devtools] Run performance node tests in the devtools-tests suite on CI r=nchevobbe 2020-10-30 17:20:04 +00:00
spidermonkey Bug 1673103 - Switch SM jobs to use newer dump_syms r=calixte 2020-10-28 16:39:05 +00:00
static-analysis-autotest Bug 1637544: Set `use-sccache` explicitly, rather than based on an sccache toolchain being provided; r=glandium 2020-07-07 16:39:31 +00:00
system-symbols Bug 1675263 - Refactor the scripts used to scrape Microsoft and Apple system symbols r=marco DONTBUILD 2020-11-06 11:02:25 +00:00
system-symbols-upload Bug 1658468: Only run system-symbols-upload tasks on cron; r=glandium 2020-08-11 01:50:41 +00:00
test Bug 1670284 - Run android perf tests with webrender-enabled. r=perftest-reviewers,Bebe 2020-11-05 14:28:58 +00:00
toolchain Bug 1673984 - Upgrade gcc from 9.1.0 to 9.3.0 r=firefox-build-system-reviewers,glandium 2020-11-04 00:08:10 +00:00
updatebot Bug 1618949 - Create a job that verifies reproducibility of updatebot jobs r=aki 2020-09-28 16:55:03 +00:00
upload-generated-sources Bug 1527313: [taskgraph] Use `artifact-reference` in upload-sources task; r=Callek 2020-02-11 19:46:44 +00:00
upload-symbols Bug 1654994 - Switch full symbols archive to tar.zst. r=firefox-build-system-reviewers,rstewart,tomprince 2020-07-31 20:27:54 +00:00
valgrind Bug 1656465 - [taskgraph.optimize] Rename 'push-interval-{10,20}' strategies to 'expanded' and 'backstop' respectively, r=marco 2020-09-10 14:47:02 +00:00
visual-metrics-dep Bug 1656465 - [taskgraph.optimize] Rename 'push-interval-{10,20}' strategies to 'expanded' and 'backstop' respectively, r=marco 2020-09-10 14:47:02 +00:00
webrender Bug 1673992 - [taskgraph] Ensure we stop extracting mozharness.zip in the cwd r=bhearsum 2020-10-30 13:32:01 +00:00
wgpu Bug 1634425 - Integrate WebGPU API tracing r=jgilbert 2020-05-27 16:49:03 +00:00
config.yml Bug 1670284 - Run android perf tests with webrender-enabled. r=perftest-reviewers,Bebe 2020-11-05 14:28:58 +00:00