Граф коммитов

20 Коммитов

Автор SHA1 Сообщение Дата
David Keeler f42b207622 Bug 1479918 - Batch requests in getHSTSPreloadList.js to avoid livelock. r=sfraser
Prior to this patch, getHSTSPreloadList.js would queue an XHR for every preload
list candidate site. This meant that there would be ~50,000 requests in flight
simultaneously. Simply processing these requests caused them to all time out,
and no useful work was done. This patch resolves them in batches of 250 to
avoid this issue.

Differential Revision: https://phabricator.services.mozilla.com/D3622

--HG--
extra : source : e0f0d5824dd8aaaaf1395e569cec1806b028b12e
extra : amend_source : 62f1cd6fc49cbae39c7691c5712906f775862887
2018-08-29 12:04:16 +00:00
Andreea Pavel d478281b2b Backed out changeset e0f0d5824dd8 (bug 1479918) for eslint failure on a CLOSED TREE 2018-08-29 16:12:24 +03:00
David Keeler 334fcdbe81 bug 1479918 - batch requests in getHSTSPreloadList.js to avoid livelock r=sfraser
Prior to this patch, getHSTSPreloadList.js would queue an XHR for every preload
list candidate site. This meant that there would be ~50,000 requests in flight
simultaneously. Simply processing these requests caused them to all time out,
and no useful work was done. This patch resolves them in batches of 250 to
avoid this issue.

Differential Revision: https://phabricator.services.mozilla.com/D3622

--HG--
extra : moz-landing-system : lando
2018-08-29 12:04:16 +00:00
Simon Fraser 3539c7c2ef Bug 1466552 Automated file updates for beta/release r=RyanVM
Enable blocklist.xml (and remote-settings, per bug 1451040) for release, and all updates for beta.

Differential Revision: https://phabricator.services.mozilla.com/D1529
2018-06-04 15:30:57 +00:00
Simon Fraser b34aecb22e Bug 1436369 Run blocklist updates on mozilla-beta r=jlorenzo
Summary:
the blocklist and remote-settings changes need to happen on beta,
but not the hsts/hpkp updates, so we have to split out the control of what
runs by project.

Reviewers: jlorenzo

Reviewed By: jlorenzo

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D1487

--HG--
extra : rebase_source : 19ccbb67b880ee7bd2dc2a37325dd70de635abad
2018-06-01 14:13:44 +01:00
Mathieu Leplatre a43f7613d3 Bug 1451040 - Download remote settings dumps regularly r=sfraser
MozReview-Commit-ID: BCCEplOq1O8

--HG--
extra : rebase_source : 4a9840b7a36b1d08e3fa012fcad755516e292ec2
2018-05-16 13:03:22 +02:00
Mihai Tabara 0de0e21e8d Bug 1453993 - Update repo update owners for releaseduty change. r=sfraser
--HG--
extra : amend_source : 3566bdc350387d676e24e5955f146d27e2573868
2018-05-14 13:38:56 +01:00
Simon Fraser 426a0e402a Bug 1458855 Change periodic file update reviewers r=asasaki
Summary: Now with correct phabricator usernames

Reviewers: aki

Reviewed By: aki

Bug #: 1458855

Differential Revision: https://phabricator.services.mozilla.com/D1133

--HG--
extra : rebase_source : fd8aa5de1c1aaedacbbad53fa692e6c3132a0a94
2018-05-08 08:07:30 +01:00
Simon Fraser 5e74c3f641 Bug 1444333 Fix missing task requirement for periodic file updates r=callek
Reviewers: Callek

Reviewed By: Callek

Bug #: 1444333

Differential Revision: https://phabricator.services.mozilla.com/D699
2018-03-09 15:00:02 +00:00
Simon Fraser 1003fa56fd Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : amend_source : fb6f5356c2ad1b6a4b1ac39460109bd91cbb2f7d
2018-03-06 15:27:58 +00:00
Andreea Pavel ecb8a6e568 Backed out changeset 514feaa0c698 (bug 1436369) for taskcluster-images bustage on a CLOSED TREE
--HG--
rename : taskcluster/docker/periodic-updates/.eslintrc.js => taskcluster/docker/periodic_updates/.eslintrc.js
rename : taskcluster/docker/periodic-updates/Dockerfile => taskcluster/docker/periodic_updates/Dockerfile
rename : taskcluster/docker/periodic-updates/README.md => taskcluster/docker/periodic_updates/README.md
rename : taskcluster/docker/periodic-updates/runme.sh => taskcluster/docker/periodic_updates/runme.sh
rename : taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh
2018-03-07 14:22:54 +02:00
Simon Fraser f5ed24fa70 Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : amend_source : fd74227ccb8cd0a89b623e042cf3aea84d753702
2018-03-06 15:27:58 +00:00
Bogdan Tara d89cfbc667 Backed out changeset 6ba388ca08da (bug 1436369) for taskcluster-images bustage and linting failure at taskcluster/ci/repo-update/kind.yml:49:1 on a CLOSED TREE
--HG--
rename : taskcluster/docker/periodic-updates/.eslintrc.js => taskcluster/docker/periodic_updates/.eslintrc.js
rename : taskcluster/docker/periodic-updates/Dockerfile => taskcluster/docker/periodic_updates/Dockerfile
rename : taskcluster/docker/periodic-updates/README.md => taskcluster/docker/periodic_updates/README.md
rename : taskcluster/docker/periodic-updates/runme.sh => taskcluster/docker/periodic_updates/runme.sh
rename : taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh
2018-03-07 13:21:46 +02:00
Simon Fraser c83da63a75 Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : histedit_source : 08bfe7e842d5e516ba6453f458796fd8d2aa3ae0%2C25d60af8fa6da24131eb23756259399abb1de41d
2018-03-06 15:27:58 +00:00
Csoregi Natalia 3758b8fe3e Backed out 3 changesets (bug 1436469) for Gecko Decision task failure. CLOSED TREE
Backed out changeset a03dea399278 (bug 1436469)
Backed out changeset 370c9dbdd572 (bug 1436369)
Backed out changeset b3b9609544ec (bug 1436369)

--HG--
rename : taskcluster/ci/repo-update-bb/kind.yml => taskcluster/ci/repo-update/kind.yml
2018-03-06 17:36:19 +02:00
Simon Fraser 8dd0c7d4aa Bug 1436469 Fix task definition r=callek CLOSED TREE
--HG--
extra : amend_source : 16927e88ffeca3b658cc287b71bb7d22e36ea380
2018-03-06 15:20:50 +00:00
Simon Fraser a1890ef267 Bug 1436369 Add taskcluster periodic file updates r=callek
Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683

--HG--
extra : rebase_source : f7f6d69c092903118b6a41aa8b69fe0419910253
2018-03-06 15:10:46 +00:00
Simon Fraser c9bb5232b8 Bug 1436369 Move buildbot periodic file updates to clearer name r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
extra : rebase_source : c1386a05c378589efdd508199d97cb8121308686
2018-03-06 15:09:48 +00:00
Steve Armand f9ec1d54e7 Bug 1414824 - Enable stricter linting in taskcluster yaml files. r=Callek
MozReview-Commit-ID: AX1cDUkwrBh

--HG--
extra : rebase_source : 4e3d0f5e4b7d1b4d2196c431ae03bc2e9b95387b
2017-11-11 00:36:41 -05:00
Justin Wood 66724b3aca Bug 1402457 - Add periodic file update task, but don't run it yet. r=dustin
MozReview-Commit-ID: GD7qRLxwDn5

--HG--
extra : rebase_source : 7a4874f7229a69630cdd3e44815de682678cb1f2
2017-09-22 14:25:28 -04:00