fd93e8b19d
Remove Mercurial repository cache from the task to find commits to ignore for finding regressors
...
Fixes a regression from 3ced9da923
2020-04-30 12:06:45 +02:00
b75648f6be
Bump taskcluster from 29.1.3 to 29.2.0 ( #1522 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 29.1.3 to 29.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v29.1.3...v29.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-30 00:37:22 +02:00
3ced9da923
Make script to find commits to ignore for finding regressors use the commits DB instead of re-analyzing commits using Mercurial
...
We can now do this thanks to f659c7c9d7
2020-04-29 14:12:03 +02:00
6cd41f92a6
Remove extraneous / from the adr s3 cache configuration
2020-04-28 03:06:18 +02:00
334133009d
Bump taskcluster from 29.0.1 to 29.1.3 ( #1513 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 29.0.1 to 29.1.3.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v29.0.1...v29.1.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-28 01:18:52 +02:00
0c323faadc
Use 'batch' worker type for the test scheduling history retriever task
...
Since the cache items are now stored in S3, we no longer need to download
and extract a huge .tar.zst file, thus we can use a worker with fewer
resources.
2020-04-27 16:48:53 +02:00
19e014b767
Use the S3 adr cache backend
...
Fixes #1492
2020-04-27 16:45:31 +02:00
94ca930645
Set fetch.prune for git-cinnabar to be happier
2020-04-27 00:11:09 +02:00
855bd21979
Install libcurl, as it's a requirement for the git-cinnabar helper
2020-04-26 20:13:32 +02:00
dc049c298b
Set git-cinnabar configuration globally
2020-04-22 02:29:20 +02:00
4e69d72dec
Don't install gcc and g++ in the Docker commit retrieval image, they are no longer needed
...
They used to be needed to build Mercurial.
2020-04-21 17:15:23 +02:00
9703112f17
Move mercurial to be a normal requirement, rather than installing it 'manually' in the Docker image
2020-04-21 17:07:01 +02:00
874e77fe2e
Update version-control-tools to a newer revision
2020-04-21 17:07:01 +02:00
233e1678bf
Use git-cinnabar to clone the git repository mirror of mozilla-central
2020-04-21 16:48:32 +02:00
fda287a8aa
Install git-cinnabar in the commit-retrieval Docker image
2020-04-21 16:48:32 +02:00
90679941a7
Create tar files using the tar binary rather than tarfile as it's twice as fast
2020-04-19 01:41:11 +02:00
d5e671a8f5
Use the renewing-file adr cache store
...
This way whenever we access a cached value, we renew its expiration.
This is needed for #1420 and #1449
2020-04-15 00:27:07 +02:00
7b845c859c
Bump taskcluster from 28.2.2 to 29.0.1 ( #1485 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 28.2.2 to 29.0.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v28.2.2...v29.0.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-14 12:29:05 +02:00
9178cc4d12
Define the DBs and DB support files which are required for performing classification with a model as a property of the model
2020-04-10 20:13:31 +02:00
9a5f2410a9
Fix path to failing together probabilities DB
2020-04-09 14:45:03 +02:00
45be290ad3
Use jemalloc
2020-04-08 03:06:47 +02:00
65c1996d39
Bump taskcluster from 28.2.0 to 28.2.2 ( #1466 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 28.2.0 to 28.2.2.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v28.2.0...v28.2.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-07 12:33:00 +02:00
1e724484db
Generate a DB containing probabilities of jobs failing together
2020-04-07 02:57:21 +02:00
1f67276d04
Bump taskcluster from 28.1.0 to 28.2.0 ( #1454 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 28.1.0 to 28.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v28.1.0...v28.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-03 15:49:05 +02:00
6139574f17
Use scientific literature names for Halstead ( #1440 )
...
* Update rust-code-analysis to v0.0.11
* Use scientific literature names for Halstead
2020-03-31 12:47:52 +02:00
447129a95e
Set default retention of ADR cache to 4 weeks
2020-03-25 21:20:20 +01:00
6d20d6667d
Bump taskcluster from 28.0.0 to 28.1.0 ( #1436 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 28.0.0 to 28.1.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v28.0.0...v28.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-24 11:24:13 +01:00
0c4265ac28
Bump pyyaml from 5.3 to 5.3.1 ( #1423 )
...
Bumps [pyyaml](https://github.com/yaml/pyyaml ) from 5.3 to 5.3.1.
- [Release notes](https://github.com/yaml/pyyaml/releases )
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES )
- [Commits](https://github.com/yaml/pyyaml/compare/5.3...5.3.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-23 12:44:47 +01:00
3bb5ab4ca4
Update rust-code-analysis to v0.0.10
2020-03-19 13:36:36 +01:00
4dcadf90f9
Bump taskcluster from 27.2.0 to 28.0.0 ( #1417 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 27.2.0 to 28.0.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v27.2.0...v28.0.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-17 11:50:03 +01:00
3f9e38d4c1
Bump taskcluster from 26.0.1 to 27.2.0 ( #1403 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 26.0.1 to 27.2.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v26.0.1...v27.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-12 12:15:20 +01:00
e73cd054aa
Bump json-e from 4.0.0 to 4.0.1 ( #1399 )
...
Bumps [json-e](https://taskcluster.github.io/json-e/ ) from 4.0.0 to 4.0.1.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-12 12:14:38 +01:00
7ba1ab7cc4
Use 'tip' branch to support autoland but keep skipping relbranch commits ( #1395 )
...
For example, 961f253985a4388008700a6a6fde80f4e17c0b4b wouldn't be skipped if
we simply removed the branch parameter.
This way, we can also stop using the firefoxtree extension.
2020-03-11 11:55:10 +01:00
92319bd53f
Bump taskcluster from 25.4.0 to 26.0.1 ( #1393 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 25.4.0 to 26.0.1.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v25.4.0...v26.0.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-10 11:25:20 +01:00
3090803bc3
Bump json-e from 3.0.0 to 4.0.0 ( #1380 )
...
Bumps [json-e](https://taskcluster.github.io/json-e/ ) from 3.0.0 to 4.0.0.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-06 17:49:20 +01:00
ded66f9e3c
Calculate number of times source files and directories in a commit were touched together with manifests
...
Part of #1281 .
2020-03-05 22:31:41 +01:00
42046cd0a0
Use shelve with LMDB instead of Pickle to store commit experiences
...
Fixes #1034
2020-03-04 15:42:02 +01:00
2482bcfc9e
Update to taskboot 0.2.2
2020-03-04 11:54:12 +01:00
befdbd730a
Use a bigger worker type for the HTTP service deployment task as it sometimes runs out of memory
2020-03-04 11:54:12 +01:00
9f7eaa0d6d
Bump python from 3.8.1-slim to 3.8.2-slim in /infra ( #1355 )
...
Bumps python from 3.8.1-slim to 3.8.2-slim.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-03 10:38:11 +01:00
c920f09297
Setup mercurial configuration system-wide ( #1346 )
...
Fixes #1341
2020-03-02 14:23:54 +01:00
a4bf12e333
The HTTP service deployment task no longer needs to depend on the task to generate test scheduling history
...
See also #1330
2020-03-01 20:13:17 +01:00
a286a0df8e
Download test selection models in the HTTP service
...
Making sure the HTTP service is built after the test selection models are trained.
Fixes #1330
2020-03-01 20:12:05 +01:00
7812d5cc97
Temporarily disable tokenized bug-introducing commits finder task
...
As it is running too slowly (probably due to git's --ignore-revs-file option)
2020-02-29 11:33:19 +01:00
16488ecda3
Test scheduling history generator tasks depend on the commit retrieval task
2020-02-29 11:25:09 +01:00
cfd82a8ad3
Clone mozilla-central and load the test scheduling and commits DBs when the HTTP service's workers start
...
Fixes #1299
2020-02-28 12:10:57 +01:00
7faca6e443
Fix paths of the push_data_* files on the worker
2020-02-28 10:50:12 +01:00
2c61d99479
Task for retrieval of test scheduling history doesn't need to wait on the commit retrieval task
2020-02-27 19:12:40 +01:00
259e7d0d98
Bump taskcluster from 25.3.0 to 25.4.0 ( #1325 )
...
Bumps [taskcluster](https://github.com/taskcluster/taskcluster ) from 25.3.0 to 25.4.0.
- [Release notes](https://github.com/taskcluster/taskcluster/releases )
- [Changelog](https://github.com/taskcluster/taskcluster/blob/master/CHANGELOG.md )
- [Commits](https://github.com/taskcluster/taskcluster/compare/v25.3.0...v25.4.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-02-27 17:33:38 +01:00
b454a39d71
Use a bigger instance for the task pushing the Docker image for the HTTP service (as it currently often runs out of memory)
2020-02-26 10:45:13 +01:00
Marco Castelluccio
dependabot-preview[bot]
Luni-4
Bastien Abadie
Bastien Abadie