Граф коммитов

10229 Коммитов

Автор SHA1 Сообщение Дата
Armen Zambrano G 40b7d98921 Permit listening to a subest of projects
For Heroku Review apps, we're trying to use a small database plan (with limited
number of collections allowed) and a small number of workers processing tasks
in order to reduce the cost of the app.

Using the PROJECTS_TO_INGEST variable we can define a small number of repos to
pay attention to and discard all other tasks.

You can remove PROJECTS_TO_INGEST to go back to using a normal ingestion behaviour.
2019-11-12 09:09:10 -05:00
Armen Zambrano G 757efc0bff Adjust logging of task processing
Tasks that do not have tc-treeherder in their routes are flodding the Papertrail logs.
Reducing the level to `debug()` is more appropriate for these kinds of discarded tasks.

We also do not need to log the routes for acceptable tasks.
2019-11-12 09:09:10 -05:00
Armen Zambrano G 8fa5790f09 Heroku Review apps to use random Pulse queue names
This allows all Review apps to use the same Pulse user, however,
they each have their own separate queues.
2019-11-12 09:09:10 -05:00
Armen Zambrano G 37c96d328d Allow using PULSE_URL to define push_sources and task_sources
Defining PULSE_TASK_SOURCES and PULSE_PUSH_SOURCES is a bit of a nightmare
because `app.json` is a Json file and using double and single quotes for a
value in the file is impossible.
2019-11-12 09:09:10 -05:00
Armen Zambrano G 79a6bba8d1 Enable MySql strict mode 2019-11-12 09:09:10 -05:00
Armen Zambrano G 725700a8a2 Do not run newrelic-admin in release phase if running in preview app 2019-11-12 09:09:10 -05:00
Armen Zambrano G f3c113995f Use Tiger plan for Cloudamqp 2019-11-12 09:09:10 -05:00
Armen Zambrano G 45b2f62487 Add JawsDB add-on 2019-11-12 09:09:10 -05:00
Armen Zambrano G 25bfda34f5 Add Papertrail add-on 2019-11-12 09:09:10 -05:00
Armen Zambrano G 5778ad71b1 Adjust workers for Heroku Review Apps
Some workers are set to 0 dynos so we only focus on ingesting pushes and tasks. Nevertheless,
the number of workers can be adjusted after the review app is created. The current settings
are to get us the minimum amount of functionality for the app and the minimum throughput
for the queues not to backlog.
2019-11-12 09:09:10 -05:00
Armen Zambrano G 1af3f69554 If SITE_URL is not available try using HEROKU_APP_NAME 2019-11-12 09:09:10 -05:00
Armen Zambrano G 7da739673e Set first set of env variables 2019-11-12 09:09:10 -05:00
Renovate Bot 65cbf85dc8 Update dependency victory to v33.1.3 2019-11-11 18:59:12 -05:00
Armen Zambrano G 3bf343fc9b Fix Node version for Selenium tests 2019-11-11 18:57:28 -05:00
ionutgoldan aef15ddf90
Bug 1593194 - Mirror CI schema validation support for application field 2019-11-11 10:48:59 +02:00
ionutgoldan ecb34da75b
Bug 1584946 - Mirror CI schema validation support for unit field 2019-11-11 09:34:26 +02:00
ionutgoldan 2ddfdbaff1 Bug 1593190 - Provide ORM support for application name (#5584) 2019-11-09 14:37:26 -08:00
Sharon Mun 65fdf9acfc Bug 1447537: Adjust document title when viewing particular intermittent (#5474) 2019-11-09 14:36:21 -08:00
Sarah Clements fd19ee836d
Bug 1566190 - Implement Taskcluster login change (#5543)
* remove taskcluster credentials from WebAuth audience and scope
* create set up separate tc auth callback component and route
2019-11-09 11:25:27 -08:00
Alexandra Lobovikova d93ee3c1dc bug-1554287 - remove zooming effect and add scroll to selected job (#5508) 2019-11-08 13:15:46 -08:00
Sarah Clements 23bba817fa
Tc migration prep part2 (#5615)
rootUrl changes to repository fixture, add new rooturls to connect-src,
remove header in make_request, update docs, and update backend urls
2019-11-08 12:57:00 -08:00
Sebastian Hengst b25eee2090 Bug 1594247 - Do not automatically set the severity of crashes to `critical` (#5607) 2019-11-08 10:50:49 -08:00
Armen Zambrano G 4e108855b6 Bug 1593869 - Land UI code in preparation for Taskcluster migration
I do not know why I suggested landing the complete PR #5604.
I wanted the UI code to be landed in advance so we can notice any edges cases
on the day before the downtime. This change only includes the UI changes from
the original PR.
2019-11-08 12:21:38 -05:00
Renovate Bot ce0295b1e1 Update dependency react-hot-loader to v4.12.16 2019-11-08 11:53:20 -05:00
Armen Zambrano G 62f953625f Revert "Bug 1593869 - prep for Taskcluster migration (#5604)"
This reverts commit 2ccfe7f6da.
2019-11-08 10:51:00 -05:00
Octavian Negru 0861884287 Bug 1595018 - Temporarily allow maxLength of 100 for extra options 2019-11-08 08:49:45 -05:00
Sarah Clements 2ccfe7f6da
Bug 1593869 - prep for Taskcluster migration (#5604)
- update repositories fixture with new tc_root_urls for firefox-ci and community-ci

- update getRunnableJobsUrl and RunnableJobModel to access currentRepo and tc_root_url;
refactor getInspectTaskUrl and JobInfo component to have currentRepo prop

- add new rooturls to connect-src, update rooturl for seta, update docs and
remove header in make_request,
2019-11-07 13:58:47 -08:00
Simon Sapin e6f6876dd1 Servo: set tc_root_url to community-tc instead of taskcluster.net
This is part of https://bugzilla.mozilla.org/show_bug.cgi?id=1574648
2019-11-07 15:45:21 -05:00
Armen Zambrano G fdc336ce26 Bug 1593781 - Do not avoid ingesting pushes/tasks based on tc_root_url 2019-11-07 13:56:42 -05:00
Renovate Bot 1230ec2335 Update dependency react-redux to v7.1.3 2019-11-07 08:41:17 -05:00
Renovate Bot 460f5ff4af Update dependency fetch-mock to v7.7.3 2019-11-07 08:40:36 -05:00
octavian-negru 979573904e Bug 1585966 - Centered header titles from Compare views should be editable 2019-11-06 17:28:38 +02:00
Dave Hunt b2c6b5c76a Remove dhunt from cc list in bugzilla templates 2019-11-06 10:42:54 +02:00
Armen Zambrano 6217b642f7
Merge pull request #5597 from mozilla/improve_ingest_tasks
Improve command to ingest data
2019-11-05 16:17:43 -05:00
Armen Zambrano G f80a47cefe Support ingesting a Github PR + refactor
Now you need to specify the type of ingestion you want (hg-push or task)
and makes it simpler to separate which options are used for what.

To ingest an Hg push you can do this:

```bash
./manage.py ingest_push_and_tasks hg-push --project autoland --commit 1f17d60de61efeebaf9e4d04ce2abc4290179d00
```

To ingest a task you can do this:

```bash
./manage.py ingest_push_and_tasks task --task-id QGZSGHnaSRWRFk6TZlNMHQ
```

To ingest a Github PR you can do this:
```
./manage.py ingest_push_and_tasks pr --pr-url https://github.com/servo/servo/pull/24662
```
2019-11-05 15:58:24 -05:00
Armen Zambrano G b03df93d6d Fix: Add TC root url for management command where missing 2019-11-05 15:10:14 -05:00
Renovate Bot 420e33ad12 Update dependency react-lazylog to v4.4.1 2019-11-05 11:54:54 -05:00
Renovate Bot 5fe06c8da7 Update dependency @testing-library/react to v9.3.2 2019-11-05 11:54:41 -05:00
octavian-negru cfbd068751 Bug 1516630 - Delete old frameworks and alerts that are not used 2019-11-05 08:33:06 +02:00
Renovate Bot 1b012b49da Update dependency fetch-mock to v7.7.2 2019-11-04 09:12:08 -05:00
Renovate Bot ffd77ad3be Update dependency @testing-library/jest-dom to v4.2.3 2019-11-04 09:11:28 -05:00
Renovate Bot da2baeb2d2 Update dependency victory to v33.1.2 2019-11-04 09:11:12 -05:00
Renovate Bot e8ed788d76 Update react monorepo to v16.11.0 2019-11-04 09:11:00 -05:00
Renovate Bot 489a384b97 Update dependency webpack-cli to v3.3.10 2019-11-01 09:25:07 -04:00
Renovate Bot 9a06fd7429 Update dependency @testing-library/react to v9.3.1 2019-10-31 14:36:42 -04:00
Armen Zambrano G d9a127cc0e If a pulse_job is None consider it as an invalid job
This is a regression introduced in https://github.com/mozilla/treeherder/pull/5196

With the [PR that just landed](https://github.com/mozilla/treeherder/pull/5546) it becomes more noticeable.
2019-10-31 13:30:27 -04:00
Armen Zambrano G 80bb188f0f Ignore certain tasks for android-components
For tasks not associated to master or associated to pull requests ignore them.
2019-10-31 10:53:07 -04:00
Armen Zambrano G 3ef5bd0785 Be more specific about the node version used for Travis
Sometimes Travis fails because `nvm` would not be able to reach the node package with:

> Failed to install 12. Remote repository may not be reachable.

Perhaps being more specific will help with timing of node releases or more likely hitting the cache.
2019-10-31 10:53:07 -04:00
Armen Zambrano G 342f3db6d4 Permit Github owner info to be longer than 50 chars 2019-10-31 10:53:07 -04:00
Armen Zambrano G 3d6d873f1a Do not process tasks that are associated to an 'onhold' repository
This will prevent raising MissingPushException which causes celery tasks to be retried
2019-10-31 10:53:07 -04:00