Граф коммитов

1760 Коммитов

Автор SHA1 Сообщение Дата
Kyle Lahnakoski 690010736f
Bug 1631082 - Fix extraction of alerts into BigQuery (#6316)
* add alert tests, fix alert extract

* enable extract testing in travis

Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-17 16:47:24 -04:00
ionutgoldan 3f73a3103e
Bug 1612547 - Define component for doing backfills using existing reports 2020-04-14 13:02:44 +03:00
esanuandra f4727a6379
Bug 1627968 - Rename Health view to Tests view 2020-04-13 09:31:24 +03:00
Kyle Lahnakoski 53a806d3cc
Test integrate black (#6277)
* Configuration for black

* changes congiguration

* change pyproject's directory

* add files to be excluded and skip string normalization

* removed isort from pre-commit

* remove version locks for black

* fix

* remove all isort

* update requirements

Co-authored-by: SuyashSalampuria <suyash546@gmail.com>
Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-08 14:47:37 -04:00
Cameron Dawson a31426bce0
Bug 1611334 - Remove support for GraphQL (#6235)
Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-07 17:36:57 -04:00
Kyle Lahnakoski e60d301775
Reduce list of Python requirements (#6141)
This is a shortened and easier list of packages to manage.

Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-07 14:40:36 -04:00
Shubham Kumar 10a2040774 Add markdownlint pre-commit hook and fixed docs
We also add it as part of the Travis execution.
2020-04-07 09:41:54 -04:00
Shubhank Saxena c7f9fbb5de
Add seed-isort-config hook (#6182) 2020-04-07 08:14:36 -04:00
Cameron Dawson 9652c11aa9
Bug 1627088 - Rename known intermittents to known issues (#6267) 2020-04-06 08:19:55 -07:00
Cameron Dawson ec0e79a8ba
Bug 1625998 - Filter failed builds/linting for parent push (#6243) 2020-04-03 16:04:31 -07:00
Sarah Clements 29ffbe0ae2
Revert "Run markdown checks in Travis and add it as a pre-commit hook (#6236)" (#6269)
This reverts commit bf67e894b7.
2020-04-03 16:41:16 -04:00
Sarah Clements 77bf3ab9a2
Bug 1603249 - Use taskcluster API to fetch artifacts in UI (#6242)
This is part 1 of this bug and only makes changes to how JobDetails API
is used in the UI to retrieve uploaded artifacts. It updates ReplicatesGraph,
DetailsPanel, UnsupportedJob and LogViewer App. Adds helpers and updates tests.
2020-04-03 11:38:27 -07:00
Sarah Clements 44cac62dad
Add task_id and retry_id to project bound Jobs API (#6250) 2020-04-03 10:21:08 -07:00
Shubham Kumar bf67e894b7
Run markdown checks in Travis and add it as a pre-commit hook (#6236)
Closes #6185 

- Add markdownlint default rules
- Add `pre-commit` in `dev.txt` with proper hashing required when running Travis
- Add hook in `.pre-commit-config.yaml`
- Refer [here](https://github.com/igorshubovych/markdownlint-cli) for documentation
2020-04-03 09:50:26 -04:00
Alexandru Irimovici eff90b1972
Bug 1618840 - Create secretary tool for PerfSheriffBot 2020-04-03 16:20:52 +03:00
Kyle Lahnakoski 0fe0362759
Use pip-tools for requirements (#6140)
* update imports, add pip-tools

* first compiled output

* add *.in files (copy of *.txt)

* common.txt from master

* update *.in

* allow upgrade on big-query requirements.txt

* run --upgrade

* example upgrade

* docs

* fix install order

* show how to slim requirements/common.in

* isort

* slim common.in

* isort

* run pip-compile

* fix formatting

* ensure requirements/common.txt is installed last

Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-04-01 08:15:15 -04:00
Kyle Lahnakoski ebf67a67c3
Update hashes, fix docker isort, more docs (#6199)
* reference

* update requirements

* fix constants

* disable isort in docker
instructions on running tests
remove timezone info

* more doc fixes

* more cleaning instructions

* fix isort

* more docs

* whitespace

Co-authored-by: Kyle Lahnakoski <kyle@lahnakoski.com>
2020-03-30 15:40:42 -04:00
Cameron Dawson 0e50ba014a
Bug 1612224 - Compare current Health push to its parent (#6165) 2020-03-26 16:59:38 -07:00
Armen Zambrano 2fdc52a474
Bug 1615330 - Support test filtering besides manifest filtering (#6172)
This change allows the user to enter a test/manifest path and find jobs that match it.
This supports the code landed in [bug 1615333](https://bugzilla.mozilla.org/show_bug.cgi?id=1615333)

We only fetch test manifest artifacts when `test_paths` is part of the URL.

Also added a test to correctly map tests/manifest from the task name, thus, increase of code coverage.

The code was originally landed here:
0f9e053096
and reverted here:
3224c217f5
2020-03-23 11:11:43 -04:00
Armen Zambrano a3a50d4ccd
Travis: Run Python tests outside of Docker container (#5943)
* Add Travis job to run Python tests outside of Docker
* `runtests.sh` is renamed to `runchecks.sh` and it does not run Python tests
* `manage.py check --deploy` was duplicated in Travis
* Update testing documentation
* Remove `-bb` since it is not needed since Python 3.5
2020-03-20 14:58:11 -04:00
Armen Zambrano G 3224c217f5 Revert "Bug 1615330 - Support filtering by test paths rather than manifest paths (#6120)"
This reverts commit 0f9e053096.
2020-03-18 08:59:12 -04:00
Suyash Salampuria 147da2c825
Bug 1618889 - Remove reduntant Selenium Graphs view tests 2020-03-17 13:13:11 +02:00
Armen Zambrano 0f9e053096
Bug 1615330 - Support filtering by test paths rather than manifest paths (#6120)
This change allows the user to enter a full test path and find jobs that match it.
This supports the code landed in [bug 1615333](https://bugzilla.mozilla.org/show_bug.cgi?id=1615333)

Also added test to correctly map tests from task name, thus, increase of code coverage.
2020-03-16 20:47:02 -04:00
Cameron Dawson 61ebbb30e8
Bug 1612229 - Push Health Usage Dashboard (#6137) 2020-03-16 14:25:11 -07:00
Tarek Ziade 2e4e3a4dda
Bug 1616975 - Create a unified changelog (#5949)
* Add management task for fetching github commits based on repository fixes and 
2 tables for storing that data
* Add changelog web api
* Add tests
* Refactor Github utilities into one file and move http utilities from common.py to new file
2020-03-13 13:27:12 -07:00
Armen Zambrano 24194441aa
Bug 1509181 - Github ingestion: Ingest pushes in the right order (#6070)
Git based projects can list pushes in the UI incorrectly. This can be caused by commits having been ammended on a PR or merges of old commits.

Using the committer's date (the date when the PR gets merged) instead of the author's date to determine push time fixes the sorting problem.

This change also includes:
* Support for manual ingestion of Git pushes
* Support for ingesting the latest commits for a repo
* Script to compare pushes between Treeherder instances

## Script to compare pushes between Treeherder instances

`compare_pushes.py` compares the last 50 pushes of various projects for different Treeherder instances. The output generates links to each instance and revision to visually compare.

```console
% ./misc/compare_pushes.py --projects android-components,fenix,reference-browser,servo-master,servo-auto,servo-try
Comparing android-components against production.
Comparing fenix against production.
Comparing reference-browser against production.
{"values_changed": {"root['push_timestamp']": {"new_value": 1582580346, "old_value": 1582581477}}}
https://treeherder.allizom.org/#/jobs?repo=reference-browser&revision=547a18b97534b237fa87bd22650f342836014c4e
https://treeherder.mozilla.org/#/jobs?repo=reference-browser&revision=547a18b97534b237fa87bd22650f342836014c4e
Comparing servo-master against production.
Comparing servo-auto against production.
Comparing servo-try against production.
```
2020-03-10 14:29:07 -04:00
Armen Zambrano b91c483a2c
job-view: Support compressed manifest-tasks artifact (#6094)
For test path filtering the artifact is quite large (over 1MB) but the
compressed version is much smaller (~90KB).

This change will try to first download the compressed file and then
attempt the uncompressed version as a fallback.
2020-03-10 11:31:36 -04:00
Cameron Dawson d0e8dc9839
Bug 1620667 - Refactor currentRepo property and CommitHistory layout (#6114) 2020-03-09 16:32:03 -07:00
Cameron Dawson 9e84b2380c
Bug 1616311 - Fix link for the Parent Push (#6104) 2020-03-05 11:15:40 -08:00
Cameron Dawson 62cfe2c8c4
Bug 1616311 - Add ability to copy test group name to clipboard (#6103)
* Bug 1616311 - Fix when a key starts with a numeral

We use this as an `id` or query selector at times.  So it must
start with a character.

* Bug 1616311 - Pass the correct revision to CommitHistory

We were passing the revision of the parent, not the current revision
for which we are showing the RevisionList

* Bug 1616311 - Add ability to copy test group name to clipboard
2020-03-04 16:18:24 -08:00
Cameron Dawson bfdd99d9b9 Bug 1618751 - Push Health show trunk parent and commits 2020-03-04 14:48:24 -08:00
Cameron Dawson ab28c4ccb4 Bug 1618751 - Make the RevisionList from job-view a shared component
Also make the clipboard copy feature only visible on hover.
2020-03-04 14:48:24 -08:00
Cameron Dawson b8982a1f9a
Bug 1611334 - Remove View Tests button from PushHeader (#6096) 2020-03-04 10:55:12 -08:00
Mellina Yonashiro 5a8c470889
Bug 1600759 - Perfherder's Graph Alt. View for Screen Readers (#6001)
Create a table view in graphs for screen reader users; add tests
2020-03-03 16:11:59 -08:00
Kyle Lahnakoski 64efbc2caf
Bug 1617674 - BigQuery Extraction - include commits in push (#6093)
add commit records to push records
2020-03-03 17:30:18 -05:00
Armen Zambrano 395237e732
Bug 1509181 - Fix ingestion of GitHub pushes (#6065)
Github based projects can list pushes in the UI incorrectly. This is caused by commits that have been ammended.

This code change switches to grab the push time from the `timestamp` field of the head commit from the Pulse event rather that Github's APIs. This fixes the problem of push sorting.

Note, that the field `timestamp` only exists in the Push event that the Pulse message contains. This field can be seen in the `events` API, however, that API contains all sorts of events and holds a maximum of 300 events.

This change also includes partial support for manual ingestion of Git pushes.
2020-02-28 09:10:52 -05:00
Cameron Dawson c7d873eda8
Bug 1617734 - Push health ui a11y improvements (#6059)
* CSS Cleanup
* Use darker-info and darker-secondary for a11y
* Put Parent Push metric at end of list and clean it up
* Add a `scrollToLine` when clicking/expanding metric names
2020-02-27 10:01:46 -08:00
Kimberly Sereduck fb67229dee
Bug 1614578 - Differentiate the "all" items from status & framework dropdowns 2020-02-26 15:35:14 +02:00
Armen Zambrano G 15b4d4d92b Revert "Bug 1509181 - Fix ingestion of GitHub pushes + manual ingestion support (#6019)"
This reverts commit b41f68286d.
2020-02-25 15:25:04 -05:00
Armen Zambrano b41f68286d
Bug 1509181 - Fix ingestion of GitHub pushes + manual ingestion support (#6019)
Git based projects can list pushes in the UI incorrectly. This is caused by commits that have been ammended.

This code change switches to use the `timestamp` field of head commit to determine push time rather a commit's authorship date. This fixes the problem of push sorting.

This change also includes support for manual ingestion of Git pushes.
2020-02-24 12:20:50 -05:00
Sarah Clements f83e08b69d
Bug 1497931 - Remove jquery and Bootstrap (#6035)
* refactor components using bootstrap elements with reactstrap
* add template for cdn to access Bootstrap CSS
* remove bootstrap, jquery and angular library
* fixes to get tests passing and add bootstrap link to csp
2020-02-21 12:10:03 -08:00
Kyle Lahnakoski 4283107ea3
Bug 1610347 - Extract to BigQuery - Fixes for Heroku (#5984)
* more error handling
* more explanation
* django query does not encode datetime
* fix redis
* update hashes
* Handle Decimal on prototype
* add --start for testing, limit some string length
* more logging
2020-02-20 11:05:03 -05:00
Armen Zambrano 9104004ee1
SETA improvements (#6002)
* Properly configure LOGGING_LEVEL

`LOGGING_LEVEL` was being cast down to False rather than "INFO" or "DEBUG".
There were no fallouts from it but it was preventing setting the right logging
level for the Docker container or the Heroku Review Apps.

* Validate preseed entries and fail if issues are found

Without validation some invalid data job priorities would be inserted into the table. No issues
would be noticed for SETA since the web API sanitizes the data before presenting it.
2020-02-18 11:51:53 -05:00
ionutgoldan eec3bfedbe
Bug 1609081 - Provide full server side search in Alerts view 2020-02-17 13:47:44 +02:00
Cameron Dawson ac5d8367a9
Bug 1612223 - Group Push Health crash signatures (#5985) 2020-02-12 16:47:20 -08:00
Cameron Dawson 346efe23a9
Bug 1614039 - Re-write pin jobs tests (#5962) 2020-02-10 14:32:42 -08:00
Cameron Dawson f398250648
Revert "Revert "Bug 1613302 - Better wording on Push Health Status wrt Need Investigation (#5958)" (#5978)" (#5981)
This reverts commit 7e39d90a85.

Fixed test to look for new wording of Push Health Badge
2020-02-10 13:24:17 -08:00
Suyash Salampuria b9920ee6a7
Bug 1452238 - remove job_id from generate_enough_perf_datum (#5956)
Unused variable.

Link to bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1452238
2020-02-10 09:38:31 -05:00
Cameron Dawson 19cddb7b1d
Bug 1612224 - Give access to parent of Push Health commit (#5902) 2020-02-07 14:40:56 -08:00
Kyle Lahnakoski d05b42cf80
Bug 1610347 - Extract jobs/perf/alert to BigQuery (#5839)
https://github.com/mozilla/treeherder/pull/5839 for details
2020-02-06 13:16:26 -05:00