Граф коммитов

285 Коммитов

Автор SHA1 Сообщение Дата
Yoann Schneider 8028121253
Bug 1823654 - Introduce pyupgrade (#7904)
* Ruff Auto fix

* Ruff unsafe fixes auto fix

* Use builtin list instead of typing.List

---------

Co-authored-by: Sebastian Hengst <aryx.github@gmx-topmail.de>
2024-02-02 21:02:10 +01:00
Yoann Schneider cfb19a5ef8
Bug 1823654 - Mostly use double quotes (#7900)
* Enable quote style verifications from Black

* Actually exclude migrations folders
2024-01-31 16:59:20 +01:00
alexandru-io f955cfd5d6
Make profiler links available in alerts view (#7838)
* Bug 1843109 - Use cache to keep taskcluster task ids

* Bug 1843109 - Add profiler links to the API response of /api/performance/alertsummary

* Bug 1843109 - Add tests in alerts API for profiler links

* Move the logic of generating the URL in ViewSet

* Fix logic in ViewSet list method
2023-12-20 15:58:36 +02:00
Joel Maher 15bae14f17
store duration along with group status (#7816) 2023-09-28 08:53:09 -07:00
alexandru-io 983aeb1b89
Add TaskclusterMetadata to the alert summary API endpoint (#7740)
Bug 1838836 - Add TaskclusterMetadata to the alert summary API endpoint
2023-09-20 12:43:33 +03:00
Beatrice Acasandrei 8933660a98 Add application field 2023-09-14 17:13:26 +02:00
Valentin Rigal 913260c308 Fix last failing tests with postgres 2023-08-11 11:45:43 +02:00
EvaBardou 27b2f96ed5 Fix two more tests 2023-08-11 11:45:43 +02:00
EvaBardou 1ea6031b99 Enforce querysets order between mysql and psql 2023-08-11 11:45:43 +02:00
EvaBardou b70edaa7ea New Black changes 2023-06-20 10:58:40 +02:00
Joel Maher fed927341e
support marking NEW failures as FC_id=6 (#7691)
* support marking NEW failures as FC_id=6

* change classification  ->
2023-05-16 05:41:29 -07:00
beatrice-acasandrei 2172544063
Update dependency moz-measure-noise to 2.60.0.2 and scipy to 1.10.0 (#7636)
* Update moz-measure-noise and scipy + generate hashes

* Update test

* Removed test changes

* Changing test values

* Mock deviance

* Address change request
2023-02-20 14:46:35 +02:00
Joel Maher 4083943628
for groupsummary use push.time instead of job.submit_time, also include failure_classification (#7571) 2022-11-17 16:41:47 -08:00
Joel Maher cbc732908a
Adjust groupsummary to use group.status and be optimized (#7570) 2022-11-10 06:43:02 -08:00
Joel Maher dd8fdf043f
Add API to get manifest run status (#7549) 2022-11-01 19:48:31 -07:00
beatrice-acasandrei 2052c763d6
Bug 1782053 - [PerfCompare] Calculate is_confident, needs_more_runs, is_noise_metric (#7499) 2022-08-08 17:40:05 +03:00
eng-esther b96ddebf9f
graph link generating in progress (#7470) 2022-08-04 13:47:17 +03:00
beatrice-acasandrei 0b13fda3f7
Bug 1778502 - Fix edge case for the PerfCompare endpoint (#7475)
* Fix edge case for PerfCompare endpoint

* Address change request
2022-07-07 17:57:30 +03:00
Bastien Abadie ec5327138a
Upgrade Celery to v5 (#7434)
* Update position of global celery parameters

* Update celery to 5.2.6

* Reference directly cached-property

* Use shared_task instead of task

* Update env for celery

* Check rabbitmq is up in dev entrypoint

* Setup HOME in dev Dockerfile to avoid mozci crash

* Use INFO log level for celery to see what is going on

* Fix lint on docker/entrypoint.sh

* Update retryable unit test
2022-05-05 23:30:20 +02:00
Sebastian Hengst ff143914a5
Bug 1766054 - dynamically generate last modification date of mocked bug data for bugscache test (#7426) 2022-04-22 12:42:17 -07:00
EvaBardou 00cd6a9187
Bug 1754464 - Store some failures classification from mozci as FailureClassification (#7406)
* Add a step to autoclassify some intermittent jobs during mozci ingestion

* Add error handling

* Link the Bugzilla single tracking bug during autoclassification

* Small fixes related to Bastien's review

* Proper logic for autoclassification Bugzilla bug linking

* Nit

Co-authored-by: Eva Bardou <ebardou@teklia.com>
2022-03-23 09:20:44 -07:00
Sebastian Hengst f8d0556fe3
Bug 1422706 - reopen incomplete bugs used for classifications (#7323) 2021-12-17 11:31:54 +00:00
Sebastian Hengst b67b596342
Bug 1731631 - suggested duplicated bug used for classification, classify with open bug against which it is set as duplicate (#7308)
* Bug 1720105 - drop 'os' column from 'bugscache' table because it's unused
* For Bug 1731631 - only ingest data about intermittent bugs changed since the last update of the bugscache
store for duplicate bugs against which non-duplicate bug they got set as duplicate
* Simplify pinnedJobBugs by switching from Object to Set
* use open bug for classification if duplicate one matches failure line
2021-12-06 10:26:14 +00:00
Sebastian Hengst d397389863
Bug 1429030 - automatically suggest Bugzilla product and component when bug filer gets opened (#7151)
* Add model for file-to-bugzilla-component relation and its ingestion process
* add API endpoint to get Bugzilla product and component for source file path/search term
* bug filer: identify bugzilla product and component to use based on file path
2021-09-13 11:43:45 +01:00
ionutgoldan c37ddb93a8
Bug 1618829 - Fully enable PerfSheriffBot
* fix package typo
* really fix the encoding error on TaskclusterModel null object
* automatically set null object for backfilling
* fully enable secretary
2021-04-07 14:47:08 +03:00
beatrice-acasandrei 8a4e98588d
Bug 1690259 - Keep perf data with historical value 2021-03-25 14:50:42 +02:00
ionutgoldan 2ab2630f62
Bug 1689620 - Soft launch backfill tool (#7006)
* Bug 1689620 - PerfSheriffBot reports outcome
* provide schema migration for extended backfill records
* delegate content creation
* stabilize or temporary silence part of the tests
* group PerfSheriffBot' s components under single package
* rename PerfSheriffBot' script
* extract Notify service
* abstract away perf sheriff bot' s instantiation
* refactor email writting
* refactor delete notification email
* provide proper subject & content for backfill report email
* merge email modules into one
* provide NullObject for email notifier
* fix tests from BigQuery integration
* fix notification mocks in tests
* build push range link
* raise appropriate exceptions from email composition
* improve Linux perf alert fixture
* handle json error exception when writing email
* exclude abstract methods from coverage
* ensure TaskclusterModelImpl cannot be instantiated on production
* basic unit tests for email notifications related to expiring signatures
* ensure happy path testing for BackfillNotificationWriter via PerfSheriffBot
* provide coverage for TaskclusterModelImpl' s constructor
* address some PyCharm inspection warnings
* better group tests for deletion email writer
* test email integration in PerfSheriffBot
* provide email writer via dependency injection to ease testability
* turn some private methods into staticmethods
2021-03-08 11:46:07 -08:00
Alexandru Irimovici 8988bb7853
Bug 1626548 - Check outcome of backfills 2021-02-26 16:00:44 +02:00
dependabot-preview[bot] 65dcbd9ff3
Bump django from 3.0.8 to 3.1.4 in /requirements (#6903)
* Bump django from 3.0.8 to 3.1.4 in /requirements

Bumps [django](https://github.com/django/django) from 3.0.8 to 3.1.4.
- [Release notes](https://github.com/django/django/releases)
- [Commits](https://github.com/django/django/compare/3.0.8...3.1.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* fix deprecated db field
* 3.1 fixup

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Cameron Dawson <cdawson@mozilla.com>
2020-12-21 16:42:26 -08:00
Cameron Dawson ed41015a48
Bug 1594822 - Remove Autoclassify and Crossreference without migration (#6915)
* Revert "Revert "Bug 1594822 - Remove Autoclassify and Crossreference code (#6897)""

This reverts commit f671b32bdc.
* remove migration changes
2020-12-15 11:08:07 -08:00
Cameron Dawson f671b32bdc Revert "Bug 1594822 - Remove Autoclassify and Crossreference code (#6897)"
This reverts commit f0bf41503f.
2020-12-14 18:40:38 -08:00
Cameron Dawson f0bf41503f
Bug 1594822 - Remove Autoclassify and Crossreference code (#6897)
* also remove other defunct job fields
2020-12-14 15:53:21 -08:00
beatrice-acasandrei 17dbc80b33
Bug 1671564 - Email summary of signatures prior to deleting them 2020-12-09 15:28:51 +02:00
beatrice-acasandrei fc08ce1ebd
Bug 1670936 - Remove deprecated columns from performance_datum table 2020-11-03 10:28:00 +02:00
beatrice-acasandrei d3fc209a29
Bug 1669490 - Added strategy for data removal 2020-10-28 08:40:42 +02:00
ionutgoldan 9848dbf8e8
Bug 1667051 - Remove `try` perf data older than 6 weeks (#6780)
* Bug 1667051 - Integrate try data removal
* by making room for strategy pattern
* test the try data removal
* fix broken tests

* Bug 1667051 - Remove leftovers after all strategies ran

* Bug 1667051 - Make --days option available only on Treeherder

* Bug 1667051 - Replace PerformanceDatumManager with dedicated cycler

* Bug 1667051 - Miscellaneous code cosmetics
* make class definition order irrelevant
* provide richer type hinting
* provide strategies via dependency injection
* use logger as global var
* improve a bit time out test for Perfherder cycler

* Bug 1667051 - Address review requests

* Bug 1667051 - Fix new strategy's intermittent issue

* Log which strategy runs & why no cycling happened
* Maintain reference of target signatures across deletes
* Remove worthless dynamic limit check
* Bulk remove from multiple signatures
2020-10-15 17:14:47 -07:00
Cameron Dawson 1250108abe
Upgrade pip dev packages (#6742)
* Upgrade pip dev packages
* Fix formatting with black
2020-08-31 11:01:43 -07:00
esanuandra d903212142
Bug 1639136 - Alert summary endpoints also retrieve performance tags 2020-06-11 08:58:17 +03:00
esanuandra 26e7979912
Bug 1639127 - Provide performance tags ORM model 2020-05-28 15:08:25 +03:00
ionutgoldan db1a90f1a1
Bug 1618836 - Integrate the backfill logic in the PerfSheriffBot (#6302)
* Big 1618836 - Integrate the backfill logic in the PerfSheriffBot

* provide test coverage at PerfSheriffBot level
* provide a max runtime for bot
* gracefully stop when no time left
* setup feature flags for backfill tool & secretary
* serialize datetimes as ISO
* extend secretary's API with methods for updating the daily limits
2020-05-20 18:15:48 +03:00
Armen Zambrano 368c112266
Apply black formating to the whole repo (#6332)
* Automatic black fixes
* Add conflicting rule exceptions between black and flake8
2020-04-21 10:35:59 -04:00
Sarah Clements 77bf3ab9a2
Bug 1603249 - Use taskcluster API to fetch artifacts in UI (#6242)
This is part 1 of this bug and only makes changes to how JobDetails API
is used in the UI to retrieve uploaded artifacts. It updates ReplicatesGraph,
DetailsPanel, UnsupportedJob and LogViewer App. Adds helpers and updates tests.
2020-04-03 11:38:27 -07:00
Cameron Dawson 0e50ba014a
Bug 1612224 - Compare current Health push to its parent (#6165) 2020-03-26 16:59:38 -07:00
Suyash Salampuria b9920ee6a7
Bug 1452238 - remove job_id from generate_enough_perf_datum (#5956)
Unused variable.

Link to bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1452238
2020-02-10 09:38:31 -05:00
Kyle Lahnakoski 7f7ce81589
Support test environment outside of Docker container (#5716)
Work to support running Python tests outside of the Docker container.
This also helps with integration with IDEs and is prework for using Git hooks for precommit/prepush features.
2020-02-05 14:55:03 -05:00
ionutgoldan d1e1af626c
Bug 1593198 - Surface application name in Graphs view 2020-01-22 14:46:14 +02:00
ionutgoldan ea1ed3b76a
Bug 1584947 - Display measurement units on the Graphs view 2020-01-08 12:03:29 +02:00
ionutgoldan 77b56c58f7
Bug 1587404 - Filter perf signatures by tags 2020-01-07 10:10:45 +02:00
Cameron Dawson 2eede9b471
Bug 1599526 - Push Health handle tasks with timout errors (#5723) 2019-12-12 12:24:22 -08:00
ionutgoldan 419c2650a1 Bug 1571369 - Store backfill reports per alert summary (#5539) 2019-11-14 08:29:55 -05:00