Граф коммитов

468 Коммитов

Автор SHA1 Сообщение Дата
Alexander Nicholson 71cd8ba434 bump pyspark version 2023-01-18 10:47:45 -05:00
kik-kik 069ed0f5e1
Merge pull request #378 from mozilla/bug/1809624/graphics_telemetry-dataproc_cluster-init-failure
bug(1809624): tweaked package requirements to use git for installing the moztelemetry package
2023-01-13 14:50:56 +01:00
kik-kik 423a62c6b4
tweaked package requirements to use git for installing the moztelemetry package 2023-01-12 14:47:09 +01:00
Will Kahn-Greene a8dbc07338 add README for symbolication scripts 2022-11-22 14:02:44 -05:00
Will Kahn-Greene 6a9e4e435d bug 1775444: drop top signatures from 250 to 200
We're having memory issues and it looks like the total number of crash
reports for the top signatures is increasing over time. This drops the
number of top signatures we look at which will drop the number of crash
reports which should reduce the memory used back to a workable number.
2022-06-22 10:40:39 -04:00
Will Kahn-Greene eb32d5a5d3 bug 1774415: reduce top signatures to 250
The top_signatures_correlations task is getting killed off for using too
much memory. This drops the top signatures we're looking at from 300 to
250 as a temporary attempt to get the job succeeding again.
2022-06-15 15:15:45 -04:00
Jeff Klukas 21b8003666
Update bhr_collection.py (#371) 2022-05-09 13:46:35 -04:00
Doug Thayer c70b5c8c6d
Allow empty symbols in breakpad files for BHR (#370)
The bhr_collection job is currently failing because we are now
seeing a FUNC line in a breakpad file which omits a symbol. I'm
not entirely sure why we're seeing this, but I don't see any
problem with just letting it through annotated as an empty symbol.
2022-05-09 13:38:16 -04:00
Will Kahn-Greene 20ab1aaa76
Revert to 300 signatures for correlations (#368) (#369)
We recently raised the number of signatures to look at to 1000, but this
caused the container to run out of memory when working on correlations
for the release channel.

This reverts back to the previous value of 300.
2022-03-24 09:17:00 -04:00
Marco Castelluccio c04a09ec9e
Generate correlations for the top 1000 signatures instead of top 300 (#367) 2022-03-22 09:26:46 -04:00
= af6d1ab2a7 Merge branch 'main' of https://github.com/mozilla/python_mozetl 2022-01-21 15:13:40 +01:00
= 81777e520e syncing changes from FirefoxGraphics/telemetry pull#14 2022-01-21 15:13:33 +01:00
kik-kik fc0fafedf4
Merge pull request #365 from mozilla/update-key
Update CircleCI SSH Key DSRE-413
2022-01-21 13:10:10 +01:00
Jason Thomas 7ccabe99c9
Update CircleCI SSH Key DSRE-413 2022-01-20 14:02:51 -05:00
kik-kik cd90abcf91
Merge pull request #364 from mozilla/bug/1737588/graphics_telemetry-none-not-subscriptable-error
Also catching TypeError in graphics_telemetry_dashboard.py
2022-01-11 18:12:26 +01:00
= 8ea63753ce because nothing ever is easy in life 2022-01-11 17:56:23 +01:00
= 37c9e5b997 sphinx and m2r extension changed to m2r2 due to no support 2022-01-11 17:50:13 +01:00
= 06cd6e1556 now also catching TypeError 2022-01-11 16:59:46 +01:00
Will Kahn-Greene 2172bb3dba
Merge pull request #362 from willkg/bug-1746874-missing-symbols
bug 1746874: fix case where version is None
2021-12-20 13:09:10 -05:00
Will Kahn-Greene 12bb1f6fbf
bug 1746874: fix case where version is None
Socorro switched stackwalkers last week and the new one emits a null
instead of an empty string for the module version. This fixes
is_old_firefox_module to work with null (which is None).
2021-12-20 11:46:21 -05:00
Ben Wu 946fbd50f4
Fix error on missing media decoders in graphics job (#361) 2021-08-18 14:36:21 -04:00
Doug Thayer 4a11103d5b
Output hang annotation information in the bhr job (#360) 2021-05-10 11:24:20 -04:00
Marco Castelluccio f72b778131
Generate correlations for the top 300 signatures instead of top 200 (#359) 2021-04-15 18:02:32 -04:00
Ben Wu 024582554a
Change graphics jobs to use mozdata for temp tables (#358) 2021-02-19 14:52:19 -05:00
Ben Wu 3e9cfbfabb
Mod 7 weekday arg in symbolication jobs (#357) 2020-12-21 15:21:49 -05:00
Ben Wu c183d901e8
Port bhr collection from databricks (#356) 2020-12-17 18:01:18 -05:00
Ben Wu 43ffb961db
Change default branch to main (#355) 2020-12-17 11:26:35 -05:00
Ben Wu e42d0a9d23
Update dependencies to fix ci (#354) 2020-12-16 11:51:45 -05:00
Ben Wu 5756722cd5
Port symbolication jobs from databricks (#353) 2020-12-15 12:23:57 -05:00
Ben Wu 96e9933ad4
Port graphics trends from databricks to dataproc (#351) 2020-12-11 18:16:26 -05:00
dependabot[bot] 3d1ca45f74 Bump pyspark from 2.3.1 to 2.3.2
Bumps [pyspark](https://github.com/apache/spark) from 2.3.1 to 2.3.2.
- [Release notes](https://github.com/apache/spark/releases)
- [Commits](https://github.com/apache/spark/compare/v2.3.1...v2.3.2)

Signed-off-by: dependabot[bot] <support@github.com>
2019-11-08 09:58:56 -05:00
Mark Reid 9c2715a67e Remove maudau tests and docs. 2019-11-08 09:58:38 -05:00
Mark Reid ee5f306d67 Remove the ETL code for the "engagement_ratio" job.
This is an ancient thing that was used by the dashboard at:
https://metrics.services.mozilla.com/firefox-dashboard/

which has been decommissioned per Bug 1571454.
2019-11-08 09:58:38 -05:00
William Lachance 8755e0c4e9
Bug 1589118 - Remove tab spinner job (#344) 2019-10-30 10:12:50 -04:00
William Lachance 58dce245ce
Fix undercounting of tab spinners (#343)
We would consider something "unaffected" for a short duration if we had no "short" tab spinner histogram OR "long" tab spinner histogramWe would consider something "unaffected" for a short duration if we had no "short" tab spinner histogram OR "long" tab spinner histograms. It should actually be "no short AND no long".
2019-10-22 09:47:14 -04:00
Victor Ng 1838654310 added tests and code to exercise `get_addons_per_client` in taar_lite_guidguid 2019-09-30 12:00:19 -07:00
Victor Ng 86eb9a9a44 The `get_addons_per_client` call had a bug where `active_addons` in the longitudinal table was structured as a dictionary of addon_guid -> addon_metadata, but the clients_daily table models the active_addons as a list of just addon_metadata.
This patch also unrolls the `extract_telemetry` function from using any nested functions to aid clarity.
2019-09-30 12:00:19 -07:00
Victor Ng 9efff104db updated taarlite guidranking tests to use mock clients_daily 2019-09-17 13:09:10 -07:00
Victor Ng 4d8b313eda Ported taar_lite ETL jobs to use clients_daily to prepare for GCP migration. 2019-09-17 13:09:10 -07:00
Victor Ng c377fc0fc5 Fixed a bad logger.error call when an exception occurs for taar_amodump 2019-09-17 13:09:10 -07:00
Anthony Miyaguchi 939eb93f8a Bug 1561048 - Decommission churn_v3 2019-08-22 09:57:30 -07:00
Anthony Miyaguchi 9217335652 Bug 1570611 - Decommission Topline summary view 2019-08-16 10:41:36 -07:00
Anthony Miyaguchi 7b58a334df Bug 1571565 - Decommission retention_v1 dataset 2019-08-13 12:34:16 -07:00
Victor Ng ba51f539e5 fixes the s3 write path for the recommended whitelist 2019-08-01 14:04:53 -07:00
Victor Ng 3e86502f5d updated taar whitelist to allow for short recommended whitelists 2019-08-01 11:19:41 -07:00
Victor Ng 978fe4f17f TAAR whitelist uses recommended addons only now.
The AMO whitelist URL is now requested with a 'recex=True' option added
to the end of the URL to restrict addons to only the recommended list
for TAAR recommendd addons now.

    Changed the 'recex=True' option to 'recommended=True'

    Changed the CGI argument as per comment:
    https://github.com/mozilla/addons-server/issues/11851#issuecomment-512355666
2019-07-19 10:52:43 -07:00
Victor Ng 3d8ebaea04 This pins the docker images to use debian 9 (stretch)
* CircleCI just upgraded to debian 10 (buster) which does not not support
OpenJDK 8.
2019-07-18 11:53:35 -07:00
William Lachance 4207f9abe2
Bug 1564513 - Bump search datasets versions again 2019-07-11 10:43:33 -04:00
Ben Miroglio 0287d91f7a Fix overcounting error when exploding ad fields (#333) 2019-07-08 17:11:52 -04:00
William Lachance ad257f64c5
Bump versions of search datasets again 2019-06-03 08:50:26 -04:00