Alexander Nicholson
71cd8ba434
bump pyspark version
2023-01-18 10:47:45 -05:00
kik-kik
069ed0f5e1
Merge pull request #378 from mozilla/bug/1809624/graphics_telemetry-dataproc_cluster-init-failure
...
bug(1809624): tweaked package requirements to use git for installing the moztelemetry package
2023-01-13 14:50:56 +01:00
kik-kik
423a62c6b4
tweaked package requirements to use git for installing the moztelemetry package
2023-01-12 14:47:09 +01:00
Will Kahn-Greene
a8dbc07338
add README for symbolication scripts
2022-11-22 14:02:44 -05:00
Will Kahn-Greene
6a9e4e435d
bug 1775444: drop top signatures from 250 to 200
...
We're having memory issues and it looks like the total number of crash
reports for the top signatures is increasing over time. This drops the
number of top signatures we look at which will drop the number of crash
reports which should reduce the memory used back to a workable number.
2022-06-22 10:40:39 -04:00
Will Kahn-Greene
eb32d5a5d3
bug 1774415: reduce top signatures to 250
...
The top_signatures_correlations task is getting killed off for using too
much memory. This drops the top signatures we're looking at from 300 to
250 as a temporary attempt to get the job succeeding again.
2022-06-15 15:15:45 -04:00
Jeff Klukas
21b8003666
Update bhr_collection.py ( #371 )
2022-05-09 13:46:35 -04:00
Doug Thayer
c70b5c8c6d
Allow empty symbols in breakpad files for BHR ( #370 )
...
The bhr_collection job is currently failing because we are now
seeing a FUNC line in a breakpad file which omits a symbol. I'm
not entirely sure why we're seeing this, but I don't see any
problem with just letting it through annotated as an empty symbol.
2022-05-09 13:38:16 -04:00
Will Kahn-Greene
20ab1aaa76
Revert to 300 signatures for correlations ( #368 ) ( #369 )
...
We recently raised the number of signatures to look at to 1000, but this
caused the container to run out of memory when working on correlations
for the release channel.
This reverts back to the previous value of 300.
2022-03-24 09:17:00 -04:00
Marco Castelluccio
c04a09ec9e
Generate correlations for the top 1000 signatures instead of top 300 ( #367 )
2022-03-22 09:26:46 -04:00
=
af6d1ab2a7
Merge branch 'main' of https://github.com/mozilla/python_mozetl
2022-01-21 15:13:40 +01:00
=
81777e520e
syncing changes from FirefoxGraphics/telemetry pull#14
2022-01-21 15:13:33 +01:00
kik-kik
fc0fafedf4
Merge pull request #365 from mozilla/update-key
...
Update CircleCI SSH Key DSRE-413
2022-01-21 13:10:10 +01:00
Jason Thomas
7ccabe99c9
Update CircleCI SSH Key DSRE-413
2022-01-20 14:02:51 -05:00
kik-kik
cd90abcf91
Merge pull request #364 from mozilla/bug/1737588/graphics_telemetry-none-not-subscriptable-error
...
Also catching TypeError in graphics_telemetry_dashboard.py
2022-01-11 18:12:26 +01:00
=
8ea63753ce
because nothing ever is easy in life
2022-01-11 17:56:23 +01:00
=
37c9e5b997
sphinx and m2r extension changed to m2r2 due to no support
2022-01-11 17:50:13 +01:00
=
06cd6e1556
now also catching TypeError
2022-01-11 16:59:46 +01:00
Will Kahn-Greene
2172bb3dba
Merge pull request #362 from willkg/bug-1746874-missing-symbols
...
bug 1746874: fix case where version is None
2021-12-20 13:09:10 -05:00
Will Kahn-Greene
12bb1f6fbf
bug 1746874: fix case where version is None
...
Socorro switched stackwalkers last week and the new one emits a null
instead of an empty string for the module version. This fixes
is_old_firefox_module to work with null (which is None).
2021-12-20 11:46:21 -05:00
Ben Wu
946fbd50f4
Fix error on missing media decoders in graphics job ( #361 )
2021-08-18 14:36:21 -04:00
Doug Thayer
4a11103d5b
Output hang annotation information in the bhr job ( #360 )
2021-05-10 11:24:20 -04:00
Marco Castelluccio
f72b778131
Generate correlations for the top 300 signatures instead of top 200 ( #359 )
2021-04-15 18:02:32 -04:00
Ben Wu
024582554a
Change graphics jobs to use mozdata for temp tables ( #358 )
2021-02-19 14:52:19 -05:00
Ben Wu
3e9cfbfabb
Mod 7 weekday arg in symbolication jobs ( #357 )
2020-12-21 15:21:49 -05:00
Ben Wu
c183d901e8
Port bhr collection from databricks ( #356 )
2020-12-17 18:01:18 -05:00
Ben Wu
43ffb961db
Change default branch to main ( #355 )
2020-12-17 11:26:35 -05:00
Ben Wu
e42d0a9d23
Update dependencies to fix ci ( #354 )
2020-12-16 11:51:45 -05:00
Ben Wu
5756722cd5
Port symbolication jobs from databricks ( #353 )
2020-12-15 12:23:57 -05:00
Ben Wu
96e9933ad4
Port graphics trends from databricks to dataproc ( #351 )
2020-12-11 18:16:26 -05:00
dependabot[bot]
3d1ca45f74
Bump pyspark from 2.3.1 to 2.3.2
...
Bumps [pyspark](https://github.com/apache/spark ) from 2.3.1 to 2.3.2.
- [Release notes](https://github.com/apache/spark/releases )
- [Commits](https://github.com/apache/spark/compare/v2.3.1...v2.3.2 )
Signed-off-by: dependabot[bot] <support@github.com>
2019-11-08 09:58:56 -05:00
Mark Reid
9c2715a67e
Remove maudau tests and docs.
2019-11-08 09:58:38 -05:00
Mark Reid
ee5f306d67
Remove the ETL code for the "engagement_ratio" job.
...
This is an ancient thing that was used by the dashboard at:
https://metrics.services.mozilla.com/firefox-dashboard/
which has been decommissioned per Bug 1571454.
2019-11-08 09:58:38 -05:00
William Lachance
8755e0c4e9
Bug 1589118 - Remove tab spinner job ( #344 )
2019-10-30 10:12:50 -04:00
William Lachance
58dce245ce
Fix undercounting of tab spinners ( #343 )
...
We would consider something "unaffected" for a short duration if we had no "short" tab spinner histogram OR "long" tab spinner histogramWe would consider something "unaffected" for a short duration if we had no "short" tab spinner histogram OR "long" tab spinner histograms. It should actually be "no short AND no long".
2019-10-22 09:47:14 -04:00
Victor Ng
1838654310
added tests and code to exercise `get_addons_per_client` in taar_lite_guidguid
2019-09-30 12:00:19 -07:00
Victor Ng
86eb9a9a44
The `get_addons_per_client` call had a bug where `active_addons` in the longitudinal table was structured as a dictionary of addon_guid -> addon_metadata, but the clients_daily table models the active_addons as a list of just addon_metadata.
...
This patch also unrolls the `extract_telemetry` function from using any nested functions to aid clarity.
2019-09-30 12:00:19 -07:00
Victor Ng
9efff104db
updated taarlite guidranking tests to use mock clients_daily
2019-09-17 13:09:10 -07:00
Victor Ng
4d8b313eda
Ported taar_lite ETL jobs to use clients_daily to prepare for GCP migration.
2019-09-17 13:09:10 -07:00
Victor Ng
c377fc0fc5
Fixed a bad logger.error call when an exception occurs for taar_amodump
2019-09-17 13:09:10 -07:00
Anthony Miyaguchi
939eb93f8a
Bug 1561048 - Decommission churn_v3
2019-08-22 09:57:30 -07:00
Anthony Miyaguchi
9217335652
Bug 1570611 - Decommission Topline summary view
2019-08-16 10:41:36 -07:00
Anthony Miyaguchi
7b58a334df
Bug 1571565 - Decommission retention_v1 dataset
2019-08-13 12:34:16 -07:00
Victor Ng
ba51f539e5
fixes the s3 write path for the recommended whitelist
2019-08-01 14:04:53 -07:00
Victor Ng
3e86502f5d
updated taar whitelist to allow for short recommended whitelists
2019-08-01 11:19:41 -07:00
Victor Ng
978fe4f17f
TAAR whitelist uses recommended addons only now.
...
The AMO whitelist URL is now requested with a 'recex=True' option added
to the end of the URL to restrict addons to only the recommended list
for TAAR recommendd addons now.
Changed the 'recex=True' option to 'recommended=True'
Changed the CGI argument as per comment:
https://github.com/mozilla/addons-server/issues/11851#issuecomment-512355666
2019-07-19 10:52:43 -07:00
Victor Ng
3d8ebaea04
This pins the docker images to use debian 9 (stretch)
...
* CircleCI just upgraded to debian 10 (buster) which does not not support
OpenJDK 8.
2019-07-18 11:53:35 -07:00
William Lachance
4207f9abe2
Bug 1564513 - Bump search datasets versions again
2019-07-11 10:43:33 -04:00
Ben Miroglio
0287d91f7a
Fix overcounting error when exploding ad fields ( #333 )
2019-07-08 17:11:52 -04:00
William Lachance
ad257f64c5
Bump versions of search datasets again
2019-06-03 08:50:26 -04:00