Граф коммитов

42 Коммитов

Автор SHA1 Сообщение Дата
Anna Scholtz 693cf80851
Fix date filtering in metric definition views (#921) 2024-03-19 15:43:59 -07:00
Anna Scholtz 244ec963e5
Generate per-datasource explores for metric definitions (#865)
* Generate per-datasource explores for metric definitions

* Combine clients daily views with metrics data sources

---------

Co-authored-by: Leli <33942105+lelilia@users.noreply.github.com>
2024-02-12 14:55:11 -08:00
Anna Scholtz 10d8577c55
Metric hub integration (#740)
* Update to Python 3.10

* Generate metric-hub namespaces

* Generate namespaces for metric hub metrics data sources

* Generate metric hub views

* Generate metric hub explores

* Add command line option to set metric hub repo

* Use client_counts views as basis for metric definition explores
2023-09-08 12:09:06 -07:00
Alexander f2cfe9e7e5
Generate datagroups.lkml (#615)
* Moved bigquery view references map to utils for use in multiple places
* Create datagroup generator script
* Added tests
* Formatting: update type reference to include dataset dict
2023-02-21 13:15:50 -05:00
dependabot[bot] c3db0820ec
Bump lkml from 1.2.0 to 1.3.1 (#548) 2022-11-03 11:09:16 -07:00
Anna Scholtz db7ccdaf4b
Merge pull request #391 from mozilla/opmon-dashboards
Opmon dashboards
2022-03-25 11:40:45 -07:00
Anna Scholtz acc59e256d File clarification to extend views
Co-authored-by: Will Lachance <wlachance@mozilla.com>
2021-12-03 14:41:17 -08:00
Anna Scholtz 4e97a8c5ca Add comment to generated contents that files are generated 2021-12-03 14:41:17 -08:00
Marina Samuel 8816f01cff Support submission_date on x-axis in operational monitoring. 2021-11-29 13:11:13 -05:00
Marina Samuel a55120e6c6 Add aggregate tables to speed up operational monitoring dashboards. 2021-11-16 11:29:54 -05:00
Marina Samuel 98ef40718a Add auto-generated opmon dashboards. 2021-10-19 13:36:02 -04:00
Daniel Thorn 5a29dde6b9
Remove workaround for joshtemple/lkml#53 (#237) 2021-09-20 11:45:22 -07:00
William Lachance aec929b8c5
Generate descriptions for Glean Ping explores (fixes #106) (#143)
Format should be `Explore for <x> ping. <x ping description>`. For
example, for the metrics ping, you would see:

```
Explore for the metrics ping. The metrics ping is intended for all of
the metrics that are explicitly set by the application or are included
in the application's metrics.yaml file (except events). The reported
data is tied to the ping's measurement window, which is the time
between the collection of two metrics ping. Ideally, this window is
expected to be about 24 hours, given that the collection is scheduled
daily at 4AM. Data in the ping_info section of the ping can be used to
infer the length of this window.
```
2021-06-02 14:30:49 -07:00
Frank Bertsch 5c69aca3e1 Add view and explore for event names
- Have explores return many explores
- Only add filters to first explore
2021-06-01 15:35:11 -04:00
William Lachance c6fa7f447f
Bug 1707727 - Publish namespaces.yaml to GitHub alongside generated lookml (#122) 2021-05-20 14:28:29 -07:00
Frank Bertsch 5ea466ff12 Add clarifying comments; import updated lkml file 2021-05-07 10:35:57 -04:00
Frank Bertsch 224489f5b4 Remove print statement
Co-authored-by: William Lachance <wrlach@gmail.com>
2021-05-07 10:35:57 -04:00
Frank Bertsch 1764f41f2d Updated lkml parser to handle explore query fields
Explore query fields have pluralized fields that lkml
expects to unnest into non-plural fields. For example,
"dimensions" is a plural field that, in a view, gets
unnested to each constituent dimension.

However, queries don't work that way; we retain the plural,
and keep it nested. We handle that here.
2021-05-07 10:35:57 -04:00
Frank Bertsch 4d4c5fcdf7 Add Client Count View from clients_daily 2021-05-07 10:35:57 -04:00
Frank Bertsch 224f895cf9 Remove print statement 2021-05-06 21:03:49 -04:00
Frank Bertsch db8ee74499 Make Glean data reliable for Fenix
- Show metrics without categories under Glean
- Add Fenix to allowlist
- Ignore duplicate metrics
2021-05-06 21:03:49 -04:00
Frank Bertsch 2edcc420a1 WIP: Put glean metrics in categories 2021-05-06 21:03:49 -04:00
Frank Bertsch e23d805ea1 Fix links with namespace filled-in 2021-05-05 13:33:50 -04:00
Frank Bertsch 717ff58f5d Use consistent method to gather views
- Remove runner from lookml tests
- Rebase changes; apply to TableView
2021-05-04 21:39:49 -04:00
William Lachance b6a99d0278 Fix 2021-05-04 21:39:49 -04:00
William Lachance bd62567a78 Ignore all the things 2021-05-04 21:39:49 -04:00
William Lachance 21068ff32a Hopefully fix type issue 2021-05-04 21:39:49 -04:00
William Lachance ef8f9172b4 More CI fixes 2021-05-04 21:39:49 -04:00
William Lachance bc01cd93db updates 2021-05-04 21:39:49 -04:00
William Lachance 4a54afecd7 Generate glean dictionary links for metric columns in pings (fixes #64)
This also adds Glean Ping Views and Explores, which fixes #67.
2021-05-04 21:39:49 -04:00
William Lachance 9b1ee49196
Use uppercase for view and explore types constants (#73) 2021-04-30 12:31:29 -04:00
Frank Bertsch 659ae2d155 Require date and channel filters in ping explores 2021-04-29 15:02:14 -04:00
Frank Bertsch 3154d13dc9 Generate LookML For growth_accounting 2021-04-19 17:04:54 -04:00
Frank Bertsch 8bc8be6b32 Generate LookML inside View classes 2021-04-19 17:04:54 -04:00
Frank Bertsch be0d398121 WIP: Use classes in lookml generation 2021-04-19 17:04:54 -04:00
Frank Bertsch daba1d38e4 Change view defns for tests and code 2021-04-15 21:43:32 -04:00
Frank Bertsch 55608b4297 Dont try and create explores for ga 2021-04-15 21:43:32 -04:00
Daniel Thorn 5a702a7d38
Generate views via lkml (#26) 2021-03-23 09:27:28 -07:00
Frank Bertsch 25ed1c724c Generate explores for Ping Tables
- Use lkml for lookml generation / comparison
- Add some logging about generation
2021-03-22 17:19:15 -04:00
Daniel Thorn 8d62e03705
Parameterize sql_table_name with channel (#16) 2021-03-16 13:38:06 -07:00
Daniel Thorn 199a8640c2
Fail lookml generation for duplicate dimensions and measures (#17) 2021-03-16 13:03:46 -07:00
Daniel Thorn d5664ac40e
Add cli command to generate view lookml from namespaces.yaml (#12) 2021-03-15 14:49:32 -07:00