Anna Scholtz
693cf80851
Fix date filtering in metric definition views ( #921 )
2024-03-19 15:43:59 -07:00
Anna Scholtz
244ec963e5
Generate per-datasource explores for metric definitions ( #865 )
...
* Generate per-datasource explores for metric definitions
* Combine clients daily views with metrics data sources
---------
Co-authored-by: Leli <33942105+lelilia@users.noreply.github.com>
2024-02-12 14:55:11 -08:00
Anna Scholtz
10d8577c55
Metric hub integration ( #740 )
...
* Update to Python 3.10
* Generate metric-hub namespaces
* Generate namespaces for metric hub metrics data sources
* Generate metric hub views
* Generate metric hub explores
* Add command line option to set metric hub repo
* Use client_counts views as basis for metric definition explores
2023-09-08 12:09:06 -07:00
Alexander
f2cfe9e7e5
Generate datagroups.lkml ( #615 )
...
* Moved bigquery view references map to utils for use in multiple places
* Create datagroup generator script
* Added tests
* Formatting: update type reference to include dataset dict
2023-02-21 13:15:50 -05:00
dependabot[bot]
c3db0820ec
Bump lkml from 1.2.0 to 1.3.1 ( #548 )
2022-11-03 11:09:16 -07:00
Anna Scholtz
db7ccdaf4b
Merge pull request #391 from mozilla/opmon-dashboards
...
Opmon dashboards
2022-03-25 11:40:45 -07:00
Anna Scholtz
acc59e256d
File clarification to extend views
...
Co-authored-by: Will Lachance <wlachance@mozilla.com>
2021-12-03 14:41:17 -08:00
Anna Scholtz
4e97a8c5ca
Add comment to generated contents that files are generated
2021-12-03 14:41:17 -08:00
Marina Samuel
8816f01cff
Support submission_date on x-axis in operational monitoring.
2021-11-29 13:11:13 -05:00
Marina Samuel
a55120e6c6
Add aggregate tables to speed up operational monitoring dashboards.
2021-11-16 11:29:54 -05:00
Marina Samuel
98ef40718a
Add auto-generated opmon dashboards.
2021-10-19 13:36:02 -04:00
Daniel Thorn
5a29dde6b9
Remove workaround for joshtemple/lkml#53 ( #237 )
2021-09-20 11:45:22 -07:00
William Lachance
aec929b8c5
Generate descriptions for Glean Ping explores ( fixes #106 ) ( #143 )
...
Format should be `Explore for <x> ping. <x ping description>`. For
example, for the metrics ping, you would see:
```
Explore for the metrics ping. The metrics ping is intended for all of
the metrics that are explicitly set by the application or are included
in the application's metrics.yaml file (except events). The reported
data is tied to the ping's measurement window, which is the time
between the collection of two metrics ping. Ideally, this window is
expected to be about 24 hours, given that the collection is scheduled
daily at 4AM. Data in the ping_info section of the ping can be used to
infer the length of this window.
```
2021-06-02 14:30:49 -07:00
Frank Bertsch
5c69aca3e1
Add view and explore for event names
...
- Have explores return many explores
- Only add filters to first explore
2021-06-01 15:35:11 -04:00
William Lachance
c6fa7f447f
Bug 1707727 - Publish namespaces.yaml to GitHub alongside generated lookml ( #122 )
2021-05-20 14:28:29 -07:00
Frank Bertsch
5ea466ff12
Add clarifying comments; import updated lkml file
2021-05-07 10:35:57 -04:00
Frank Bertsch
224489f5b4
Remove print statement
...
Co-authored-by: William Lachance <wrlach@gmail.com>
2021-05-07 10:35:57 -04:00
Frank Bertsch
1764f41f2d
Updated lkml parser to handle explore query fields
...
Explore query fields have pluralized fields that lkml
expects to unnest into non-plural fields. For example,
"dimensions" is a plural field that, in a view, gets
unnested to each constituent dimension.
However, queries don't work that way; we retain the plural,
and keep it nested. We handle that here.
2021-05-07 10:35:57 -04:00
Frank Bertsch
4d4c5fcdf7
Add Client Count View from clients_daily
2021-05-07 10:35:57 -04:00
Frank Bertsch
224f895cf9
Remove print statement
2021-05-06 21:03:49 -04:00
Frank Bertsch
db8ee74499
Make Glean data reliable for Fenix
...
- Show metrics without categories under Glean
- Add Fenix to allowlist
- Ignore duplicate metrics
2021-05-06 21:03:49 -04:00
Frank Bertsch
2edcc420a1
WIP: Put glean metrics in categories
2021-05-06 21:03:49 -04:00
Frank Bertsch
e23d805ea1
Fix links with namespace filled-in
2021-05-05 13:33:50 -04:00
Frank Bertsch
717ff58f5d
Use consistent method to gather views
...
- Remove runner from lookml tests
- Rebase changes; apply to TableView
2021-05-04 21:39:49 -04:00
William Lachance
b6a99d0278
Fix
2021-05-04 21:39:49 -04:00
William Lachance
bd62567a78
Ignore all the things
2021-05-04 21:39:49 -04:00
William Lachance
21068ff32a
Hopefully fix type issue
2021-05-04 21:39:49 -04:00
William Lachance
ef8f9172b4
More CI fixes
2021-05-04 21:39:49 -04:00
William Lachance
bc01cd93db
updates
2021-05-04 21:39:49 -04:00
William Lachance
4a54afecd7
Generate glean dictionary links for metric columns in pings ( fixes #64 )
...
This also adds Glean Ping Views and Explores, which fixes #67 .
2021-05-04 21:39:49 -04:00
William Lachance
9b1ee49196
Use uppercase for view and explore types constants ( #73 )
2021-04-30 12:31:29 -04:00
Frank Bertsch
659ae2d155
Require date and channel filters in ping explores
2021-04-29 15:02:14 -04:00
Frank Bertsch
3154d13dc9
Generate LookML For growth_accounting
2021-04-19 17:04:54 -04:00
Frank Bertsch
8bc8be6b32
Generate LookML inside View classes
2021-04-19 17:04:54 -04:00
Frank Bertsch
be0d398121
WIP: Use classes in lookml generation
2021-04-19 17:04:54 -04:00
Frank Bertsch
daba1d38e4
Change view defns for tests and code
2021-04-15 21:43:32 -04:00
Frank Bertsch
55608b4297
Dont try and create explores for ga
2021-04-15 21:43:32 -04:00
Daniel Thorn
5a702a7d38
Generate views via lkml ( #26 )
2021-03-23 09:27:28 -07:00
Frank Bertsch
25ed1c724c
Generate explores for Ping Tables
...
- Use lkml for lookml generation / comparison
- Add some logging about generation
2021-03-22 17:19:15 -04:00
Daniel Thorn
8d62e03705
Parameterize sql_table_name with channel ( #16 )
2021-03-16 13:38:06 -07:00
Daniel Thorn
199a8640c2
Fail lookml generation for duplicate dimensions and measures ( #17 )
2021-03-16 13:03:46 -07:00
Daniel Thorn
d5664ac40e
Add cli command to generate view lookml from namespaces.yaml ( #12 )
2021-03-15 14:49:32 -07:00