a218f9a69e
Add default value for channel selector
2021-05-12 10:33:03 -04:00
70fcb2cc65
Remove allowlist from content generator
2021-05-11 21:55:21 -04:00
5c7037f3b2
Put new owners in namespaces.yaml
2021-05-11 21:55:21 -04:00
a6e809f04c
Pluralize file name
2021-05-11 21:55:21 -04:00
67606c2c18
Change name to namespace-allowlist
2021-05-11 21:55:21 -04:00
d4ea32a553
Apply suggestions from code review
...
Co-authored-by: Daniel Thorn <dthorn@mozilla.com>
2021-05-11 21:55:21 -04:00
d4763dad77
Add optional owners section to namespace_allowlist
2021-05-11 21:55:21 -04:00
b411fd2d04
Fix spurious comma in growth accounting measure
2021-05-07 12:08:53 -04:00
5ea466ff12
Add clarifying comments; import updated lkml file
2021-05-07 10:35:57 -04:00
224489f5b4
Remove print statement
...
Co-authored-by: William Lachance <wrlach@gmail.com>
2021-05-07 10:35:57 -04:00
1764f41f2d
Updated lkml parser to handle explore query fields
...
Explore query fields have pluralized fields that lkml
expects to unnest into non-plural fields. For example,
"dimensions" is a plural field that, in a view, gets
unnested to each constituent dimension.
However, queries don't work that way; we retain the plural,
and keep it nested. We handle that here.
2021-05-07 10:35:57 -04:00
1e8fd8d21e
Rename to ClientCountsView
2021-05-07 10:35:57 -04:00
d9f63a3980
Add client_counts explore
...
- Use common filter expressions derived from views
2021-05-07 10:35:57 -04:00
4d4c5fcdf7
Add Client Count View from clients_daily
2021-05-07 10:35:57 -04:00
172411829d
Add client_id comment; log for missing v1_name
2021-05-06 21:03:49 -04:00
224f895cf9
Remove print statement
2021-05-06 21:03:49 -04:00
db8ee74499
Make Glean data reliable for Fenix
...
- Show metrics without categories under Glean
- Add Fenix to allowlist
- Ignore duplicate metrics
2021-05-06 21:03:49 -04:00
554120694b
Hide Glean core fields
...
- Fix suffix for non-category fields
2021-05-06 21:03:49 -04:00
c312a47a42
Dont require client_id field in ping view
2021-05-06 21:03:49 -04:00
80ab1aee7a
Add additional metric types
2021-05-06 21:03:49 -04:00
2edcc420a1
WIP: Put glean metrics in categories
2021-05-06 21:03:49 -04:00
e23d805ea1
Fix links with namespace filled-in
2021-05-05 13:33:50 -04:00
f545460ce6
Add links to generated measures
2021-05-05 13:33:50 -04:00
dedc798317
Remove print statements
2021-05-05 13:33:50 -04:00
dff7e39edd
Add test for metric ping
2021-05-05 13:33:50 -04:00
5cd60d4401
Refactor client id field and add sum/client counts to measures
2021-05-05 13:33:50 -04:00
4db7a7c295
Break up loop for adding measures
2021-05-05 13:33:50 -04:00
717ff58f5d
Use consistent method to gather views
...
- Remove runner from lookml tests
- Rebase changes; apply to TableView
2021-05-04 21:39:49 -04:00
b6a99d0278
Fix
2021-05-04 21:39:49 -04:00
bd62567a78
Ignore all the things
2021-05-04 21:39:49 -04:00
21068ff32a
Hopefully fix type issue
2021-05-04 21:39:49 -04:00
5f75b70720
More fixes
2021-05-04 21:39:49 -04:00
6e5d6dda0b
Remove unused variable
2021-05-04 21:39:49 -04:00
ef8f9172b4
More CI fixes
2021-05-04 21:39:49 -04:00
32485be75d
Fix more test failures
2021-05-04 21:39:49 -04:00
bc01cd93db
updates
2021-05-04 21:39:49 -04:00
4a54afecd7
Generate glean dictionary links for metric columns in pings ( fixes #64 )
...
This also adds Glean Ping Views and Explores, which fixes #67 .
2021-05-04 21:39:49 -04:00
ed8172f4a6
Allow for special chars in filter expressions
2021-05-04 12:22:18 -04:00
c134e57a9a
Fix always_filters syntax
2021-05-03 20:37:37 -04:00
8f433fa4bd
Add TableView to tables
...
A TableView simply exposes a raw table, with no measures.
Eventually we will import this instead of re-generating
all dimensions multiple times.
2021-05-03 19:13:15 -04:00
043b75c02d
Add generated models to user_spokes model set
2021-04-30 14:06:28 -04:00
9b1ee49196
Use uppercase for view and explore types constants ( #73 )
2021-04-30 12:31:29 -04:00
659ae2d155
Require date and channel filters in ping explores
2021-04-29 15:02:14 -04:00
daa4f93d79
Don't configure model if already exists
2021-04-28 16:18:11 -04:00
acdfcf03b7
Updates to `namespaces.yaml`
...
- Use pretty_name instead of canonical_app_name
- Add `glean_app` to indicate a namespace is glean
2021-04-28 10:53:44 -04:00
67975da24c
Move explores and views to directory
...
This should make it easier to move around this repo.
2021-04-26 16:36:06 -04:00
6c3fee7120
Fix missing gitkeep file for dashboards
2021-04-26 16:30:12 -04:00
70976e3f55
Add model to model set
2021-04-22 14:32:42 -04:00
a7664a1ff5
Fix filter syntax for lkml
...
See: https://github.com/joshtemple/lkml/issues/52
2021-04-22 14:32:42 -04:00
bf6fd92355
Configure models after creation
2021-04-22 14:32:42 -04:00
bfbd6daff5
Configure model after creation
2021-04-22 14:32:42 -04:00
8e55d9dba9
WIP: configure models
2021-04-22 14:32:42 -04:00
785d175ae1
Add utility func for id access
...
- Add logs for API access
2021-04-20 14:45:13 -04:00
b81016beee
Add tests and fix mypy errors
2021-04-20 14:45:13 -04:00
a2781b1f9b
Add owners as edit access
2021-04-20 14:45:13 -04:00
e048f92c3b
Add owners to namespaces
2021-04-20 14:45:13 -04:00
e90b51db8b
Generate folders for namespaces
2021-04-20 14:45:13 -04:00
4e23d591db
Address review feedback
2021-04-19 17:04:54 -04:00
3154d13dc9
Generate LookML For growth_accounting
2021-04-19 17:04:54 -04:00
8bc8be6b32
Generate LookML inside View classes
2021-04-19 17:04:54 -04:00
be0d398121
WIP: Use classes in lookml generation
2021-04-19 17:04:54 -04:00
88e0330770
Finalize container and script to publish LookML
2021-04-19 13:50:45 -04:00
2bdfe7a62e
Allow for empty custom-namespaces
2021-04-19 13:50:45 -04:00
085c868c56
Include allowlist to prune namespaces
...
We're working with Looker on a problem with the large deploys
of LookML: see bug 1705700.
We work around that here by introducing an allowlist.
2021-04-19 13:31:00 -04:00
ffa13e2ddd
Generate gitkeep files for dirs
2021-04-19 13:28:25 -04:00
019da51cdc
CLI for update spoke with new namespaces
2021-04-19 13:28:25 -04:00
536b5cdec9
Update generator/views.py
...
Co-authored-by: Daniel Thorn <dthorn@mozilla.com>
2021-04-15 21:43:32 -04:00
daba1d38e4
Change view defns for tests and code
2021-04-15 21:43:32 -04:00
55608b4297
Dont try and create explores for ga
2021-04-15 21:43:32 -04:00
261b993e99
Use view type for key
2021-04-15 21:43:32 -04:00
e1890509ff
Include view type in namespaces.yaml
2021-04-15 21:43:32 -04:00
2788b34170
Return instances of views instead of dicts
...
- Create more functions in namespaces.py
- Add more unit tests
2021-04-15 21:43:32 -04:00
ae4cac541b
Add growth accounting explore
2021-04-15 21:43:32 -04:00
80a4ece40d
Cleanup mypy problems
2021-03-25 08:52:38 -04:00
c90f1f2ad7
Apply suggestions from code review
...
Co-authored-by: Daniel Thorn <dthorn@mozilla.com>
2021-03-25 08:52:38 -04:00
b7c634c5ac
Generate views from View classes
2021-03-25 08:52:38 -04:00
5a702a7d38
Generate views via lkml ( #26 )
2021-03-23 09:27:28 -07:00
25ed1c724c
Generate explores for Ping Tables
...
- Use lkml for lookml generation / comparison
- Add some logging about generation
2021-03-22 17:19:15 -04:00
cef888e86d
Include explore info in namespaces.yaml
2021-03-22 15:07:19 -04:00
0bc5c7f5ad
Differentiate stable and derived views ( #19 )
2021-03-22 15:06:19 -04:00
4ea03e60a3
Make the view blocklist in namespaces.yaml configurable
2021-03-16 13:45:49 -07:00
8d62e03705
Parameterize sql_table_name with channel ( #16 )
2021-03-16 13:38:06 -07:00
199a8640c2
Fail lookml generation for duplicate dimensions and measures ( #17 )
2021-03-16 13:03:46 -07:00
d5664ac40e
Add cli command to generate view lookml from namespaces.yaml ( #12 )
2021-03-15 14:49:32 -07:00
4588f2e750
Expect gzip encoding in probeinfo service response ( #14 )
...
and bypass cloudfront cache
2021-03-11 10:30:01 -08:00
5574341ef7
Generate namespaces.yaml ( #9 )
2021-03-08 13:45:24 -08:00
Frank Bertsch
Anthony Miyaguchi
William Lachance
William Lachance
Daniel Thorn