Граф коммитов

66 Коммитов

Автор SHA1 Сообщение Дата
akkomar bb75270f2d
DENG-2407 Allow hiding generated explores (#1074)
* DENG-2407 Allow hiding generated explores

* Add tests
2024-10-02 08:26:07 -07:00
Anna Scholtz 3c007abe05
Set default sampling filter to 1% for metric definiton explores (#1070) 2024-09-25 14:55:27 -07:00
Anna Scholtz 28b4dccaf1
Use dry run function for generation (#1003)
* Add --ignore option when generating namespaces

* use dryrun

* Add dryrun

* Update tests to mock dry run

* Have use_cloud_function as parameter

* Pass dryrun instance

* raise DryRunErrors

* Download files from looker-hub

* Review feedback

* Update generator/lookml.py

Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>

---------

Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
2024-07-29 09:24:50 -07:00
dependabot[bot] 0b69a14565
Bump black from 23.7.0 to 24.3.0 (#922)
* Bump black from 23.7.0 to 24.3.0

Bumps [black](https://github.com/psf/black) from 23.7.0 to 24.3.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.7.0...24.3.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

* Reformat

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2024-03-20 12:46:11 -07:00
Anna Scholtz 693cf80851
Fix date filtering in metric definition views (#921) 2024-03-19 15:43:59 -07:00
Anna Scholtz 5e34f956ad
Glean ping explores with nested dimensions (#884) 2024-02-21 13:11:13 -08:00
Anna Scholtz 244ec963e5
Generate per-datasource explores for metric definitions (#865)
* Generate per-datasource explores for metric definitions

* Combine clients daily views with metrics data sources

---------

Co-authored-by: Leli <33942105+lelilia@users.noreply.github.com>
2024-02-12 14:55:11 -08:00
Anna Scholtz 10b1bd1e52
Automatically generate explores for events stream tables (#873) 2024-02-12 11:31:15 -08:00
Anna Scholtz 88604bd81b
Metric definition explores ignore have_completed_period field (#785) 2023-10-17 15:06:35 -07:00
Anna Scholtz facc562426
Use Client Counts view as basis for metric definition views (#776) 2023-10-12 13:51:08 -07:00
Anna Scholtz 8498f23130
Use clients_daily views as base for metric definition explores (#753) 2023-09-11 14:49:02 -07:00
Anna Scholtz 10d8577c55
Metric hub integration (#740)
* Update to Python 3.10

* Generate metric-hub namespaces

* Generate namespaces for metric hub metrics data sources

* Generate metric hub views

* Generate metric hub explores

* Add command line option to set metric hub repo

* Use client_counts views as basis for metric definition explores
2023-09-08 12:09:06 -07:00
Anna Scholtz 2d15382425
Update to Python 3.10 (#736)
* Update to Python 3.10

* Review comments
2023-08-29 15:41:51 -07:00
Sean Rose e89ccc8dc1
Add `table_explore` explore type (#682) 2023-06-05 08:59:20 -07:00
Jan-Erik Rediger dd756e470f Use a channel filter instead of a parameter switching out the table
The parameter switched out the underlying table to be queried.
However we now have UNIONed tables for every variant of an application,
making the first table contain data from all channels.
Instead we now filter by `normalized_channel` and enforce that filter in explores.
2023-06-05 11:08:29 +02:00
Anna Scholtz 50de83fc00
Update opmon generation to use statistic tables (#523) 2022-09-20 10:23:19 -07:00
Anna Scholtz 860c6340ca
Opmon compact visualization (#483)
* OpMon single probe view

* Hide opmon explores by default

* Generate single tile for compact opmon dashboard representation
2022-07-07 10:53:41 -07:00
Anna Scholtz 3180b335a7
Remove opmon aggregate tables (#475) 2022-06-27 14:56:14 -07:00
Daniel Thorn 792d6ecf9f
Only reference app_build in client counts explore if available (#451)
and reference time_partitioning_field instead of a static submission_date
2022-05-26 10:19:12 -07:00
Daniel Thorn f24ff3041f
Add support for time partitioning fields other than submission_date (#450) 2022-05-25 14:58:06 -07:00
Anna Scholtz e1af5bc9e0
OpMon alerting (#447) 2022-05-18 13:25:36 -07:00
Anna Scholtz db7ccdaf4b
Merge pull request #391 from mozilla/opmon-dashboards
Opmon dashboards
2022-03-25 11:40:45 -07:00
Anna Scholtz 471d9f9cac Default event_counts naming 2022-01-24 10:02:34 -08:00
Anna Scholtz 793b3c92a1 Fix event explore naming 2022-01-24 08:55:18 -08:00
Anna Scholtz 5947fa91ac Check if default dimension exists when adding opmon filters 2021-12-07 12:27:56 -05:00
Marina Samuel 43e8e44c7a Fix sql_trigger_value. 2021-12-06 14:53:40 -05:00
Anna Scholtz f92caeb6ed Use slug_to_title utility method for creating Looker labels 2021-12-06 11:01:39 -08:00
Anna Scholtz 90b3f46ab5 Repeated nested field support for all explores 2021-12-06 11:01:39 -08:00
Marina Samuel ba681a8b52 Aggregate tables should be created after the ETL runs. 2021-12-02 09:38:45 -05:00
Marina Samuel 8816f01cff Support submission_date on x-axis in operational monitoring. 2021-11-29 13:11:13 -05:00
Marina Samuel a55120e6c6 Add aggregate tables to speed up operational monitoring dashboards. 2021-11-16 11:29:54 -05:00
Marina Samuel 98ef40718a Add auto-generated opmon dashboards. 2021-10-19 13:36:02 -04:00
Anna Scholtz 3cd0af61a5 Add clarifications to nested view generation 2021-10-12 11:00:08 -07:00
Anna Scholtz c9814249d9 Nested fields for ping explores 2021-10-12 11:00:08 -07:00
Anna Scholtz 9b4f99f609 Update tests 2021-10-12 11:00:08 -07:00
Anna Scholtz 833c11769d Generate ping explores with joins 2021-10-12 11:00:08 -07:00
Marina Samuel 85de0a5c0c Add Operational Monitoring Views and Explores 2021-10-05 12:16:00 -04:00
Anna Scholtz 934240e16a Revert "Add examples to Ping explore and Glean ping explore"
This reverts commit 388f09b6c8.
2021-08-31 09:09:17 -07:00
Anna Scholtz 388f09b6c8 Add examples to Ping explore and Glean ping explore 2021-08-17 10:26:02 -07:00
Frank Bertsch 8db3ebc21e Add fxa namespace 2021-06-25 09:38:28 -04:00
Frank Bertsch 536c0909c6 Add from_dict method 2021-06-24 10:19:31 -04:00
Frank Bertsch ef9081115e Add event counts view 2021-06-24 10:19:31 -04:00
Anthony Miyaguchi d54af3a23a
Add unnested labeled counter to glean ping explores (#139)
* Add unnested label view

* Add hidden dimension for labeled counter (probably unnecessary)

* Add measures to separate view (broken because of circular dependencies)

* Move unnested view logic into glean ping directly

* Add explore logic to expose join views in explore

* Add test for labeled counter view

* Add description to view

* Break gigantic test for lookml into smaller tests

* Remove extra semicolons and description from view

* Remove duplicate values from explore/view

* Update _to_lookml for API changes

* Add looker suggest explores

* Update tests for suggest explores and new labels

* Use client id as primary key for joins

* Join using document_id as primary key

* Update tests for document id as primary key

* Fix description from rebase

* Address review: longer time period for labels

* Remove document id primary key

* Revert "Remove document id primary key"

This reverts commit 242913c241.

* Sort views in the correct order

* Reduce suggest time to 30 days
2021-06-04 09:54:18 -04:00
William Lachance aec929b8c5
Generate descriptions for Glean Ping explores (fixes #106) (#143)
Format should be `Explore for <x> ping. <x ping description>`. For
example, for the metrics ping, you would see:

```
Explore for the metrics ping. The metrics ping is intended for all of
the metrics that are explicitly set by the application or are included
in the application's metrics.yaml file (except events). The reported
data is tied to the ping's measurement window, which is the time
between the collection of two metrics ping. Ideally, this window is
expected to be about 24 hours, given that the collection is scheduled
daily at 4AM. Data in the ping_info section of the ping can be used to
infer the length of this window.
```
2021-06-02 14:30:49 -07:00
Frank Bertsch 1a53b788bc Add description to explore 2021-06-01 15:35:11 -04:00
Frank Bertsch 7104acda4c Rename dimensions
- Rename user-day counts to just counts
- Rename event_type_N to just step_N
2021-06-01 15:35:11 -04:00
Frank Bertsch 5c69aca3e1 Add view and explore for event names
- Have explores return many explores
- Only add filters to first explore
2021-06-01 15:35:11 -04:00
Frank Bertsch 26e4348ded Create LookML for explore 2021-06-01 15:35:11 -04:00
Frank Bertsch 1a1e9b1ba0 Remove joined views from funnel_analysis explore 2021-06-01 15:35:11 -04:00
Frank Bertsch 0783b7c46e Get LookML for views
- Fix test cases for namespaces
- Add new file for testing funnels
2021-06-01 15:35:11 -04:00