Граф коммитов

284 Коммитов

Автор SHA1 Сообщение Дата
Sean Rose 832e9ff527
Fix bug with funnel analyses not matching secondary properties (#751)
* Fix bug with funnel analyses not matching secondary properties.

* Don't aggregate null match strings.
2024-08-08 15:28:01 -07:00
Anna Scholtz 64a9f4c76d
Parallelize lookml generation (#1021)
* use dryrun

* Add dryrun

* Update tests to mock dry run

* Have use_cloud_function as parameter

* Pass dryrun instance

* raise DryRunErrors

* Download files from looker-hub

* Review feedback

* Parallelize lookml generation

* Update datagroup tests

* Update tests for multiprocessing usage

* Use FileSystemLoader for loading templates

* Address review feedback

* Review feedback

* Fix repo init
2024-08-06 09:45:55 -07:00
Anna Scholtz 28b4dccaf1
Use dry run function for generation (#1003)
* Add --ignore option when generating namespaces

* use dryrun

* Add dryrun

* Update tests to mock dry run

* Have use_cloud_function as parameter

* Pass dryrun instance

* raise DryRunErrors

* Download files from looker-hub

* Review feedback

* Update generator/lookml.py

Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>

---------

Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
2024-07-29 09:24:50 -07:00
akkomar 21fb9c4736
Allow same names for dimensions and time dimension groups in generated views (#1010) 2024-07-17 11:42:44 +02:00
Anna Scholtz 1357973c9d
Revert "Parallel lookml generation (#994)" (#1000)
This reverts commit 09c4aa9f8e.
2024-06-24 09:34:19 -07:00
Anna Scholtz 09c4aa9f8e
Parallel lookml generation (#994)
* Parallel generation

* Run lookml geneation in parallel

* Parallelism parameter

* Use starmap
2024-06-24 08:10:33 -07:00
Anna Scholtz b398a842f0
Add --only parameter to generate lookml only for select namespaces (#992) 2024-06-11 05:38:49 -07:00
Anna Scholtz e32bc58df2
Prevent duplicate dimensions in metric definitions views (#989) 2024-06-04 08:59:29 -07:00
Anna Scholtz 707b73d628
Update metric-config-parser (#988) 2024-06-03 10:20:08 -07:00
Anna Scholtz 9cb62abe43
Handle columns_as_dimensions for metric definition views (#987) 2024-06-03 08:04:06 -07:00
Anna Scholtz 247d64d2c7
Add running_average statistic for metrics (#984)
* Add running_average statistic for metrics

* Update dependencies
2024-05-29 10:04:28 -07:00
Anna Scholtz feee4038f5
Fix date filters for metrics definitions views (#981) 2024-05-22 11:32:56 -07:00
Anna Scholtz 268bb77111
Update metric definition views to depend on data source joins (#969) 2024-05-21 15:01:53 -07:00
Anna Scholtz 59405c39d8
Generate suggest explores only for specific labeled counters (#976) 2024-05-16 11:20:43 -07:00
wil stuckey 7c987848d9
Remove from event_id dimension in final view (#962) 2024-05-02 11:23:16 -05:00
wil stuckey 3c8063c7bb
DENG-3540 Add `event_id` as a primary key for event view (#960)
* Add `event_id` as a synthetic pk for event view

* ci fix

* Generate an event_id dimension for the final view. Update test.

* comments

* review comments
2024-05-01 14:24:01 -05:00
Sean Rose b5a45b4bd3
Don't suggest including all hub views in the model. (#947)
Including all hub views in the model is unnecessary and slows down LookML validation.
2024-04-09 08:43:05 -07:00
Anna Scholtz e1988d8890
Remove deprecated glean apps (#935)
* Remove namespaces from spoke that no longer exist

* Remove spoke folders for namespaces that have been removed
2024-03-28 12:07:49 -07:00
Anna Scholtz 7cdc2aed51
Auto-remove expired opmon projects (#927) 2024-03-25 15:10:19 -07:00
Anna Scholtz a2e65f4b4c
Support minimal Glean pings (#923)
Co-authored-by: wil stuckey <wil.stuckey@gmail.com>
2024-03-20 15:01:31 -05:00
dependabot[bot] 0b69a14565
Bump black from 23.7.0 to 24.3.0 (#922)
* Bump black from 23.7.0 to 24.3.0

Bumps [black](https://github.com/psf/black) from 23.7.0 to 24.3.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.7.0...24.3.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

* Reformat

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2024-03-20 12:46:11 -07:00
Anna Scholtz 693cf80851
Fix date filtering in metric definition views (#921) 2024-03-19 15:43:59 -07:00
Anna Scholtz 8dec8e41cf
Aliase base fields (#904) 2024-03-04 13:05:16 -08:00
Anna Scholtz 76d0d5a55e
Add more metrics statistics (#896) 2024-03-04 10:46:59 -08:00
Ben Wu 5a2e28259c
[DENG-1908] Auto-import existing explores for new namespaces (#895) 2024-02-28 11:32:36 -05:00
Anna Scholtz 5e34f956ad
Glean ping explores with nested dimensions (#884) 2024-02-21 13:11:13 -08:00
Anna Scholtz fb68d9e03b
Update metric_definitions_view.py (#885)
* Update metric_definitions_view.py

* Update metric_definitions_view.py

* Update metric_definitions_view.py
2024-02-20 14:23:17 -08:00
Anna Scholtz a6b9eda0b3
Fix date filter in generated metric views (#883) 2024-02-20 10:27:22 -08:00
Winnie Chan 030ebbbf88
Changed datagroups to use table storage view (#875) 2024-02-15 09:44:06 -08:00
Anna Scholtz 244ec963e5
Generate per-datasource explores for metric definitions (#865)
* Generate per-datasource explores for metric definitions

* Combine clients daily views with metrics data sources

---------

Co-authored-by: Leli <33942105+lelilia@users.noreply.github.com>
2024-02-12 14:55:11 -08:00
Anna Scholtz 10b1bd1e52
Automatically generate explores for events stream tables (#873) 2024-02-12 11:31:15 -08:00
Arkadiusz Komarzewski b1b740e54b Fix handling firefox_desktop.desktop_installs 2024-01-18 18:34:02 +01:00
akkomar 8f400e4ecc
Fix handling event stream tables (#855)
Follow up to https://github.com/mozilla/lookml-generator/pull/854
2024-01-18 08:05:34 -08:00
Anna Scholtz 75e4302546
Fix handling event stream tables (#854) 2024-01-17 13:36:31 -08:00
Leli 3e524742c0
remove summed cards for group by (#823)
* remove summed cards for group by

* Remove spaces for pivots

---------

Co-authored-by: Anna Scholtz <anna@scholtzan.net>
2023-12-04 09:59:38 -08:00
Anna Scholtz 6810649279
COUNT(DISTINCT ${TABLE}.client_id) in client count views (#808) 2023-11-08 11:40:23 -08:00
Sean Rose d0fb3ac48e
Remove invalid link properties from datetime metric dimension groups in Glean ping views. (#807) 2023-11-08 11:27:54 -08:00
Sean Rose 412675f8fc
Generate time dimension groups for datetime metrics in Glean ping views (#806)
* Generate time dimension groups for datetime metrics in Glean ping views.

  This should have been done when we changed the Glean ping views to convert datetime metrics to timestamps (mozilla/bigquery-etl#3453).
2023-11-08 10:04:51 -08:00
Anna Scholtz 88604bd81b
Metric definition explores ignore have_completed_period field (#785) 2023-10-17 15:06:35 -07:00
Anna Scholtz facc562426
Use Client Counts view as basis for metric definition views (#776) 2023-10-12 13:51:08 -07:00
Anna Scholtz 0f59b880eb
Fix metrics definition generation order (#756) 2023-09-12 11:21:23 -07:00
Anna Scholtz 8498f23130
Use clients_daily views as base for metric definition explores (#753) 2023-09-11 14:49:02 -07:00
Anna Scholtz 10d8577c55
Metric hub integration (#740)
* Update to Python 3.10

* Generate metric-hub namespaces

* Generate namespaces for metric hub metrics data sources

* Generate metric hub views

* Generate metric hub explores

* Add command line option to set metric hub repo

* Use client_counts views as basis for metric definition explores
2023-09-08 12:09:06 -07:00
Sean Rose d709beaa32
Use Looker API 4.0 (#749)
Looker API 3.1 has been disabled by Looker.
2023-09-07 12:04:02 -07:00
Chris H-C 2cc9076284
bug 1843406 - Only display the configured x-axis column in alert grid, for tidiness (#746) 2023-09-06 14:27:40 -07:00
Anna Scholtz 2d15382425
Update to Python 3.10 (#736)
* Update to Python 3.10

* Review comments
2023-08-29 15:41:51 -07:00
Alexander 65ec74a59a
Move includes in spoke model generation to footer comment. (#689)
* Move includes in spoke model generation to header comment.
* Changed to footer
2023-06-08 12:38:20 -04:00
Sean Rose 149e733f8d
Allow `table_view` measures to be defined in `custom-namespaces.yaml` (#686) 2023-06-05 15:35:24 -07:00
Sean Rose e89ccc8dc1
Add `table_explore` explore type (#682) 2023-06-05 08:59:20 -07:00
Jan-Erik Rediger 0512c47840 Fix suggestion filter: Only take existing values 2023-06-05 15:29:45 +02:00