fa9e2c8e5d
Bump google-api-core from 1.11.1 to 1.12.0 ( #187 )
...
Bumps [google-api-core](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.11.1 to 1.12.0.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/api_core-1.11.1...storage-1.12.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-19 08:51:06 -07:00
e1a412bcaf
Use FULL JOIN
2019-06-13 09:11:13 -04:00
8353ef862f
Add tier 1 mau to desktop exact_mau28
2019-06-13 09:11:13 -04:00
3bf70c65d8
Use imputed values for desktop KPIs after Armag-add-on
2019-06-13 09:11:13 -04:00
87b9ab9278
Bump google-cloud-core from 1.0.1 to 1.0.2 ( #182 )
...
Bumps [google-cloud-core](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.0.1 to 1.0.2.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/core-1.0.1...core-1.0.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-12 15:18:58 -07:00
47856ec5ea
Bump pytest from 4.5.0 to 4.6.3 ( #180 )
...
Bumps [pytest](https://github.com/pytest-dev/pytest ) from 4.5.0 to 4.6.3.
- [Release notes](https://github.com/pytest-dev/pytest/releases )
- [Changelog](https://github.com/pytest-dev/pytest/blob/4.6.3/CHANGELOG.rst )
- [Commits](https://github.com/pytest-dev/pytest/compare/4.5.0...4.6.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-11 17:41:56 -07:00
9c21cf4eed
Bump pyyaml from 5.1 to 5.1.1 ( #178 )
...
Bumps [pyyaml](https://github.com/yaml/pyyaml ) from 5.1 to 5.1.1.
- [Release notes](https://github.com/yaml/pyyaml/releases )
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES )
- [Commits](https://github.com/yaml/pyyaml/compare/5.1...5.1.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-11 17:33:35 -07:00
2a020adef6
Bump importlib-metadata from 0.17 to 0.18 ( #181 )
...
Bumps [importlib-metadata](http://importlib-metadata.readthedocs.io/ ) from 0.17 to 0.18.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-11 17:31:49 -07:00
62443b1270
Update README.md ( #172 )
2019-06-08 18:05:17 -07:00
6f05e1c1c3
Bump typed-ast from 1.3.5 to 1.4.0 ( #175 )
...
Bumps [typed-ast](https://github.com/python/typed_ast ) from 1.3.5 to 1.4.0.
- [Release notes](https://github.com/python/typed_ast/releases )
- [Changelog](https://github.com/python/typed_ast/blob/master/release_process.md )
- [Commits](https://github.com/python/typed_ast/compare/1.3.5...1.4.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-06 21:45:03 -07:00
c1664574e9
Bump google-cloud-bigquery from 1.13.0 to 1.14.0 ( #176 )
...
Bumps [google-cloud-bigquery](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.13.0 to 1.14.0.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/storage-1.13.0...storage-1.14.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-06 20:39:28 -07:00
7aff7c13c6
create a view of lockbox ios and android events ( #163 )
...
* create a view of lockbox ios and android events
* Update sql/lockbox_mobile_events_v1.sql
Co-Authored-By: Jeff Klukas <jeff@klukas.net>
* Update sql/lockbox_mobile_events_v1.sql
Co-Authored-By: Jeff Klukas <jeff@klukas.net>
* change view name to lockwise
2019-06-05 11:34:38 -07:00
5b2238aa9e
Bump google-cloud-bigquery from 1.12.1 to 1.13.0 ( #169 )
...
Bumps [google-cloud-bigquery](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.12.1 to 1.13.0.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/bigquery-1.12.1...storage-1.13.0 )
2019-06-04 23:25:51 -07:00
db79705465
Smoot tables and views to support GUD
...
These tables will support the exploratory Growth and Usage dashboard
that we will be demo-ing at Whistler.
2019-05-31 08:14:35 -04:00
d8f31e048e
Add udf_active_n_weeks_ago
2019-05-31 08:14:35 -04:00
2d3c87155a
Bump importlib-metadata from 0.15 to 0.17 ( #166 )
...
Bumps [importlib-metadata](http://importlib-metadata.readthedocs.io/ ) from 0.15 to 0.17.
2019-05-30 17:05:39 -07:00
9771299003
Bump pytest-black from 0.3.6 to 0.3.7 ( #165 )
...
Bumps [pytest-black](https://github.com/shopkeep/pytest-black ) from 0.3.6 to 0.3.7.
- [Release notes](https://github.com/shopkeep/pytest-black/releases )
- [Commits](https://github.com/shopkeep/pytest-black/compare/0.3.6...0.3.7 )
2019-05-30 17:03:21 -07:00
f2cce4580d
Bump google-cloud-core from 1.0.0 to 1.0.1 ( #164 )
...
Bumps [google-cloud-core](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/kms-1.0.0...core-1.0.1 )
2019-05-30 17:00:11 -07:00
55f7442871
Bump pytest-black from 0.3.5 to 0.3.6 ( #162 )
...
Bumps [pytest-black](https://github.com/shopkeep/pytest-black ) from 0.3.5 to 0.3.6.
- [Release notes](https://github.com/shopkeep/pytest-black/releases )
- [Commits](https://github.com/shopkeep/pytest-black/compare/0.3.5...0.3.6 )
2019-05-29 18:15:07 -07:00
bfa576b85d
Bump google-api-core from 1.11.0 to 1.11.1 ( #161 )
...
Bumps [google-api-core](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/logging-1.11.0...api_core-1.11.1 )
2019-05-29 18:11:37 -07:00
b14865b08d
Bump protobuf from 3.7.1 to 3.8.0 ( #160 )
...
Bumps [protobuf](https://github.com/protocolbuffers/protobuf ) from 3.7.1 to 3.8.0.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases )
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/master/generate_changelog.py )
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.7.1...v3.8.0 )
2019-05-29 17:56:38 -07:00
b565815ab8
Bump pluggy from 0.11.0 to 0.12.0 ( #158 )
...
Bumps [pluggy](https://github.com/pytest-dev/pluggy ) from 0.11.0 to 0.12.0.
- [Release notes](https://github.com/pytest-dev/pluggy/releases )
- [Changelog](https://github.com/pytest-dev/pluggy/blob/master/CHANGELOG.rst )
- [Commits](https://github.com/pytest-dev/pluggy/compare/0.11.0...0.12.0 )
2019-05-28 09:58:09 -07:00
1b6a442d2f
Bump cachetools from 3.1.0 to 3.1.1 ( #157 )
...
Bumps [cachetools](https://github.com/tkem/cachetools ) from 3.1.0 to 3.1.1.
- [Release notes](https://github.com/tkem/cachetools/releases )
- [Changelog](https://github.com/tkem/cachetools/blob/master/CHANGES.rst )
- [Commits](https://github.com/tkem/cachetools/compare/v3.1.0...v3.1.1 )
2019-05-24 09:30:54 -07:00
377ad2b3b2
Bump urllib3 from 1.24.2 to 1.25.3 ( #156 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 1.24.2 to 1.25.3.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/master/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/1.24.2...1.25.3 )
2019-05-24 09:28:51 -07:00
53b944cc3b
Fixup for #136
2019-05-23 16:58:51 -04:00
5eb134ca86
fixups found while running the deletions
2019-05-23 16:42:08 -04:00
120153dabe
respond to review comments
2019-05-23 16:42:08 -04:00
845fa792c3
Codify archiving of exact mau table
2019-05-23 16:42:08 -04:00
76a8a23e54
Use generate_incremental_table for clients_last_seen backfill
2019-05-23 16:42:08 -04:00
d9669e325a
Add comments on tables that do not exist in BQ
2019-05-23 16:42:08 -04:00
d481d93861
delete from experiments and search_clients_daily datasets
2019-05-23 16:42:08 -04:00
090fce87cb
Better handling for bq tables
2019-05-23 16:42:08 -04:00
b421eeeb11
Correct time range for gs
2019-05-23 16:42:08 -04:00
9970aebd4e
Add delete-from-bq.sh
2019-05-23 16:42:08 -04:00
7c8cbbc0f4
Bug 1550814 Remove data collected during hotfix rollout
...
See https://bugzilla.mozilla.org/show_bug.cgi?id=1550814
2019-05-23 16:42:08 -04:00
b3b5af98f0
Recreate core_clients_last_seen with bit patterns for activity
...
Matches the technique implemented for desktop clients_last_seen in #128 .
2019-05-23 16:05:56 -04:00
6b7d5df05f
Bump googleapis-common-protos from 1.5.10 to 1.6.0 ( #154 )
...
Bumps [googleapis-common-protos](https://github.com/googleapis/googleapis ) from 1.5.10 to 1.6.0.
- [Release notes](https://github.com/googleapis/googleapis/releases )
- [Commits](https://github.com/googleapis/googleapis/commits )
Signed-off-by: dependabot[bot] <support@dependabot.com>
2019-05-23 10:19:35 -07:00
8ce5714562
Add ci token to status badge ( #153 )
2019-05-23 10:17:31 -07:00
3b66fe8591
Apply suggestions from code review
...
Co-Authored-By: Daniel Thorn <dthorn@mozilla.com>
2019-05-22 19:30:11 -04:00
4a632a64e9
Add a test harness for UDFs
...
This is the first stage for addressing #141
With this change, we parse dependencies between UDFs so that each
UDF sql file can contain just a single UDF definition.
Furthermore, we allow additional SQL statements in the file which
will be treated as tests; they should call ERROR to cause
a test to fail.
2019-05-22 19:30:11 -04:00
32cd91c00c
Bump google-cloud-bigquery from 1.12.0 to 1.12.1 ( #150 )
...
Bumps [google-cloud-bigquery](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.12.0 to 1.12.1.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/storage-1.12.0...bigquery-1.12.1 )
Signed-off-by: dependabot[bot] <support@dependabot.com>
2019-05-22 15:31:59 -07:00
e782c5f6ff
Add --destination-table and selectExprs options to export_to_parquet
...
We implemented a view-based solution for creating clients_last_seen
from clients_last_seen_raw in Athena and Presto, but this made the
table unavailable from Spark.
By adding in these options, we can materialize view logic at the
time of writing to Parquet, so that it will be available to all
Parquet consumers.
2019-05-22 14:01:40 -04:00
9c358c8baa
Factor profile days logic into 2 udfs
2019-05-21 20:22:01 -04:00
c6fed78815
Refactor to use days_created_profile_bits
...
Applying the same technique suggested by @relud in #136 to desktop.
2019-05-21 20:22:01 -04:00
8544c6b1e3
Move udf_combine_experiment_days into udf/ dir
2019-05-21 20:22:01 -04:00
b87885bf6c
Add bit patterns for experiment activity
2019-05-21 20:22:01 -04:00
789cabe1b3
Use bit arrays in clients_last_seen
...
This methodology was developed in draft #80
The result here is that `clients_last_seen_v1` becomes a view that should
be compatible with existing usage (it has all the same columns as the existing
table), but also has underlying bit patterns for each usage criterion,
which can be used for calculating engagement, retention, and new profile
metrics (those will be in a later PR).
In the next day or two, there will be similar PRs for nondesktop and FxA.
2019-05-21 20:22:01 -04:00
c36204de2f
Bump google-cloud-bigquery from 1.11.3 to 1.12.0 ( #149 )
...
Bumps [google-cloud-bigquery](https://github.com/GoogleCloudPlatform/google-cloud-python ) from 1.11.3 to 1.12.0.
- [Release notes](https://github.com/GoogleCloudPlatform/google-cloud-python/releases )
- [Changelog](https://github.com/googleapis/google-cloud-python/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GoogleCloudPlatform/google-cloud-python/compare/bigquery-1.11.3...storage-1.12.0 )
Signed-off-by: dependabot[bot] <support@dependabot.com>
2019-05-20 09:29:54 -07:00
155a1561cf
remove null uid filter
2019-05-20 09:24:23 -04:00
b5076f0b94
Update firefox_kpi_dashboard query for missing data
...
The desktop forecast is temporarily frozen, so this query should
follow what's in the forecast and keep desktop data frozen at
2019-05-15 until the forecast reflects new actuals, at which point
it will automatically start pulling in the newer data.
2019-05-20 08:55:31 -04:00
dependabot-preview[bot]
Jeff Klukas
Daniel Thorn
Leif Oines
dependabot[bot]