4a0419fb93
feat: Upgrade to 2.6.3 ( #1789 )
2023-09-07 14:04:40 -04:00
a4d65d1a60
Ctroy replace dataval ( #1790 )
...
* Run replacement data validation job daily at 8 AM
* update link
* turn underscore into dash
2023-09-07 12:55:37 -05:00
e7c4a93b78
Run replacement data validation job daily at 8 AM ( #1788 )
...
* Run replacement data validation job daily at 8 AM
* update link
2023-09-07 10:10:08 -05:00
ec30ba606d
Notify telemetry-alerts@mozilla.com of `probe_scraper` task errors. ( #1787 )
2023-09-05 11:17:52 -07:00
8e27a5bfb4
Change prerelease aggs owner ( #1786 )
...
Committer: Linh Nguyen <linhnguyen@mozilla.com>
On branch change-tmo-owner
Co-authored-by: Linh <linh@LNs-MacBook-Pro.local>
2023-08-30 19:43:22 +02:00
2a76f67cf9
add no_triage tag to clean_gke_pods DAG ( #1784 )
...
* add no_triage tag to clean_gke_pods DAG
* run black
* more linting
* even more linting
2023-08-23 14:03:29 +02:00
b72098352b
fix broken link in search_term_data_validation docstring ( #1783 )
2023-08-21 17:16:31 +02:00
d15c87b143
Add missing serialization for MultiWeekTimetable ( #1782 )
2023-08-15 14:58:17 -07:00
96b51ca071
Import timetable relative to plugins folder ( #1781 )
2023-08-15 13:18:15 -07:00
c443fb32f5
Create custom timetable to run shredder every 4 weeks ( #1771 )
2023-08-14 15:55:39 -07:00
5856924b3c
Revert "DENG 1022 - Update bhr_collection DAG to write to GCS instead of S3 ( #1776 )" ( #1779 )
...
This reverts commit 9fe4b6de23
2023-08-14 10:30:59 -04:00
dd546f9b9b
updated owner from kignasiak to kik for consistency ( #1778 )
2023-08-11 16:08:49 +02:00
336647a861
DENG-1025: gfx export to prod gcs bucket ( #1777 )
2023-08-10 13:05:58 -04:00
6604724736
DENG-1025: gfx_telemetry r/w to GCS instead of S3 (test) ( #1774 )
2023-08-10 10:45:50 -04:00
9fe4b6de23
DENG 1022 - Update bhr_collection DAG to write to GCS instead of S3 ( #1776 )
...
* DENG 1022 - Update bhr_collection DAG to write to GCS instead of S3
* Fix CI issues
2023-08-09 10:01:05 -04:00
cfff0454b7
Replace GCS test bucket with prod bucket ( #1773 )
2023-08-02 11:30:50 -04:00
c69e173c1d
Update orphaning to write to GCS instead of S3 ( #1770 )
2023-08-01 11:25:44 -04:00
58f522a92e
Add actions parameter to android_client_history_sim ( #1769 )
...
* Add actions parameter to android_client_history_sim
* Formatting
* Updated to use flags
* revert changes
2023-07-28 14:31:27 -04:00
3d08bd5753
Don't send email to telemetry-alerts to reduce noise ( #1768 )
2023-07-28 11:25:31 -04:00
bcc5438473
Update glam import img to use fix ( #1767 )
2023-07-27 15:02:09 -04:00
8e861d1371
added more an additional link to bhr pings ( #1766 )
2023-07-26 15:14:58 +02:00
2de1df4083
DENG-1240 - Fix bigquery_dq_check function to accept arguments ( #1759 )
...
* Fix DENG-1240
* fix black check
2023-07-25 10:46:11 -04:00
d1c403df02
Update glam_glean_imports img to support non-norm data ( #1764 )
...
* Update glam_glean_imports img to support non-norm data
* lint fixes
2023-07-24 17:16:34 -04:00
9fd721fc9f
Change schedule interval of bqetl_artifact_deployment ( #1761 )
2023-07-20 09:10:27 +02:00
4de0734605
glam: Non normalized aggregations ( #1721 )
2023-07-19 17:52:31 -04:00
6d1b29c580
Updated - add flask-appbuilder ( #1760 )
2023-07-19 16:41:32 -04:00
cf8041fa10
Undo log removal ( #1756 )
2023-07-13 14:23:34 -05:00
6231446bf9
Update partybal image ( #1757 )
2023-07-13 07:50:04 -07:00
e39b642d3b
Extend timeout for client regen job ( #1755 )
2023-07-10 09:21:53 -04:00
3a3c19908a
Temporarily remove logging from this DAG: ( #1748 )
...
You can see precedent for this solution in this issue record https://github.com/apache/airflow/issues/12136
As well as this similar change https://github.com/mozilla/telemetry-airflow/pull/1615
2023-07-07 13:36:49 -05:00
e01d24b646
Remove spaces; add comma ( #1754 )
2023-07-07 09:58:26 -04:00
a199d308ff
Add owner note to android_client_history_sim doc ( #1753 )
2023-07-07 09:04:51 -04:00
a9a0c872e3
Remove times; add spaces ( #1750 )
2023-07-06 14:00:42 -04:00
f662d11956
Add DAG to regenerate client histories ( #1749 )
...
* Add DAG to regenerate client histories
* Reformat
* Remove str from seed param
* Add defaults for all params
2023-07-06 12:10:05 -04:00
152926013e
Add `no_triage` tag to search_term_data_validation ( #1747 )
2023-07-05 11:42:11 -05:00
3e3acc0f69
feat: Update Airflow to 2.5.3 ( #1742 )
2023-06-28 12:41:31 -04:00
e8ec66cd27
DENG 946 - Add a gcp util to handle the BQ DQ checks ( #1735 )
...
* Add gcp util function to handle dq checks
* Fix CI issues
* rename destination table to source table
* Incorporate feedback
Incorporate feedback
2023-06-28 07:53:05 -04:00
7fb8f66506
Use prod GCS bucket for ensemble export ( #1736 )
2023-06-23 18:52:53 +00:00
c03d800b34
Update owners and bqetl_artifact_deployment docs ( #1741 )
2023-06-22 14:29:46 -07:00
2edb35ea0c
Update schedule ( #1740 )
...
The wait tasks for this DAG were never completing because the DAG was scheduled to start before the upstream tasks.
The upstream DAGs are scheduled to run at `30 4 * * *`. This DAG will now run at `0 5 * * *` and look back 30 minutes for the upstream tasks.
2023-06-22 10:36:01 -07:00
11d9bc357a
Add credentials for sending email to probe scraper glean tasks ( #1739 )
2023-06-22 09:52:06 -07:00
cba4eeb23f
feat: Update to Python 3.10 ( #1737 )
2023-06-22 09:32:19 -04:00
2ac86e68be
Update kpi_forecasting DAG ( #1738 )
2023-06-21 15:45:09 -07:00
a34971d6e6
chore: use PostgreSQL for local environment and update README.md ( #1729 )
2023-06-21 15:03:39 -04:00
94a2208f71
DSRE 1146 ( #1733 )
...
* Fix style in taar DAG
* Use s3 bucket for taar code jar
2023-06-16 20:15:57 +00:00
3d6dee4c9d
updated gsutil command to use correct path for the image ( #1734 )
2023-06-16 08:10:03 +00:00
8ff3885bd0
DSRE 951 2 ( #1732 )
...
* Add crash_symbolification GCS sync
* Add bhr GCS sync
* Add public-data-report GCS sync
* Add graphics-telemetry GCS sync
* Fixup dags for style
* Fix DAG ordering for public data report exports
* Pin cloud-sdk version in gcs sync tasks
2023-06-15 23:04:27 +00:00
5e8e9d1d27
DSRE 951 ( #1728 )
...
* Add temporary s3->GCS sync DAG
* Add s3 sync dependencies
* Switch to per-DAG syncs
* Switch to prod bucket for analysis-output.tmo sync
2023-06-15 17:46:07 +00:00
f636dcb5c5
Update shredder so it can be migrated to the new airflow ( #1731 )
2023-06-14 14:21:06 -07:00
17e0e09332
Add ensemble-transposer to airflow ( #1730 )
2023-06-14 20:54:35 +00:00
Mikaël Ducharme
Chelsea Troy
Sean Rose
Linh Nguyen
Leli
Daniel Thorn
Alekhya
kik-kik
Eduardo Filho
Alexander
Anna Scholtz
Glenda Leonard
Frank Bertsch
akkomar
whd
Brad Ochocki