Граф коммитов

4 Коммитов

Автор SHA1 Сообщение Дата
Evgeny Pavlov 7d97b53ec9
Add profiles deletion job (#11)
* Add profiles deletion job

* Fix comments
2021-04-09 11:06:10 -07:00
Victor Ng a20f214b44 Add google-cloud-storage to container 2020-07-20 13:03:11 -04:00
Victor Ng 388811080b
Convert all ETL jobs to use only GCS instead of S3 (#8)
* Migrate taar_update_whitelist from S3 to GCS

* Migrate taar_amodump AMO database extraction from S3 to GCS

* Add requests_toolbelt for addon extraction

* Delete AWS enviroment configuration

* Convert extended_addons_database.json to bz2

* Convert taarlite addon lists to bz2

* Convert only_guids_top_200 to bz2

* Convert taar_lite_guidguid to only use GCS

* Repoint README to GCS from S3

* TAAR-lite job is handled by telemetry-airflow/jobs

* Add instructions to get the container image
2020-07-20 12:12:41 -04:00
Victor Ng 70dae94035 Added support for TAAR profiles from Cloud BigTable 2020-06-22 12:37:54 -04:00