mozilla
/
taar
зеркало из https://github.com/mozilla/taar.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
293 коммитов 8 Ветки 47 Теги 7,2 MiB
Граф коммитов

293 Коммитов

Автор SHA1 Сообщение Дата
Victor Ng fe878e03e9 Remove basic auth from taarlite 2020-07-13 13:07:41 -04:00
Victor Ng f88d31b599
Merge taar-lite into main TAAR repository (#173) 
* Merge taar-lite into taar

* Enable API endpoint for TAARlite

* Bump version number and add an amended TAARLITE-README.md

* Added curl instruction for invoking TAARlite

* flake8/black fixes

* Add markus[datadog] for statsd metrics

* Add markus statsd metrics all over TAAR
 2020-07-13 12:50:19 -04:00
Victor Ng 3891419bcb
Fixed typo in markdown for ETL source 2020-07-06 14:22:11 -04:00
Victor Ng b185583d42
Remerge #157 for weighted randomization (#171) 
* Unified patch for #157

* Update ETL job links

Update documentation and removed unnecessary env variables.
Split up some test cases
 2020-07-06 14:19:18 -04:00
Victor Ng 37a3fb7bbb
Use newrelic to startup gunicorn service (#172) 
* Update newrelic dependency and enable newrelic

* Bump taar to 0.5.1
 2020-06-30 15:59:08 -04:00
Victor Ng 316aee7c4f
Update documentation to reflect modern deployment (#170) 2020-06-26 11:42:22 -04:00
Victor Ng fef44f8368 Rename 'dynamo' to 'storage backend' for logging 2020-06-25 12:49:06 -04:00
Victor Ng 4ac0a31afa
Remove AWS Dynamo and port to GCP Cloud BigTable (#169) 
* Add error handling for missing records in BigTable

* Switch from Travis to CircleCI badge

* flake8 fixes
 2020-06-24 21:36:35 -04:00
Victor Ng 0f57bd5072
Add better documentation (#168) 
* Update documentation to reflect prod setup

* dirty commit

* Add stubs for GCP resources

* Add instructions for deletion of user data

* Add link to production YAML configuration

* merged missing docs

* Fill in GCP and Airflow variable information
 2020-06-24 16:51:34 -04:00
Victor Ng e1da916205 Bump from 0.4.5 to revision 0.5.0 and require python 3.7 2020-06-16 16:12:36 -04:00
Victor Ng 5be7a59315 Implement a new GCP BigTable Profile database for TAAR 2020-06-16 16:12:36 -04:00
Victor Ng 41f81c9c31 Modernize bin/run to use miniconda 
Also simplified the use of codecov.io for the test target in bin/run
 2020-06-16 16:12:36 -04:00
Victor Ng efe0baf988 Delete deprecated Dynamo configuration 2020-06-16 16:12:36 -04:00
Victor Ng 3e49cacca7 Update CircleCI to use docker container and miniconda 2020-06-16 16:12:36 -04:00
Victor Ng 3994d24887 Modernize build configuration with miniconda 
Remove travis, docker-compose and tox dependancy
Delete requirements.txt for virtualenv
Add environment.yml for conda
Update Makefile to use conda build container images
 2020-06-16 16:12:36 -04:00
Victor Ng d771ad1d46 updated S3 file location docs 2020-04-27 18:25:26 -04:00
Victor Ng ff4ff1371b Added another test for client_id+addon_id lookup 
Tests now differentiate between failure to find a client_id and
a failure to find an addon for a found client_id.
 2019-04-29 13:40:04 -04:00
Victor Ng 3f8e588f29 Lots of security updates 
* bumped jinja2 and urllib3 per github security
* bumped base python docker image to 3.6.8-stretch as jessie is
  deprecated
* bump up pip to latest version
* bumped version of flake8 and fixed whitespace issues
* dropped Python 2.7 setup as databricks provides a python3 enviroment now
* dropped enviroment.emr required for python2.7 enviroment
* dropped thriftpy
* updated travis.yml to use dockerized tests and flake8
* split tests into coverage and no-coverage versions because travis
* disable coverage plugin for tests in travis until write permissions
  are sorted outa
 2019-04-25 14:48:04 -04:00
Victor Ng 34af9eabd7 added tests for client+addon query for issue 151 2019-04-25 14:48:04 -04:00
Victor Ng b78d821746 patch to enable querying for existence of a (hashed_client_id, addon_id) pair 2019-04-25 14:48:04 -04:00
Mozilla-GitHub-Standards 64569674a2 Add Mozilla Code of Conduct file 
Fixes #153.

_(Message COC002)_
 2019-03-31 18:08:08 -05:00
Victor Ng ce781f99d1 dropped library requirements in setup.py 
Databricks uses it for dependency loading
 2019-03-12 13:16:24 -04:00
Victor Ng bf9375fbac fixed link for ensemble recommender code in README.md 2019-03-11 15:41:03 -04:00
Victor Ng 7110da8f85 lowered logging level for failed client lookups in dynamo 2019-02-21 13:23:34 -05:00
Victor Ng ac4f3a3c26 Reworked the matrix construction in similarity recommender so that a fresh JSON file will force the cached matrices to be recomputed. 
Added tests to verify matrix reconstruction
 2019-02-20 18:28:07 -05:00
Victor Ng 7624fc90a6 default SENTRY_DSN to empty string 2019-02-20 14:26:44 -05:00
Victor Ng b8e9956693 applied black formatting 2019-02-20 14:26:44 -05:00
Victor Ng 2f6c63f718 More logging and safety around the recommend method for each recommender 
I've added an exception handler that forces reload of underlying model in the case of recommendation error.
Extra exception logging occurs if any recommender crashes
 2019-02-20 14:26:44 -05:00
Victor Ng c1df5b1efb Added a force_expiry() method to the JSON loader 2019-02-20 14:26:44 -05:00
Victor Ng bbb7f8b8ef Added sentry integration 2019-02-20 14:26:44 -05:00
Victor Ng 4f84794bcc Merge branch 'master' of github.com:mozilla/taar 2019-02-11 08:51:05 -05:00
Victor Ng abf6b94b7c added thread synchronization as it's possible to mutate the model during 
the model reload
 2019-02-11 08:42:21 -05:00
Victor Ng 40534a0fd4 force collaborative model to be None when the raw_item_matrix JSON 
doesn't load
 2019-02-11 08:42:21 -05:00
Victor Ng 6d79398b56 reworked how the model is reconstructed when new JSON is loaded 2019-02-11 08:42:21 -05:00
Victor Ng 09ff4ac3cb set limit for taar results in test with length 4 2019-02-11 08:42:21 -05:00
Victor Ng 1f7990887a added thread synchronization as it's possible to mutate the model during 
the model reload
 2019-02-11 08:33:30 -05:00
Victor Ng 45e7a67226 force collaborative model to be None when the raw_item_matrix JSON 
doesn't load
 2019-02-11 07:15:32 -05:00
Victor Ng a7181c3618 reworked how the model is reconstructed when new JSON is loaded 2019-02-10 21:46:42 -05:00
Victor Ng 0e252d6b0b set limit for taar results in test with length 4 2019-02-10 21:44:05 -05:00
Victor Ng ec6467a8db added a skip_existing directive for Travis+PyPI 2019-01-29 10:29:37 -05:00
Victor Ng 0921f014f0 bumped to 0.4.3 for a new tag and testing travis deployment 2019-01-29 10:19:32 -05:00
Victor Ng da9ea04e3f bumped travis.yml deployment section 2019-01-29 10:07:50 -05:00
Victor Ng 05712eb9ac bumped version to 0.4.2 2019-01-29 09:42:10 -05:00
Victor Ng eb47dc658c * fixed some spurious flake8 warnings 
* Reworked the LazyS3 loader to accept an optional transform function to
  modify the JSON on load.
* Dropped dead testcase and clarified name for another testcase.
 2019-01-28 15:29:29 -05:00
Victor Ng e509a88299 branched a release for 20190123 2019-01-23 10:08:27 -05:00
Victor Ng 682e08ec19 fix for "F821 undefined name 'unicode'" error when running tox 2019-01-20 20:42:39 -05:00
Victor Ng 24e3d9f0a0 fixed taar.plugin to work with python2.7 2019-01-20 20:42:39 -05:00
Victor Ng 2b7f86f608 reworked the merging of promoted addons so that duplicated GUIDs are not 
reflected in the resultset
 2019-01-20 20:42:39 -05:00
Victor Ng b3c084bfec removed all alternate branches 
removed all colander code
 2019-01-20 20:42:39 -05:00
Victor Ng da5c6a4893 black'd setup.py 2019-01-20 20:42:39 -05:00