Граф коммитов

76 Коммитов

Автор SHA1 Сообщение Дата
Brandon Myers 11ac4dd835
Update files that were diff between two repos 2017-06-15 15:14:57 -05:00
Brandon Myers fa8e3d4cc3
Expand query_models into separate folder 2017-06-15 15:07:43 -05:00
Brandon Myers 9e734175e7
Add SNS SQS mq worker 2017-06-15 15:07:30 -05:00
Brandon Myers 42e34c65fc
Add state file with tests 2017-06-15 15:07:19 -05:00
Brandon Myers 5d197bfe91
Create events weekly alias 2017-06-15 15:06:33 -05:00
Brandon Myers a069616358
Add check if ip list contains less than certain ips
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:56 -05:00
Brandon Myers ab00d7065b
Add utility logger for cron
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:55 -05:00
Brandon Myers c7b1e934b4
Update location of geolitecity data file
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:40 -05:00
Brandon Myers 062fbc911b
Add missing specs to es client
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:33 -05:00
Brandon Myers 58fcb8b6f8
Modify search query to match on receivedtimestamp in addition
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:32 -05:00
Brandon Myers 6667267e18
Add customizable document type to es client
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:06 -05:00
Brandon Myers 11ba5cde1f
Parse as json if document is string
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:05:05 -05:00
Brandon Myers 3f7352936e
Remove unused lib files
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:04:55 -05:00
Brandon Myers ec5d1ad5b7
Keep in sync with qa1 #70
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:04:54 -05:00
Brandon Myers 8895fed1e9
Remove pyes_enabled references in codebase
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:42 -05:00
Brandon Myers e43fe3c323
Replace kibana-int with .kibana as index
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:40 -05:00
Brandon Myers 2d79e07679
Change cpu usage to cpu percent
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:40 -05:00
Brandon Myers e0c93a5cd0
Default to DSL instead of pyes
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:39 -05:00
Brandon Myers 8e4424e36c
Wrap pyes import with if statement
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:39 -05:00
Brandon Myers 71692067cc
Add error support plus tests to bulk import
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:38 -05:00
Brandon Myers 43755b2580
Add bulk support to elasticsearch client
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:38 -05:00
Brandon Myers 59ede33b59
Add initial swing at BulkQueue
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:37 -05:00
Brandon Myers 13f2764ef8
Add aggregation size functionality
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:36 -05:00
Brandon Myers 4031c431d9
Add ES2 tests for elasticsearch client
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:36 -05:00
Brandon Myers 14013b9f84
Remove hardcoded alias
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:36 -05:00
Brandon Myers 9655ea740c
Add tests for creating aliases
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:36 -05:00
Brandon Myers aa7562c876
Change create alias to set alias
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:35 -05:00
Brandon Myers dae49eadde
Remove lower term match value
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:35 -05:00
Brandon Myers ac0217f373
Update default timezone to UTC
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:35 -05:00
Brandon Myers fb5a8fcb50
Switch from MultiMatch to QueryStringMatch in crons
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:33 -05:00
Brandon Myers ccebf7344d
Add unit test support for query should param
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:33 -05:00
Brandon Myers b8f9aa8d10
Add size to search query
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:33 -05:00
Brandon Myers 46fd487ee6
Fixup healthToMongo with health stats in ES
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:28 -05:00
Brandon Myers 51b9c1fefe
Add get_indices() to ES client with test
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:03:28 -05:00
Brandon Myers 6caaad320d
Remove duplicate definitions of toUTC
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:02:46 -05:00
Brandon Myers ff4260f879
Configure rest api to handle no kibana index
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:02:10 -05:00
Brandon Myers e832b313ee
Fix flush_bulk for pyes only
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:02:01 -05:00
Brandon Myers 76174add7d
Update mq directory with search class
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:02:01 -05:00
Brandon Myers 7b14fcef69
Update rest api with tests
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:01:24 -05:00
Brandon Myers 7ccf36f75c
Update alert specs for new event format
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:01:24 -05:00
Brandon Myers 1e14ca0ce8
Add aggregation to search query
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:01:23 -05:00
Brandon Myers 5631e494de
Add unit tests for some rest routes
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:01:23 -05:00
Brandon Myers 8faad73d0b
Move toUTC into lib utilities
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:01:22 -05:00
Brandon Myers 93d717dd95
Improve elasticsearch client and query models
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:01:17 -05:00
Brandon Myers 442bdf8257
Switch lib to US/Pacific
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 15:00:47 -05:00
Michal Purzynski 8b63d90c69
Refactor dict2List and clean debug messages. 2017-06-15 14:59:40 -05:00
Brandon Myers b3ef583338
Update leftover files from public repo
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2017-06-15 14:59:39 -05:00
Brandon Myers 1d8c59b93f
Setup codebase for merge of two repos 2017-06-15 14:56:47 -05:00
Brandon Myers d206fa157c Update slapd importer with local timezone
Signed-off-by: Brandon Myers <bmyers@mozilla.com>
2016-07-12 11:22:20 -05:00
Jonathan Claudius 8e1adf57f7
Add claudijd as contributor 2016-05-25 11:37:41 -04:00