Граф коммитов

514 Коммитов

Автор SHA1 Сообщение Дата
Brandon Myers 34ab0000ec
Resolve E116 unexpected indentation in comments 2018-10-30 17:30:02 -05:00
Brandon Myers 2f885bf98e
Remove details.apiversion from default mapping 2018-10-29 11:50:31 -05:00
Brandon Myers 044e9388a7
Fix generic alerts cron script 2018-10-26 13:20:10 -05:00
Brandon Myers 0b790a94a6
Update missing virtualenv path change 2018-10-24 13:09:51 -05:00
Brandon Myers 663fd76ab2
Merge remote-tracking branch 'origin/infosec_workweek' into virtualenv_path_change 2018-10-24 13:05:30 -05:00
andrewkrug 7c72f1bb69
remove blanket exception handling 2018-10-19 14:05:56 -07:00
Jeff Bryner 6552998a2e no hostname in a managed ES 2018-10-19 13:00:51 -07:00
Zack Mullaly 13a6c7401b Replace all the imports to use mozdef_util 2018-10-16 12:45:04 -07:00
Brandon Myers 6456b8eddb
Merge remote-tracking branch 'origin/master' into fix_pep8_errors 2018-10-08 16:20:32 -04:00
Brandon Myers cd4ac1b733
Merge pull request #765 from mozilla/remove_e271
Remove unnecessary spaces after keyword
2018-10-08 16:16:02 -04:00
Brandon Myers 235af28af6
Merge pull request #764 from mozilla/fix_w601
Fix w601 pep8 error
2018-10-08 16:15:39 -04:00
Brandon Myers 5428a40110
Fixup inline comments 2018-10-05 18:02:04 -04:00
Brandon Myers ef4930603f
Fixup blank line at end of file 2018-10-05 17:52:13 -04:00
Brandon Myers 82f88cf5aa
Fixup blank lines with whitespace 2018-10-05 17:51:09 -04:00
Brandon Myers 20bc4a6aba
Remove trailing whitespace 2018-10-05 17:47:49 -04:00
Brandon Myers 7689ea0d20
Remove too many blank lines 2018-10-05 17:46:00 -04:00
Brandon Myers 7f149fad15
Remove whitespace before single quote 2018-10-05 17:39:44 -04:00
Brandon Myers c255c94c67
Remove whitespace before parenthesis 2018-10-05 17:37:47 -04:00
Brandon Myers 06f0e78c5a
Remove whitespace after parenthesis 2018-10-05 17:34:36 -04:00
Brandon Myers 72e5f690a6
Remove unnecessary spaces after keyword 2018-10-05 16:51:12 -04:00
Brandon Myers 291a99d0eb
Remove deprecated has_key function 2018-10-05 16:22:49 -04:00
Brandon Myers 1bbf4ef129
Remove facebook threatexchange support 2018-10-04 12:43:10 -04:00
Brandon Myers 1065a06c29
Remove unused ssh fingerprints cron script 2018-09-25 13:41:52 -05:00
A Smith 44c38e2324
Merge pull request #731 from Phrozyn/sqs_queue_status
Adding sqs_queue_status script to cron
2018-08-28 17:02:24 -04:00
A Smith 6283bb6266
Merge pull request #723 from Phrozyn/mozdefhealth_index
Mozdefhealth index - initial review
2018-08-28 17:02:12 -04:00
Phrozyn 9989590b0b
small corrections to if statements for index_exists. 2018-08-17 09:46:31 -05:00
Phrozyn b15927025e
Merge branch 'mozdefhealth_index' of https://github.com/Phrozyn/MozDef into mozdefhealth_index 2018-08-16 19:56:54 -05:00
Phrozyn 07e0659a39
Cleaning up unused fields, adding used fields. 2018-08-16 19:56:13 -05:00
Phrozyn e29f08bec0 Found more formatting errors, should be good now. 2018-08-14 18:35:01 -05:00
Phrozyn 9bdd2646f1 Template was badly formatted, and thus incorrect. Corrected. 2018-08-14 18:19:41 -05:00
Phrozyn 27766e2f48
Updating script to reflect correct Template name. 2018-08-14 13:49:34 -05:00
Phrozyn 89dddd59e3
Removing erroneous mapping template in favor of the correct one. 2018-08-14 13:48:37 -05:00
Phrozyn f72e262468
Merge branch 'mozdefhealth_index' of https://github.com/Phrozyn/MozDef into mozdefhealth_index 2018-08-07 15:49:19 -05:00
Phrozyn eb8fad8f58
Adding index to initial es event, and updating mapping. 2018-08-07 15:48:52 -05:00
Phrozyn ace743b8e3 Adding config/scripts for prod/dev aws accounts 2018-08-06 18:05:37 -05:00
Phrozyn ec988c0e38 Correcting event _type 2018-08-06 13:21:10 -05:00
Phrozyn 4686fd3c90 Adding sqsstats to healthToMongo.py 2018-08-06 13:12:24 -05:00
Phrozyn 16c1c341d0 adding doc_type back into sqs-latest event 2018-08-06 13:06:28 -05:00
Brandon Myers 62231136c9
Remove fxa health and status cron script 2018-08-06 11:33:10 -05:00
Phrozyn 9851899444 Adding sqs_queue_status script to cron 2018-08-06 11:04:05 -05:00
Phrozyn e372ff4f3a Merge branch 'mozdefhealth_index' of https://github.com/Phrozyn/MozDef into mozdefhealth_index 2018-08-02 19:38:39 -05:00
Phrozyn 1f359a716f Updated default mapping for mozdefstate index 2018-08-02 19:36:59 -05:00
Phrozyn 4a098162ae
Updated mapping that includes mozdefhealth and will work with the dynamic quality of our SQS queues. 2018-07-20 19:03:14 -05:00
Phrozyn 5fc756d17e
Adding sleep cycle timer and exit to eventStats 2018-07-18 09:48:26 -05:00
Jeff Bryner 91acafe3d4 correct reference to self 2018-07-17 14:43:36 -07:00
Jeff Bryner 8d1ffbaa32 remove unused import, correct comments 2018-07-17 14:38:05 -07:00
Phrozyn 6ba6b70799
Updating eventStats to write to mozdefstate index, and sleep if it's not available yet. 2018-07-16 15:11:58 -05:00
Phrozyn 73d9032164
Updating replicas to be 1 to align with data retention desires. 2018-07-13 09:23:07 -05:00
Phrozyn 6aad873903 Changing index to mozdefstate 2018-07-12 16:54:14 -05:00
Phrozyn 59bd115fe6 Merge branch 'mozdefhealth_index' of https://github.com/Phrozyn/MozDef into mozdefhealth_index 2018-07-12 16:30:04 -05:00
Phrozyn 3362fad060 Update to add mozdefhealth to it's own index. 2018-07-12 16:16:15 -05:00
Phrozyn 4c1864f735
Working on separating health stats from events index. 2018-07-12 12:58:30 -05:00
Jeff Bryner e0463ab84c fixup the fqdn list creation cron job 2018-07-10 16:20:54 -07:00
Jonathan Claudius 1064f81b81 Fix a few more code review items 2018-07-05 16:42:01 -04:00
Jonathan Claudius ad59be88ca Remove more unnecessary attacker logic 2018-07-05 16:35:30 -04:00
Jonathan Claudius f753ff38ff Remove unnecessary attacker logic 2018-07-05 16:34:35 -04:00
Jonathan Claudius 223e2a3c40 Add stub cron jobs for FQDN blocklist 2018-07-05 15:54:07 -04:00
Brandon Myers 95503dfcbb
Modify logger level in es cache cron script 2018-05-29 11:03:34 -05:00
A Smith 7e18f9c1c4
Merge pull request #699 from mozilla/remove_leftover_escache_bug
Fix leftover esCacheMaint http req bug
2018-05-24 14:34:22 -05:00
Brandon Myers a1fd1ab0d6
Merge pull request #695 from mozilla/meteor-blocklist
Add a new ip blocklist within Meteor/Mongo
2018-05-24 13:52:18 -05:00
Brandon Myers c4d2568046
Fix leftover esCacheMaint http req bug 2018-05-22 18:21:05 -05:00
Brandon Myers 4e55663229
Update es cache cron script to remove http in request 2018-05-22 13:03:25 -05:00
Jeff Bryner c60391caf0 fix aggregate/pymongo version update, set cidr to /32 2018-05-18 14:44:01 -07:00
Jeff Bryner 281496077b add option to trim blocklist entries that have expired. 2018-05-18 12:30:40 -07:00
Jeff Bryner ca634a1a12 make the attacker age an option rather than hardcoded 2018-05-18 12:13:37 -07:00
Brandon Myers 1ec6857c4e
Add shell script for esCacheMaint cron 2018-05-17 12:30:26 -05:00
Brandon Myers 774342e08f
Convert clear cache cron script to using elasticsearch client 2018-05-17 10:55:05 -05:00
Jeff Bryner 76ce0f7db7 reset threshold from testing to normal 2018-05-17 08:00:51 -07:00
A Smith 4218eba69f
Merge pull request #690 from mozilla/cachemaint
Cachemaint utility, closes #689
2018-05-17 09:55:03 -05:00
Jeff Bryner 3fb8ac8cc7 add meteor ID to allow deletion of attacker-entered blocks 2018-05-16 14:31:46 -07:00
Jeff Bryner 7c20866363 Update logic for matching expire date, current pymongo cursor use 2018-05-16 08:29:27 -07:00
Jeff Bryner c691a390f9 reference/creator update 2018-05-15 17:39:50 -07:00
Jeff Bryner 6e4f8531b9 add logic to include attacker IPs in the mongo blocklist table. 2018-05-15 16:35:39 -07:00
Jeff Bryner b348fc20b2 add ipv4/6 support functions 2018-05-15 16:21:16 -07:00
Jeff Bryner 7b0907f275 rough in changes to the block list creation cron to allow for the unified block list 2018-05-15 16:16:16 -07:00
Jeff Bryner 4b04567320 s/list/whitelist and update the parsing logic to allow for bad data 2018-05-15 10:48:37 -07:00
Jeff Bryner 4701346076 remove un-needed init 2018-05-10 16:08:13 -07:00
Jeff Bryner 60da6725da clean up unused imports, use libs. 2018-05-10 16:06:03 -07:00
Jeff Bryner 77e2c793fb clean up unused code bits 2018-05-10 14:57:50 -07:00
Jeff Bryner 77ee8faf93 add utility to check JVM memory utilization and clear cache 2018-05-10 14:32:04 -07:00
Brandon Myers 8822b34631
Fix syntax error in else statement in auth0 script 2018-05-10 15:55:35 -05:00
Guillaume Destuynder 63b5eb5597
Support `details.auth_type` which indicates if a successful login was
realized because a password was validated, or because the session was
still valid
2018-05-09 13:32:06 -07:00
Brandon Myers 6f2a0aa75d
Merge pull request #649 from scriptonist/Issue421
Changed python virtualenv locations in cron/*.sh
2018-04-20 12:48:20 -05:00
Brandon Myers 9339409210
Fix remaining hardcoded s3 bucket names 2018-04-09 11:16:26 -05:00
Brandon Myers 9ea05213c0
Convert s3 bucket name into config option 2018-04-09 11:12:24 -05:00
A Smith a98034ee15
Merge pull request #632 from mozilla/elasticsearch_5
Elasticsearch 5 Upgrade
2018-04-05 11:31:13 -05:00
Brandon Myers ad7866d7e3
Add total fields config to index creation 2018-04-03 12:16:40 -05:00
scriptonist 2203442483 Changed pythong virtualenv locations in cron/*.sh 2018-03-27 09:57:12 +05:30
Brandon Myers d827e65a56
Move default mapping file under cron directory 2018-03-15 12:50:28 -05:00
Brandon Myers 378c3d1332
Merge pull request #644 from mozilla/add_mdc1_health_and_status
Adding a new health and status cron
2018-03-13 12:59:27 -05:00
Phrozyn bbecd28655
Adding a new health and status cron 2018-03-13 10:33:45 -05:00
Brandon Myers 233f0a6c2b
Modify rotate indexes cron script to specify index settings on creation 2018-03-09 13:55:02 -06:00
Brandon Myers 09d01cafe6
Remove unused parameter in create_index 2018-03-06 17:18:21 -06:00
Brandon Myers 90895c7422
Remove unused parameter in create_index 2018-03-06 17:10:18 -06:00
Brandon Myers 3e34bf1527
Modify health cron script to use new ES stat format 2018-03-06 12:07:10 -06:00
Brandon Myers ac6ff9f291
Convert auth0 raw message into a string 2018-02-26 13:19:57 -06:00
Phrozyn 4d81cd7569
Swapping log lines with index creation task - fixing alignment 2018-01-31 13:54:46 -06:00
Phrozyn 72bd27d6ba
updating test_elasticsearch_client.py to use index_config and adding else statement to index creation in rotateIndexes.py 2018-01-31 13:39:00 -06:00
Phrozyn a5fba58726
refactoring sharding into cron and removing additional template. 2018-01-25 18:23:35 -06:00
Brandon Myers 7928f58b93
Merge remote-tracking branch 'origin/master' into fix_healthtomongo_cron 2018-01-05 12:44:38 -06:00