Граф коммитов

389 Коммитов

Автор SHA1 Сообщение Дата
miguelgfierro 3d3ea4b5d6 🐛 2019-09-27 17:13:50 +01:00
miguelgfierro 635659cafe fixed 🐛 in bert_senteval and added integration test asserts 2019-09-27 17:07:47 +01:00
miguelgfierro 6926b71a2a rename tests to be the same as the notebook file 2019-09-27 16:52:13 +01:00
Yijing Chen 22031210cf remove the tracking pipeline yml file 2019-09-26 13:01:46 -07:00
miguelgfierro 0de34142a2 entailment passing 2019-09-26 17:43:13 +01:00
miguelgfierro ec604c5fbf integration test tc azureml working 2019-09-26 16:31:10 +01:00
miguelgfierro dc101eb474 🐛 2019-09-26 13:17:37 +01:00
miguelgfierro 5fc53d69ee black 2019-09-25 16:26:28 +01:00
miguelgfierro 03ae1a9b60 fixed 🐛 with merge 2019-09-25 11:19:28 +01:00
saidbleik 7536488928 reduce batch size for test 2019-09-15 07:24:24 +00:00
saidbleik 6fdd10bd65 add eval checks for tests 2019-09-12 17:10:38 +00:00
saidbleik c6f7b9ddcc add hi TC excample 2019-09-11 15:37:18 +00:00
saidbleik 43841f2e5b add ar example 2019-09-10 20:07:45 +00:00
Sahitya Mantravadi a89b4ece06
Merge branch 'staging' into master 2019-09-04 14:48:29 -04:00
miguelgfierro ce50943465 component governance 2019-09-03 15:27:17 +01:00
Sahitya Mantravadi 0f1a77d91d fixed testing bug with validation 2019-08-30 14:59:50 -04:00
chhetri22 91f5810cac Added tests for xlnet 2019-08-29 14:23:46 -04:00
Said Bleik 1f733811b0
Merge pull request #375 from microsoft/arg_names_patch
update arg names: percentage to fraction
2019-08-26 17:09:53 -04:00
saidbleik 1deb5bf679 update arg name in test_dataset 2019-08-26 18:45:05 +00:00
Daisy Deng 385134c257 fix the badge 2019-08-26 15:27:56 +00:00
Yijing Chen da90ee8dcc Fix the merge conflict with staging branch 2019-08-22 20:09:40 +00:00
Daisy Deng e766da81bd revert the scope of the test 2019-08-22 15:49:31 +00:00
Daisy Deng 86c5414339 add reason 2019-08-22 15:40:02 +00:00
Daisy Deng af686639b4 Merge branch 'fix_horovod' of https://github.com/microsoft/nlp into fix_horovod 2019-08-22 15:34:50 +00:00
Daisy Deng a83a2b32aa add 2019-08-22 15:16:17 +00:00
Daisy Deng 8066515595 Update gpu_integration_tests_linux.yml for Azure Pipelines only test sentent_similarity 2019-08-22 11:00:54 -04:00
Daisy Deng 0526502c4e Merge branch 'staging' of https://github.com/microsoft/nlp into fix_horovod 2019-08-22 13:16:53 +00:00
Daisy Deng fc74801e60 skip tests which use horovod 2019-08-22 13:12:19 +00:00
saidbleik 3c9bbee521 model_explainability edits 2019-08-21 18:37:36 +00:00
hlums b8a02cf1f7 Reduce assertion decimals to make test pass. 2019-08-21 00:00:09 +00:00
hlums 9c24698936 Update model explainability notebook path in test. 2019-08-20 13:54:42 -04:00
saidbleik 37f804bc3c update examples folder refs 2019-08-19 14:51:35 +00:00
hlums d46a503a07 Minor edits. 2019-08-17 12:01:47 -04:00
Daisy Deng e6d4766337 Merge branch 'staging' of github.com:microsoft/nlp into daden/perf_predict 2019-08-14 21:06:53 +00:00
Said Bleik 8e467f633a
Merge pull request #271 from microsoft/daden/device_aware
add device awareness and test cases for sentence encoding
2019-08-13 16:21:03 -04:00
Said Bleik a76db21bf7
Merge branch 'staging' into bert-ss-tests 2019-08-13 16:13:30 -04:00
Said Bleik d7bc4e8fb0
Merge pull request #267 from microsoft/hlu/Add_reference_running_time_to_more_notebooks
Hlu/add reference running time to more notebooks
2019-08-13 16:10:49 -04:00
Casey Hong 95311c8768 bert_encoder unit test 2019-08-13 15:13:27 -04:00
Daisy Deng 8f4ba6a0fd format 2019-08-13 19:08:23 +00:00
Casey Hong 13533d614e bert_senteval integration test 2019-08-13 14:51:37 -04:00
Yijing Chen bd2b60d0bc update with the changes in staging branch 2019-08-13 18:10:56 +00:00
Said Bleik 0642773154
Merge pull request #254 from microsoft/sequence-classifier-dist
Entailment using BERT, AzureML along with Text Classification updates
2019-08-13 14:09:20 -04:00
Yijing Chen 7b10bad2bd Add notebook test 2019-08-13 18:02:50 +00:00
hlums fd5397b931 Update NER notebook test. 2019-08-13 17:23:41 +00:00
Daisy Deng 002078ab68 add test coverage 2019-08-13 17:09:24 +00:00
Daisy Deng 468cf34354 auto decide if model needs to be moved to cpu or not 2019-08-13 17:06:56 +00:00
Daisy Deng 3167bc313d add test case for sentence encoding 2019-08-13 16:25:56 +00:00
hlums 0792a332e0 Merge with staging and resolve conflicts. 2019-08-13 15:00:01 +00:00
hlums 642700f79f Add integration test for named entity recognition notebook. 2019-08-12 18:27:46 +00:00
hlums a4842afdd6 Add integration test for text classification notebook. 2019-08-12 18:27:13 +00:00
Janhavi Mahajan 1ed90af072 changed the assert value in the test 2019-08-09 16:17:45 -04:00
Daisy Deng ec55324412 remove luis related files 2019-08-09 17:44:32 +00:00
Janhavi Mahajan a628ddbbd6 renamed results.json in test and removed commented lines from bert util 2019-08-09 13:23:22 -04:00
Janhavi Mahajan 1614167d08 All PR review comments addressed except modifying save_model 2019-08-09 13:17:25 -04:00
Janhavi Mahajan a96cbb9614 integration test for entailment_azureml and doctring for xnli torch dataset 2019-08-09 13:16:54 -04:00
miguelgfierro 50cd73645f merged with staging 2019-08-09 08:58:11 +00:00
Miguel González-Fierro ccdd6959bc
Merge pull request #248 from microsoft/miguel/missing_notebook_tests
Added missing notebook tests
2019-08-09 09:30:23 +01:00
Said Bleik 74e4efb7be
Merge pull request #223 from microsoft/daden/er
Add LUIS-style Entity Extractor based on BERTTokenClassifier
2019-08-08 11:23:51 -05:00
miguelgfierro 28ff5dded4 🐛 in configuration 2019-08-08 16:03:55 +00:00
miguelgfierro cd92b6dede 🐛 in configuration 2019-08-08 15:56:16 +00:00
miguelgfierro a57aa20ce4 🐛 2019-08-08 16:34:53 +01:00
miguelgfierro 3c93a29942 🐛 2019-08-08 15:45:03 +01:00
miguelgfierro f8fa987f58 azureml pipeline 2019-08-08 11:45:07 +01:00
miguelgfierro 405a12748b 🐛 2019-08-08 09:23:43 +00:00
miguelgfierro cf2a3b2eab added test tc_mnli_bert 2019-08-07 16:06:48 +00:00
miguelgfierro 8a6a7d4158 added test for bert_encoder notebook 2019-08-07 14:59:15 +00:00
miguelgfierro 6213d2f9df interpretability notebook 2019-08-07 14:39:21 +00:00
miguelgfierro 33ac413e39 Merge branch 'staging' into miguel/missing_notebook_tests 2019-08-07 14:32:35 +00:00
miguelgfierro e74e636c51 interpretability 2019-08-07 14:32:05 +00:00
miguelgfierro b383699e4d skipping test 2019-08-07 13:38:52 +00:00
miguelgfierro a8cd1be774 reorder conftest 💥 2019-08-07 13:35:46 +00:00
miguelgfierro 1bb900a847 🐛 2019-08-07 13:33:34 +00:00
miguelgfierro c4d7125b20 rename entailment test 2019-08-07 13:32:29 +00:00
Miguel González-Fierro ce89669b2b
Merge branch 'staging' into abhiram-tc-pipelines 2019-08-07 14:15:05 +01:00
Miguel González-Fierro a4e2e28438
Merge pull request #237 from microsoft/hlu/update_entailment_notebook_running_time
Hlu/update entailment notebook running time
2019-08-07 11:32:32 +01:00
Hong Lu f276d3cfa5 Add pytest.mark.gpu 2019-08-06 17:33:39 -04:00
Abhiram E fa5d033c48 Minor change to expected vocab variable 2019-08-06 13:03:17 -04:00
hlums 238e8d0403 Resolved conflict with staging. 2019-08-05 18:07:42 +00:00
honglu@microsoft.com c8ac917317 Update notebook parameters. 2019-08-05 18:00:51 +00:00
Abhiram E 1b4a58f1b6 Minor refactoring for Gensen tests 2019-08-02 18:42:39 -04:00
Abhiram E 0f44167928 Added tests to Gensen 2019-08-02 18:25:06 -04:00
hlums e1bb26fb28 Add integration test for entailment notebook. 2019-08-02 20:01:20 +00:00
Yijing Chen 1cfedcbebe update the embedding notebook and glove folder 2019-08-01 22:55:37 +00:00
Abhiram E 1c0b54db40 Added minor missing fixture 2019-08-01 02:19:52 -04:00
Abhiram E f82e5ec6db Added AzureML notebook test, parameterized variables in the notebook and got rid of redundant variables. 2019-08-01 02:16:14 -04:00
Miguel González-Fierro ac577ca17b
Merge pull request #225 from microsoft/miguel/repo_metrics_fix
remove scheduler
2019-07-31 17:14:03 +01:00
miguelgfierro b2dc4fa2dd license 2019-07-31 15:54:14 +01:00
miguelgfierro 1313adb5ba remove pr to master and setting the scheduler from the dashboard 2019-07-31 15:36:16 +01:00
miguelgfierro 22a96bfda7 remove scheduler 2019-07-31 15:05:17 +01:00
daden-ms b17645cc5a add comments 2019-07-31 04:13:24 +00:00
daden-ms a6e99b462f fixed tests 2019-07-31 02:50:33 +00:00
daden-ms cf1a32b2e2 add test 2019-07-31 02:43:17 +00:00
Said Bleik 66ff7b408f
Merge pull request #212 from microsoft/miguel/fix_unit
Miguel/fix unit
2019-07-30 16:29:30 -04:00
Liqun Shao 628225e16a fix bugs on duplicate code 2019-07-30 14:27:26 -04:00
Liqun Shao f22e8914e9 add gensen aml test 2019-07-30 14:25:26 -04:00
Liqun Shao 27fd2c4c90 add gensen aml notebook testing 2019-07-30 14:21:46 -04:00
Liqun Shao 44fdc90fec add mark.azureml to bert test 2019-07-30 12:57:32 -04:00
Liqun Shao a07fd4d265 change @pytest.mark.notebooks to @pytest.mark.integration 2019-07-30 12:57:32 -04:00
Liqun Shao c4e80760d8 resolve casey comments on notebook; add more parameters for testing 2019-07-30 12:57:32 -04:00
Liqun Shao 83e2411de3 apply black and add more parameters to testing 2019-07-30 12:57:32 -04:00
catherine667 c6abfb0ae9 add f1 and learning rate to results for testing 2019-07-30 12:57:31 -04:00
catherine667 29a914ee22 add notebook testing for BERT QA 2019-07-30 12:56:17 -04:00
miguelgfierro 5687295479 duration to smoke and integration tests 2019-07-30 16:47:38 +01:00
miguelgfierro 00c8bb3d19 added azureml flag 2019-07-30 16:45:39 +01:00
cocochrane 366bad1538
Merge branch 'staging' into courtney-tests 2019-07-30 11:23:19 -04:00
Courtney Cochrane 77e8684252 Change pytest.mark.notebooks 2019-07-30 11:21:32 -04:00
Miguel González-Fierro 01b3996d82
Merge pull request #194 from microsoft/miguel/integration
Integration tests
2019-07-30 10:04:17 +01:00
Courtney Cochrane 31b135aa28 Tests and update to use CLI auth so that tests run smoothly 2019-07-29 20:16:12 -04:00
Courtney Cochrane 81a1a4c293 Updating tests for QA and SS 2019-07-29 20:16:11 -04:00
Courtney Cochrane 50e2dbc95e Adding tests for QA and update experiment names 2019-07-29 20:10:10 -04:00
Courtney Cochrane 80c806a0b9 Add tests for sentence similarity 2019-07-29 20:10:10 -04:00
Abhiram E 56074fdbfb Fixed paths used in Gensen local tests 2019-07-29 16:19:15 -04:00
Said Bleik a681a827e1
Merge pull request #206 from microsoft/init_app
Init apps directory under utils_nlp
2019-07-29 14:45:40 -04:00
Daisy Deng f7d79c0a44 use tmpdir fixture 2019-07-29 18:39:47 +00:00
Daisy Deng c015a64836 use pytest fixture to get FoodTruck.json from its original source 2019-07-29 18:31:09 +00:00
Daisy Deng 5660bfe9df rename app_luis_tests to app_tests 2019-07-29 18:02:42 +00:00
Daisy Deng cf6ee334be add test files for luis test 2019-07-29 16:49:26 +00:00
Daisy Deng 85080122a6 initial commit for apps with luis file loading into python objects 2019-07-29 16:47:16 +00:00
miguelgfierro 3b4c6bb37a 🐛 2019-07-26 16:30:51 +01:00
miguelgfierro bb269a5b5c 🐛 2019-07-26 16:27:11 +01:00
miguelgfierro 25241b77a8 🐛 forgot to import snli 2019-07-26 16:16:08 +01:00
miguelgfierro ceb859f52c xnli 2019-07-26 16:01:15 +01:00
miguelgfierro a32b3a27b9 snli 2019-07-26 15:44:46 +01:00
miguelgfierro fe785b5be4 🐛 2019-07-26 14:41:48 +01:00
miguelgfierro f2709d00a6 🐛 remove sent eval related tests 2019-07-26 14:24:16 +01:00
miguelgfierro 9d82948249 merged with staging and added mark of azureml 2019-07-26 12:23:25 +01:00
miguelgfierro 1fb8195ff3 Merge branch 'staging' into miguel/integration 2019-07-26 12:20:22 +01:00
Abhiram E cd357d2b04 Minor fix to tests 2019-07-25 17:00:19 -04:00
Abhiram E c6ab656cf2 Changes for code review comments.
1. Added compute_correlation_coeff method to utils and separated it from
the predict method to ensure single responsbility.
2. Added tests accordingly.
3. In the notebook added a scrap to track preditions and assert it in
tests.
4. Also added extra documentation to explain what the predict method is
doing.
5. Minor fix to stop train at max_epoch.
2019-07-25 16:56:02 -04:00
Abhiram E ddf810fa9f Fixed some messed conflict resolution 2019-07-25 16:56:02 -04:00
Abhiram E 9b239f5db5 Added integration test to Gensen Local notebook 2019-07-25 16:56:02 -04:00
miguelgfierro 5137921046 fix 🐛 in integration cpu pipeline 2019-07-25 17:51:20 +01:00
miguelgfierro 6c867e1be7 added badges and update yml 2019-07-25 17:49:21 +01:00
Miguel González-Fierro 2c37bf0892
Merge pull request #190 from microsoft/bert-ss
Bert sentence encoder
2019-07-25 09:35:30 +01:00
miguelgfierro 2c1f038ed2 integration pipeline 💥 2019-07-24 16:38:38 +01:00
Casey Hong 46f2336c65 notebook test 2019-07-24 11:32:36 -04:00
miguelgfierro 0ddc9482de removed repeated instructions, added durations and revert back to nlpmachine 2019-07-23 17:39:28 +01:00
miguelgfierro f57edfd983 moving to host to have some tests in parallel 2019-07-23 17:17:50 +01:00
miguelgfierro 6d09a63560 🐛 2019-07-23 16:52:15 +01:00
miguelgfierro cef2b19180 changes on ymal pipelines 2019-07-23 16:51:18 +01:00
Miguel González-Fierro 1819998707
Update cpu_unit_tests_linux.yml 2019-07-23 16:32:43 +01:00
Miguel González-Fierro 849f3112cb
Update gpu_unit_tests_linux.yml 2019-07-23 16:24:26 +01:00
Miguel González-Fierro f01c77853c
fix #186 2019-07-23 14:38:45 +01:00
Miguel González-Fierro f49a353854
Update cpu_unit_tests_linux.yml 2019-07-23 14:33:49 +01:00
Miguel González-Fierro c321261a21
#186 2019-07-23 14:29:05 +01:00
Miguel González-Fierro 28bd77494b
the command has to go all together #186 2019-07-23 14:26:59 +01:00
Miguel González-Fierro 44aed8019f
#186 2019-07-23 14:25:15 +01:00
Miguel González-Fierro 2aee7b1909
#186 2019-07-23 14:22:15 +01:00
Miguel González-Fierro 4d260259f0
#186 2019-07-23 14:20:54 +01:00
Miguel González-Fierro c00c2e6d61
#186 2019-07-23 14:19:23 +01:00
Miguel González-Fierro 1118efea95
#186 2019-07-23 14:18:37 +01:00
Miguel González-Fierro 4395fbfda4
Update cpu_unit_tests_linux.yml 2019-07-23 14:15:06 +01:00
Miguel González-Fierro 75f018de45
Update cpu_unit_tests_linux.yml 2019-07-23 13:59:35 +01:00
Miguel González-Fierro d85fabc3bb
Update cpu_unit_tests_linux.yml 2019-07-23 13:50:49 +01:00
Miguel González-Fierro 32eb4143a6
Update cpu_unit_tests_linux.yml 2019-07-22 16:33:53 +01:00
Miguel González-Fierro a393098084
Update cpu_unit_tests_linux.yml 2019-07-22 16:28:04 +01:00
Miguel González-Fierro f60d4a40fa
Update cpu_unit_tests_linux.yml 2019-07-22 16:16:45 +01:00
Miguel González-Fierro fe9ce0c026
Update cpu_unit_tests_linux.yml 2019-07-22 13:28:28 +01:00
Miguel González-Fierro dcb704f33c
Merge pull request #178 from microsoft/rm-senteval
remove senteval notebooks and integration tests
2019-07-20 08:07:47 +01:00
Casey Hong b44b552ed0 remove gensen senteval fixture 2019-07-19 17:40:10 -04:00
Casey Hong 1bb75e7275 remove senteval notebooks and integration tests 2019-07-19 18:26:55 +00:00
miguelgfierro f2dfdf15b6 edge case 2019-07-19 16:18:46 +00:00
miguelgfierro 6b41ede682 refactor 2019-07-19 16:03:47 +00:00
miguelgfierro 7c3b82fda0 refactoring pytorch utils 2019-07-19 15:17:24 +00:00
miguelgfierro f6af1f1941 Merge branch 'staging' into miguel/integration_test_fix 2019-07-18 19:45:22 +00:00
Said Bleik 21e92a81b4
Merge pull request #168 from microsoft/hlu/fix_cpu_bug
Hlu/fix cpu bug
2019-07-17 11:19:04 -04:00
miguelgfierro 7aacdb0e5b adjusted results in integration tests and refactor fixtures 2019-07-17 12:19:38 +00:00
Miguel González-Fierro 48f916ff47
Merge pull request #90 from Frozenmad/v-chguan/add_ICML_exNLP_code
V chguan/add icml ex nlp code
2019-07-17 12:34:10 +01:00
Frozenmad 5ad5e9bad5 change unit test of interpreter 2019-07-17 10:32:37 +08:00
Ubuntu 92d74f16dd Added tests for pytorch utils. 2019-07-15 21:09:52 +00:00
miguelgfierro 9dd0e9c309 merge staging and fix 🐛 2019-07-15 16:31:38 +00:00
miguelgfierro 63c3d1cf94 remove warning 2019-07-15 15:18:41 +00:00
Said Bleik 56747428e2 update imports - tests & utils 2019-07-15 10:57:51 -04:00
miguelgfierro 94861f4d9f 🐛 2019-07-15 14:33:56 +00:00
miguelgfierro 0d56f6046f refactor tests 2019-07-15 14:08:36 +00:00
Frozenmad 503df312dd add CLA, rm files according to comments, etc. 2019-07-11 23:25:02 +08:00
Said Bleik 85b3349007
Merge pull request #161 from microsoft/hlu/add_missing_tests_and_minor_updates
Hlu/add missing tests and minor updates
2019-07-10 09:13:25 -04:00
hlums edf0d63fff Merge remote-tracking branch 'origin' into hlu/add_missing_tests_and_minor_updates 2019-07-09 21:59:08 +00:00
hlums f227e5ec9a Added more unit tests. 2019-07-09 21:52:09 +00:00
Abhiram E 833b1a527b Separated JSON loader from CSV loader for DASK based on code review comments. 2019-07-09 11:43:17 -04:00
Abhiram E 72d167763b Added sequential test after rebasing 2019-07-08 16:29:44 -04:00
Abhiram E 1b92220031 Code changes based on code review comments.
Adding DASK support for JSON files.
1. Added method to support to loading dataframes in parallel with DASK
for JSON files.
2. Added tests to test the new methods.
3. Added a minor fix to extracting files for MNLI dataset.
2019-07-08 16:26:08 -04:00
Said Bleik c698f68afe
Merge pull request #158 from microsoft/bleik-fixloadertest
bug - fixloadertest
2019-07-08 13:20:37 -04:00
Said Bleik 176dfdf4a4 removed debug prints 2019-07-08 12:43:25 -04:00
Said Bleik 481e9aadec bug fix 2019-07-08 12:38:21 -04:00
Miguel González-Fierro 66b1ac9aac
Update repo_metrics_pipeline.yml 2019-07-08 11:47:52 +01:00
Casey Hong f8dd156ff4 remove @cpu marker 2019-07-05 15:51:01 -04:00
Casey Hong c2856872ae senteval integration tests 2019-07-05 15:50:40 -04:00
Miguel González-Fierro c397cdda12
add schedule 2019-07-05 16:36:41 +01:00
Said Bleik a3d40eba7e
Merge pull request #147 from microsoft/rm-dataprep
remove data_prep notebooks
2019-07-05 09:54:52 -04:00
hlums 2d4371b008 Minor update to msra ner utils. 2019-07-04 00:03:44 +00:00
Casey Hong 0607198dbb remove data_prep notebooks 2019-07-03 18:34:40 -04:00
hlums 66c1bff5ea Updated ner tokenization api. 2019-07-03 21:06:44 +00:00
miguelgfierro ec2c827e75 azure devops tests 2019-06-28 16:15:46 +01:00
bethz 3f84802644 add comments to tests/readme 2019-06-26 10:53:32 -04:00
bethz 6c756830ee create unit-tests.yml as a copy from .ci/azure-pipelines.yml and create in tests/ci instead of .ci 2019-06-26 10:41:39 -04:00
Said Bleik 4a9633f70d old files 2019-06-25 23:58:44 -04:00
Said Bleik a91b73a0b6 added more tests and bug fixes 2019-06-25 22:58:03 -04:00
Said Bleik 4dac5f1cff
Merge pull request #116 from microsoft/abhiram-mlflow
Integrating Mlflow.
2019-06-25 08:55:44 -07:00
hlums 48ce3bf989 Changed tokenizer_preprocess_ner_text to tokenize_ner. 2019-06-24 19:21:16 +00:00