Граф коммитов

389 Коммитов

Автор SHA1 Сообщение Дата
saidbleik a8287dfea0 fix ner pred function 2020-02-15 18:48:06 +00:00
hlums 4641eb9e87 Minor edits 2020-02-13 23:49:05 +00:00
saidbleik 69357e5937 update move_model_to_device args 2020-02-13 21:21:17 +00:00
saidbleik cd0a001dd9 updated ext summarization files 2020-02-12 22:00:52 +00:00
Ubuntu fff98faf58 move to device part of abssum 2020-02-12 21:13:14 +00:00
saidbleik 01d69abf98 update sequence classification files 2020-02-12 20:16:49 +00:00
Ubuntu 9860de4f46 fit verified with pretrained model 2020-02-12 04:47:22 +00:00
Hong Lu 675e5827ea
Merge pull request #553 from microsoft/bleik/rel-patch1
Fix QA notebook issue
2020-02-11 13:54:30 -05:00
saidbleik 67b1d8a8ea fix qa notebook 2020-02-11 05:27:23 +00:00
Daisy Deng e5b4a3a66d add test 2020-02-05 05:40:54 +00:00
Daisy Deng 1d2873c376 add import 2020-01-31 03:53:00 +00:00
Daisy Deng bb25e16710 add test 2020-01-30 05:53:00 +00:00
Said Bleik 7dcdc32399
Merge pull request #529 from microsoft/bleik/optim-patch
bleik/common transformers utils update
2020-01-24 20:06:37 -05:00
saidbleik 9db5a3708c minor edits 2020-01-23 23:59:31 +00:00
hlums b5a9f502f3 Change local_rank to 0 to make test pass on 1 GPU machine. 2020-01-22 16:24:04 +00:00
saidbleik 489f5381b8 specify model name in NER test 2020-01-19 19:24:10 +00:00
saidbleik 30a9e0342b add pytest marker to ner test 2020-01-18 19:38:10 +00:00
saidbleik 4b2ced52ba rem num_labels check 2020-01-18 18:07:39 +00:00
saidbleik ecb7245270 Merge branch 'bleik/optim-patch' of https://github.com/microsoft/nlp-recipes into bleik/optim-patch 2020-01-18 06:28:09 +00:00
saidbleik 2b1736086f update pytorch utils tests 2020-01-18 06:15:32 +00:00
saidbleik b6424d173e update pytorch_utils tests 2020-01-18 06:09:20 +00:00
Said Bleik 97f6f0814b
Update test_notebooks_extractive_summarization.py 2020-01-17 00:06:37 -05:00
saidbleik b76750aaa6 NER updates 2020-01-17 02:16:10 +00:00
saidbleik 82816318dc update summarization files 2020-01-16 19:14:24 +00:00
saidbleik 2a4c1be721 Merge remote-tracking branch 'origin/staging' into bleik/optim-patch 2020-01-14 20:04:38 +00:00
saidbleik c7d3409dfd update QA utils and tests 2020-01-14 17:08:58 +00:00
saidbleik 5611740f96 update seq classification examples 2020-01-13 21:00:11 +00:00
saidbleik 9811b8abfb restructuring of common transformers utils 2020-01-13 17:45:00 +00:00
saidbleik 8242bcf767 modified structure of transformer wrapper 2020-01-08 06:37:42 +00:00
hlums 59ca52b222 Merge with staging and resolve conflict. 2020-01-07 22:41:41 +00:00
hlums 68d02bdba4 Resolve simple review comments. 2020-01-06 19:14:49 +00:00
Daisy Deng 1dc0570616 use dataset in finetuning 2020-01-06 18:58:49 +00:00
Daisy Deng b7af2127e7 add documentation 2020-01-03 05:46:22 +00:00
Daisy Deng 120b9734fe add integration test for extractive summarization 2020-01-02 21:17:11 +00:00
Daisy Deng 8801ea75b9 use the new dataset for testing 2020-01-02 19:23:31 +00:00
hlums acb03d0e8e Add Hindi ROUGE computation. 2019-12-26 22:55:17 +00:00
hlums 8e172d6172 Merge branch 'staging', remote-tracking branch 'origin' into hlu/summarization_evaluation 2019-12-26 11:29:45 -05:00
Daisy Deng d6233c7a7e remove the temp_target printout 2019-12-24 02:48:14 +00:00
hlums 8d5ae4fcdd Add tests for compute_rouge.py 2019-12-20 22:02:24 +00:00
Daisy Deng 408f87cb8c add a test for extractive summarization 2019-12-17 20:51:56 +00:00
Daisy Deng 69c63023a0 remove unnecessary files 2019-12-13 21:05:40 +00:00
Ubuntu 5e4d15ffde fix typoes 2019-12-05 20:47:07 +00:00
Ubuntu 50d3891bf8 remove the sys path 2019-12-05 20:47:07 +00:00
Ubuntu ee973ea03d remove unnecessary arguments; add documentation 2019-12-05 20:41:32 +00:00
Ubuntu 1d49b963da add unit test 2019-12-05 20:40:06 +00:00
Miguel González-Fierro ed04438ae1 Staging to master to add the latest fixes (#503)
* update mlflow version to match the other azureml versions

* Update generate_conda_file.py

* added temporary

* doc: update github url references

* docs: update nlp recipes references

* Minor bug fix for text classification of multi languages notebook

* remove bert and xlnet notebooks

* remove obsolete tests and links

* Add missing tmp directories.

* fix import error and max_nodes for the cluster

* Minor edits.

* Attempt to fix test device error.

* Temporarily pin transformers version

* Remove gpu tags temporarily

* Test whether device error also occurs for SequenceClassifier.

* Revert temporary changes.

* Revert temporary changes.
2019-11-29 19:53:57 -05:00
Miguel González-Fierro 857ce5ca33
Merge pull request #498 from microsoft/hlu/fix_temp_directories
Hlu/fix temp directories
2019-11-28 14:04:10 +00:00
hlums 3bb5cce068 Revert temporary changes. 2019-11-27 23:27:01 +00:00
hlums 321032e0e5 Revert temporary changes. 2019-11-27 23:25:49 +00:00
hlums 40ae2b7170 Test whether device error also occurs for SequenceClassifier. 2019-11-27 23:09:09 +00:00
hlums 3e72fb034e Remove gpu tags temporarily 2019-11-27 23:08:28 +00:00
hlums d13cce1e37 Minor edits. 2019-11-27 19:46:42 +00:00
hlums 0b4b25638e Add missing tmp directories. 2019-11-26 22:44:21 +00:00
saidbleik b0dc696acc remove obsolete tests and links 2019-11-26 21:10:01 +00:00
saidbleik d71de4a1d5 remove bert and xlnet notebooks 2019-11-25 20:43:14 +00:00
miguelgfierro 00d9ca0b17 added temporary 2019-11-21 19:15:49 +00:00
Ke Huang 6e19905a13 Updated NER utils and notebook use the new Transformer class 2019-11-15 16:34:04 -05:00
Hong Lu de60b4446d
Merge branch 'staging' into hlu/update_entailment_notebook_to_use_transformers 2019-11-14 23:08:05 -05:00
hlums 8e542482fb Uncomment a test. 2019-11-15 03:47:01 +00:00
saidbleik b22b1845a0 fix tc tests 2019-11-15 03:35:23 +00:00
hlums 6301686f52 Merge branch 'hlu/update_entailment_notebook_to_use_transformers' of https://github.com/Microsoft/NLP into hlu/update_entailment_notebook_to_use_transformers 2019-11-15 03:13:15 +00:00
hlums dab0f019c8 Update entailment notebook test. 2019-11-15 03:13:03 +00:00
hlums 3b695174e3 Update QA utils and notebook to pass dataloader to fit and predict. 2019-11-14 23:07:32 +00:00
saidbleik fab7ace1a6 update qadataset import 2019-11-14 19:32:22 +00:00
saidbleik af77a06434 Merge branch 'transformers2' of https://github.com/microsoft/nlp into transformers2 2019-11-14 19:30:09 +00:00
saidbleik 51568defa2 update qadataset import 2019-11-14 19:29:15 +00:00
Ke Huang f176bba1d8 Merge branch 'transformers2' of https://github.com/microsoft/nlp into kehuan-transformers 2019-11-14 11:51:11 -05:00
Ke Huang d52bfc653b Added TC notebooks for multi languages 2019-11-14 11:51:04 -05:00
saidbleik 6c7975ce09 update import in test_dataset_pytorch 2019-11-14 16:19:51 +00:00
Ke Huang 3680835694 Merge branch 'transformers2' of https://github.com/microsoft/nlp into kehuan-transformers 2019-11-13 11:02:13 -05:00
Miguel González-Fierro fc80039835
trigger tests 2019-11-08 20:36:12 +00:00
Miguel González-Fierro 4f651bc772
Merge branch 'staging' into transformers2 2019-11-08 16:06:44 +00:00
hlums c406c3bb19 Remove pytorch-transformers from dependencies. 2019-11-05 14:05:45 -05:00
Said Bleik af245b569f
Merge pull request #449 from microsoft/kehuan-transformers
Added NER notebook using pretrained transformer model and wikigold da…
2019-10-29 11:00:45 -04:00
Said Bleik b964115aac
Update conftest.py 2019-10-29 10:17:38 -04:00
Ke Huang 9ad9a56489 Updated wikigold dataset, NER python file and notebook, also updated tests 2019-10-28 13:28:18 -04:00
hlums 7a41da9dcb Add result assertion to entailment notebook test. 2019-10-25 18:57:54 +00:00
hlums 0d09498a56 Add result assertion to qa notebook test. 2019-10-25 18:11:36 +00:00
Ubuntu 51bfbc946f Add result assertion to qa notebook test. 2019-10-25 17:43:48 +00:00
miguelgfierro 6ff9b2dd3c removed repeated get_device 2019-10-25 14:24:24 +01:00
Said Bleik ee67aa0108
Merge branch 'staging' into transformers2 2019-10-23 16:09:46 -04:00
saidbleik e83bf05a4d edits and updates 2019-10-23 19:26:17 +00:00
hlums 755bd43dc0 Fix license link in test_maybe_download. 2019-10-22 16:10:31 +00:00
hlums eaad52a6ef Fix license link in test_maybe_download. 2019-10-22 11:43:24 -04:00
hlums e6a3092318 Fix license link in test_maybe_download. 2019-10-22 10:53:49 -04:00
hlums 9385beff90 Fix minor bug in conftest.py 2019-10-21 17:50:51 +00:00
Hong Lu a8f5d4a1c5
Merge branch 'staging' into hlu/qa_transformers 2019-10-21 13:47:52 -04:00
hlums 6824595758 Revert "Merge with staging and resolve conflicts."
This reverts commit 3715eaefc6.
2019-10-21 17:46:01 +00:00
hlums 3715eaefc6 Merge with staging and resolve conflicts. 2019-10-21 17:23:22 +00:00
hlums 4c29667086 More tests for list of ground truth answers. 2019-10-21 16:04:30 +00:00
hlums 4677d0b6e4 Moved postprocess function into QAProcessor. 2019-10-17 18:57:05 +00:00
hlums 9d25215619 Rename question answering evaluation script. 2019-10-17 17:36:40 +00:00
hlums 027bff43d8 Add test for question answering notebook. 2019-10-17 17:35:48 +00:00
hlums 0201c07478 Add test for question answering notebook. 2019-10-17 17:35:33 +00:00
hlums 4b6295b654 Add tmp path. 2019-10-17 17:34:39 +00:00
hlums 45a8196575 Add test for QADataset. 2019-10-04 21:56:26 +00:00
hlums 37bc46b0b7 Add tests for question answering utils. 2019-10-04 21:53:35 +00:00
hlums 08cb4707b0 Add test code for squad data utils. 2019-10-04 21:52:35 +00:00
hlums 8cd3cd25ac Add test for AnswerExtractor. 2019-10-03 20:57:28 +00:00
Miguel González-Fierro f41faf587e
Merge pull request #262 from microsoft/miguel/pipeline_azureml_notebooks
Make sure that AzureML test can run programmatically (WORK IN PROGRESS)
2019-09-27 22:07:53 +01:00