saidbleik
a8287dfea0
fix ner pred function
2020-02-15 18:48:06 +00:00
hlums
4641eb9e87
Minor edits
2020-02-13 23:49:05 +00:00
saidbleik
69357e5937
update move_model_to_device args
2020-02-13 21:21:17 +00:00
saidbleik
cd0a001dd9
updated ext summarization files
2020-02-12 22:00:52 +00:00
Ubuntu
fff98faf58
move to device part of abssum
2020-02-12 21:13:14 +00:00
saidbleik
01d69abf98
update sequence classification files
2020-02-12 20:16:49 +00:00
Ubuntu
9860de4f46
fit verified with pretrained model
2020-02-12 04:47:22 +00:00
Hong Lu
675e5827ea
Merge pull request #553 from microsoft/bleik/rel-patch1
...
Fix QA notebook issue
2020-02-11 13:54:30 -05:00
saidbleik
67b1d8a8ea
fix qa notebook
2020-02-11 05:27:23 +00:00
Daisy Deng
e5b4a3a66d
add test
2020-02-05 05:40:54 +00:00
Daisy Deng
1d2873c376
add import
2020-01-31 03:53:00 +00:00
Daisy Deng
bb25e16710
add test
2020-01-30 05:53:00 +00:00
Said Bleik
7dcdc32399
Merge pull request #529 from microsoft/bleik/optim-patch
...
bleik/common transformers utils update
2020-01-24 20:06:37 -05:00
saidbleik
9db5a3708c
minor edits
2020-01-23 23:59:31 +00:00
hlums
b5a9f502f3
Change local_rank to 0 to make test pass on 1 GPU machine.
2020-01-22 16:24:04 +00:00
saidbleik
489f5381b8
specify model name in NER test
2020-01-19 19:24:10 +00:00
saidbleik
30a9e0342b
add pytest marker to ner test
2020-01-18 19:38:10 +00:00
saidbleik
4b2ced52ba
rem num_labels check
2020-01-18 18:07:39 +00:00
saidbleik
ecb7245270
Merge branch 'bleik/optim-patch' of https://github.com/microsoft/nlp-recipes into bleik/optim-patch
2020-01-18 06:28:09 +00:00
saidbleik
2b1736086f
update pytorch utils tests
2020-01-18 06:15:32 +00:00
saidbleik
b6424d173e
update pytorch_utils tests
2020-01-18 06:09:20 +00:00
Said Bleik
97f6f0814b
Update test_notebooks_extractive_summarization.py
2020-01-17 00:06:37 -05:00
saidbleik
b76750aaa6
NER updates
2020-01-17 02:16:10 +00:00
saidbleik
82816318dc
update summarization files
2020-01-16 19:14:24 +00:00
saidbleik
2a4c1be721
Merge remote-tracking branch 'origin/staging' into bleik/optim-patch
2020-01-14 20:04:38 +00:00
saidbleik
c7d3409dfd
update QA utils and tests
2020-01-14 17:08:58 +00:00
saidbleik
5611740f96
update seq classification examples
2020-01-13 21:00:11 +00:00
saidbleik
9811b8abfb
restructuring of common transformers utils
2020-01-13 17:45:00 +00:00
saidbleik
8242bcf767
modified structure of transformer wrapper
2020-01-08 06:37:42 +00:00
hlums
59ca52b222
Merge with staging and resolve conflict.
2020-01-07 22:41:41 +00:00
hlums
68d02bdba4
Resolve simple review comments.
2020-01-06 19:14:49 +00:00
Daisy Deng
1dc0570616
use dataset in finetuning
2020-01-06 18:58:49 +00:00
Daisy Deng
b7af2127e7
add documentation
2020-01-03 05:46:22 +00:00
Daisy Deng
120b9734fe
add integration test for extractive summarization
2020-01-02 21:17:11 +00:00
Daisy Deng
8801ea75b9
use the new dataset for testing
2020-01-02 19:23:31 +00:00
hlums
acb03d0e8e
Add Hindi ROUGE computation.
2019-12-26 22:55:17 +00:00
hlums
8e172d6172
Merge branch 'staging', remote-tracking branch 'origin' into hlu/summarization_evaluation
2019-12-26 11:29:45 -05:00
Daisy Deng
d6233c7a7e
remove the temp_target printout
2019-12-24 02:48:14 +00:00
hlums
8d5ae4fcdd
Add tests for compute_rouge.py
2019-12-20 22:02:24 +00:00
Daisy Deng
408f87cb8c
add a test for extractive summarization
2019-12-17 20:51:56 +00:00
Daisy Deng
69c63023a0
remove unnecessary files
2019-12-13 21:05:40 +00:00
Ubuntu
5e4d15ffde
fix typoes
2019-12-05 20:47:07 +00:00
Ubuntu
50d3891bf8
remove the sys path
2019-12-05 20:47:07 +00:00
Ubuntu
ee973ea03d
remove unnecessary arguments; add documentation
2019-12-05 20:41:32 +00:00
Ubuntu
1d49b963da
add unit test
2019-12-05 20:40:06 +00:00
Miguel González-Fierro
ed04438ae1
Staging to master to add the latest fixes ( #503 )
...
* update mlflow version to match the other azureml versions
* Update generate_conda_file.py
* added temporary
* doc: update github url references
* docs: update nlp recipes references
* Minor bug fix for text classification of multi languages notebook
* remove bert and xlnet notebooks
* remove obsolete tests and links
* Add missing tmp directories.
* fix import error and max_nodes for the cluster
* Minor edits.
* Attempt to fix test device error.
* Temporarily pin transformers version
* Remove gpu tags temporarily
* Test whether device error also occurs for SequenceClassifier.
* Revert temporary changes.
* Revert temporary changes.
2019-11-29 19:53:57 -05:00
Miguel González-Fierro
857ce5ca33
Merge pull request #498 from microsoft/hlu/fix_temp_directories
...
Hlu/fix temp directories
2019-11-28 14:04:10 +00:00
hlums
3bb5cce068
Revert temporary changes.
2019-11-27 23:27:01 +00:00
hlums
321032e0e5
Revert temporary changes.
2019-11-27 23:25:49 +00:00
hlums
40ae2b7170
Test whether device error also occurs for SequenceClassifier.
2019-11-27 23:09:09 +00:00
hlums
3e72fb034e
Remove gpu tags temporarily
2019-11-27 23:08:28 +00:00
hlums
d13cce1e37
Minor edits.
2019-11-27 19:46:42 +00:00
hlums
0b4b25638e
Add missing tmp directories.
2019-11-26 22:44:21 +00:00
saidbleik
b0dc696acc
remove obsolete tests and links
2019-11-26 21:10:01 +00:00
saidbleik
d71de4a1d5
remove bert and xlnet notebooks
2019-11-25 20:43:14 +00:00
miguelgfierro
00d9ca0b17
added temporary
2019-11-21 19:15:49 +00:00
Ke Huang
6e19905a13
Updated NER utils and notebook use the new Transformer class
2019-11-15 16:34:04 -05:00
Hong Lu
de60b4446d
Merge branch 'staging' into hlu/update_entailment_notebook_to_use_transformers
2019-11-14 23:08:05 -05:00
hlums
8e542482fb
Uncomment a test.
2019-11-15 03:47:01 +00:00
saidbleik
b22b1845a0
fix tc tests
2019-11-15 03:35:23 +00:00
hlums
6301686f52
Merge branch 'hlu/update_entailment_notebook_to_use_transformers' of https://github.com/Microsoft/NLP into hlu/update_entailment_notebook_to_use_transformers
2019-11-15 03:13:15 +00:00
hlums
dab0f019c8
Update entailment notebook test.
2019-11-15 03:13:03 +00:00
hlums
3b695174e3
Update QA utils and notebook to pass dataloader to fit and predict.
2019-11-14 23:07:32 +00:00
saidbleik
fab7ace1a6
update qadataset import
2019-11-14 19:32:22 +00:00
saidbleik
af77a06434
Merge branch 'transformers2' of https://github.com/microsoft/nlp into transformers2
2019-11-14 19:30:09 +00:00
saidbleik
51568defa2
update qadataset import
2019-11-14 19:29:15 +00:00
Ke Huang
f176bba1d8
Merge branch 'transformers2' of https://github.com/microsoft/nlp into kehuan-transformers
2019-11-14 11:51:11 -05:00
Ke Huang
d52bfc653b
Added TC notebooks for multi languages
2019-11-14 11:51:04 -05:00
saidbleik
6c7975ce09
update import in test_dataset_pytorch
2019-11-14 16:19:51 +00:00
Ke Huang
3680835694
Merge branch 'transformers2' of https://github.com/microsoft/nlp into kehuan-transformers
2019-11-13 11:02:13 -05:00
Miguel González-Fierro
fc80039835
trigger tests
2019-11-08 20:36:12 +00:00
Miguel González-Fierro
4f651bc772
Merge branch 'staging' into transformers2
2019-11-08 16:06:44 +00:00
hlums
c406c3bb19
Remove pytorch-transformers from dependencies.
2019-11-05 14:05:45 -05:00
Said Bleik
af245b569f
Merge pull request #449 from microsoft/kehuan-transformers
...
Added NER notebook using pretrained transformer model and wikigold da…
2019-10-29 11:00:45 -04:00
Said Bleik
b964115aac
Update conftest.py
2019-10-29 10:17:38 -04:00
Ke Huang
9ad9a56489
Updated wikigold dataset, NER python file and notebook, also updated tests
2019-10-28 13:28:18 -04:00
hlums
7a41da9dcb
Add result assertion to entailment notebook test.
2019-10-25 18:57:54 +00:00
hlums
0d09498a56
Add result assertion to qa notebook test.
2019-10-25 18:11:36 +00:00
Ubuntu
51bfbc946f
Add result assertion to qa notebook test.
2019-10-25 17:43:48 +00:00
miguelgfierro
6ff9b2dd3c
removed repeated get_device
2019-10-25 14:24:24 +01:00
Said Bleik
ee67aa0108
Merge branch 'staging' into transformers2
2019-10-23 16:09:46 -04:00
saidbleik
e83bf05a4d
edits and updates
2019-10-23 19:26:17 +00:00
hlums
755bd43dc0
Fix license link in test_maybe_download.
2019-10-22 16:10:31 +00:00
hlums
eaad52a6ef
Fix license link in test_maybe_download.
2019-10-22 11:43:24 -04:00
hlums
e6a3092318
Fix license link in test_maybe_download.
2019-10-22 10:53:49 -04:00
hlums
9385beff90
Fix minor bug in conftest.py
2019-10-21 17:50:51 +00:00
Hong Lu
a8f5d4a1c5
Merge branch 'staging' into hlu/qa_transformers
2019-10-21 13:47:52 -04:00
hlums
6824595758
Revert "Merge with staging and resolve conflicts."
...
This reverts commit 3715eaefc6
.
2019-10-21 17:46:01 +00:00
hlums
3715eaefc6
Merge with staging and resolve conflicts.
2019-10-21 17:23:22 +00:00
hlums
4c29667086
More tests for list of ground truth answers.
2019-10-21 16:04:30 +00:00
hlums
4677d0b6e4
Moved postprocess function into QAProcessor.
2019-10-17 18:57:05 +00:00
hlums
9d25215619
Rename question answering evaluation script.
2019-10-17 17:36:40 +00:00
hlums
027bff43d8
Add test for question answering notebook.
2019-10-17 17:35:48 +00:00
hlums
0201c07478
Add test for question answering notebook.
2019-10-17 17:35:33 +00:00
hlums
4b6295b654
Add tmp path.
2019-10-17 17:34:39 +00:00
hlums
45a8196575
Add test for QADataset.
2019-10-04 21:56:26 +00:00
hlums
37bc46b0b7
Add tests for question answering utils.
2019-10-04 21:53:35 +00:00
hlums
08cb4707b0
Add test code for squad data utils.
2019-10-04 21:52:35 +00:00
hlums
8cd3cd25ac
Add test for AnswerExtractor.
2019-10-03 20:57:28 +00:00
Miguel González-Fierro
f41faf587e
Merge pull request #262 from microsoft/miguel/pipeline_azureml_notebooks
...
Make sure that AzureML test can run programmatically (WORK IN PROGRESS)
2019-09-27 22:07:53 +01:00