huggingface-transformers/tests
Lysandre Debut 850afb422d
Patch token classification pipeline (#8364)
* Patch token classification pipeline

* Some added tests for TokenClassificationArgumentHandler (#8366)

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2020-11-10 07:29:34 -05:00
..
fixtures Add new token classification example (#8340) 2020-11-09 11:39:55 -05:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
conftest.py [CIs] Better reports everywhere (#8275) 2020-11-03 16:57:12 -05:00
test_activations.py Replace swish with silu (#8166) 2020-10-30 15:09:10 -04:00
test_activations_tf.py Replace swish with silu (#8166) 2020-10-30 15:09:10 -04:00
test_benchmark.py [Benchmarks] Change all args to from `no_...` to their positive form (#7075) 2020-09-23 13:25:24 -04:00
test_benchmark_tf.py [Benchmarks] Change all args to from `no_...` to their positive form (#7075) 2020-09-23 13:25:24 -04:00
test_cli.py [transformers-cli] fix logger getter (#6777) 2020-08-27 20:01:17 -04:00
test_configuration_auto.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_configuration_common.py [PretrainedConfig] Fix save pretrained config for edge case (#7943) 2020-10-22 15:39:01 +02:00
test_data_collator.py Clean up data collators and datasets (#8308) 2020-11-04 17:24:49 -05:00
test_doc_samples.py Fix ignore list behavior in doctests (#8213) 2020-11-02 08:47:37 -05:00
test_file_utils.py Model versioning (#8324) 2020-11-10 07:11:02 -05:00
test_flax_auto.py Integrate Bert-like model on Flax runtime. (#3722) 2020-10-19 09:55:41 -04:00
test_generation_beam_search.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_generation_logits_process.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_generation_utils.py [Generate Test] fix greedy generate test (#8293) 2020-11-04 15:44:36 +01:00
test_hf_api.py Model versioning (#8324) 2020-11-10 07:11:02 -05:00
test_hf_argparser.py Smarter prediction loop and no- -> no_ in console args (#8151) 2020-10-29 10:56:25 -04:00
test_logging.py Fix doc errors and typos across the board (#8139) 2020-10-29 10:33:33 -04:00
test_model_card.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_model_output.py Add tests and fix various bugs in ModelOutput (#7073) 2020-09-11 12:01:33 -04:00
test_modeling_albert.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_auto.py Blenderbot (#7418) 2020-10-07 19:09:23 -04:00
test_modeling_bart.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_bert.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_bert_generation.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_blenderbot.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_camembert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_modeling_common.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_ctrl.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_deberta.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_modeling_distilbert.py Black 20 release 2020-08-26 17:20:22 +02:00
test_modeling_dpr.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_electra.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_encoder_decoder.py [All Seq2Seq model + CLM models that can be used with EncoderDecoder] Add cross-attention weights to outputs (#8071) 2020-11-06 19:34:48 +01:00
test_modeling_flaubert.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_flax_bert.py Integrate Bert-like model on Flax runtime. (#3722) 2020-10-19 09:55:41 -04:00
test_modeling_flax_roberta.py Integrate Bert-like model on Flax runtime. (#3722) 2020-10-19 09:55:41 -04:00
test_modeling_fsmt.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_funnel.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_gpt2.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_layoutlm.py [testing] rename skip targets + docs (#7863) 2020-10-20 04:39:13 -04:00
test_modeling_longformer.py Output global_attentions in Longformer models (#7562) 2020-11-05 21:10:43 +01:00
test_modeling_lxmert.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_marian.py TFMarian, TFMbart, TFPegasus, TFBlenderbot (#7987) 2020-10-30 11:23:16 -04:00
test_modeling_mbart.py Cleanup pytorch tests (#8033) 2020-10-26 08:59:06 -04:00
test_modeling_mobilebert.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_openai.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_pegasus.py Cleanup pytorch tests (#8033) 2020-10-26 08:59:06 -04:00
test_modeling_prophetnet.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_rag.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_reformer.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_roberta.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_squeezebert.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_t5.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_modeling_tf_albert.py Update repo to isort v5 (#6686) 2020-08-24 11:03:01 -04:00
test_modeling_tf_auto.py Update repo to isort v5 (#6686) 2020-08-24 11:03:01 -04:00
test_modeling_tf_bart.py TFMarian, TFMbart, TFPegasus, TFBlenderbot (#7987) 2020-10-30 11:23:16 -04:00
test_modeling_tf_bert.py Model versioning (#8324) 2020-11-10 07:11:02 -05:00
test_modeling_tf_blenderbot.py TFMarian, TFMbart, TFPegasus, TFBlenderbot (#7987) 2020-10-30 11:23:16 -04:00
test_modeling_tf_camembert.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_tf_common.py Output global_attentions in Longformer models (#7562) 2020-11-05 21:10:43 +01:00
test_modeling_tf_ctrl.py Black 20 release 2020-08-26 17:20:22 +02:00
test_modeling_tf_distilbert.py test_tf_common: remove un_used mixin class parameters (#6866) 2020-09-02 10:54:40 -04:00
test_modeling_tf_electra.py Black 20 release 2020-08-26 17:20:22 +02:00
test_modeling_tf_flaubert.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_tf_funnel.py Fix saving TF custom models (#7291) 2020-09-22 09:31:13 -04:00
test_modeling_tf_gpt2.py [Seq2Seq] Fix a couple of bugs and clean examples (#7474) 2020-10-01 17:38:50 +02:00
test_modeling_tf_longformer.py Output global_attentions in Longformer models (#7562) 2020-11-05 21:10:43 +01:00
test_modeling_tf_lxmert.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_tf_marian.py TFMarian, TFMbart, TFPegasus, TFBlenderbot (#7987) 2020-10-30 11:23:16 -04:00
test_modeling_tf_mbart.py TFMarian, TFMbart, TFPegasus, TFBlenderbot (#7987) 2020-10-30 11:23:16 -04:00
test_modeling_tf_mobilebert.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_tf_openai.py [Generate] Facilitate PyTorch generate using `ModelOutputs` (#6735) 2020-09-01 12:38:25 +02:00
test_modeling_tf_pegasus.py TFMarian, TFMbart, TFPegasus, TFBlenderbot (#7987) 2020-10-30 11:23:16 -04:00
test_modeling_tf_pytorch.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_modeling_tf_roberta.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_modeling_tf_t5.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_tf_transfo_xl.py test_tf_common: remove un_used mixin class parameters (#6866) 2020-09-02 10:54:40 -04:00
test_modeling_tf_xlm.py Black 20 release 2020-08-26 17:20:22 +02:00
test_modeling_tf_xlm_roberta.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_tf_xlnet.py test_tf_common: remove un_used mixin class parameters (#6866) 2020-09-02 10:54:40 -04:00
test_modeling_transfo_xl.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_xlm.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_modeling_xlm_prophetnet.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_xlm_roberta.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_xlnet.py [Tests] Add Common Test for Training + Fix a couple of bugs (#8415) 2020-11-09 18:24:41 +01:00
test_onnx.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_optimization.py Format 2020-08-27 18:31:51 +02:00
test_optimization_tf.py Update repo to isort v5 (#6686) 2020-08-24 11:03:01 -04:00
test_pipelines_common.py Fix the behaviour of DefaultArgumentHandler (removing it). (#8180) 2020-11-02 12:33:50 +01:00
test_pipelines_conversational.py Updated ConversationalPipeline to work with encoder-decoder models (#8207) 2020-11-03 10:33:01 -05:00
test_pipelines_dialog.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_pipelines_feature_extraction.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_pipelines_fill_mask.py Fix the behaviour of DefaultArgumentHandler (removing it). (#8180) 2020-11-02 12:33:50 +01:00
test_pipelines_ner.py Patch token classification pipeline (#8364) 2020-11-10 07:29:34 -05:00
test_pipelines_question_answering.py Improve QA pipeline error handling (#8286) 2020-11-04 11:30:42 -05:00
test_pipelines_sentiment_analysis.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_pipelines_summarization.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_pipelines_text2text_generation.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_pipelines_text_generation.py [FIX] TextGenerationPipeline is currently broken. (#8256) 2020-11-03 10:10:22 -05:00
test_pipelines_translation.py [tests|tokenizers] Refactoring pipelines test backbone - Small tokenizers improvements - General tests speedups (#7970) 2020-10-23 15:58:19 +02:00
test_pipelines_zero_shot.py Fix the behaviour of DefaultArgumentHandler (removing it). (#8180) 2020-11-02 12:33:50 +01:00
test_retrieval_rag.py Allow Custom Dataset in RAG Retriever (#7763) 2020-10-19 19:42:45 +02:00
test_skip_decorators.py [testing] rename skip targets + docs (#7863) 2020-10-20 04:39:13 -04:00
test_tokenization_albert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_auto.py [testing] slow tests should be marked as slow (#7895) 2020-10-22 06:34:05 -04:00
test_tokenization_bart.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_bert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_bert_generation.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_bert_japanese.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_bertweet.py Add new pre-trained models BERTweet and PhoBERT (#6129) 2020-09-18 13:16:43 -04:00
test_tokenization_blenderbot.py Fix + Test (#8049) 2020-10-26 12:32:27 -04:00
test_tokenization_camembert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_common.py [tokenizers] Fixing #8001 - Adding tests on tokenizers serialization (#8006) 2020-10-26 10:27:48 +01:00
test_tokenization_ctrl.py Adding Fast tokenizers for SentencePiece based tokenizers - Breaking: remove Transfo-XL fast tokenizer (#7141) 2020-10-08 11:32:16 +02:00
test_tokenization_deberta.py Add DeBERTa model (#5929) 2020-09-30 07:07:30 -04:00
test_tokenization_distilbert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_dpr.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_fsmt.py [fsmt tokenizer] support lowercase tokenizer (#8389) 2020-11-09 10:41:39 -05:00
test_tokenization_funnel.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_gpt2.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_herbert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_layoutlm.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_lxmert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_marian.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_mbart.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_openai.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_pegasus.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_phobert.py Add new pre-trained models BERTweet and PhoBERT (#6129) 2020-09-18 13:16:43 -04:00
test_tokenization_prophetnet.py ProphetNet (#7157) 2020-10-19 17:36:09 +02:00
test_tokenization_rag.py [Rag] Fix loading of pretrained Rag Tokenizer (#7756) 2020-10-13 14:34:22 +02:00
test_tokenization_reformer.py [Reformer] remove reformer pad_token_id (#7991) 2020-10-23 10:29:15 -04:00
test_tokenization_roberta.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_squeezebert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_t5.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_transfo_xl.py Adding Fast tokenizers for SentencePiece based tokenizers - Breaking: remove Transfo-XL fast tokenizer (#7141) 2020-10-08 11:32:16 +02:00
test_tokenization_utils.py Fix BatchEncoding.word_to_tokens for removed tokens (#7939) 2020-10-23 10:29:37 -04:00
test_tokenization_xlm.py Adding Fast tokenizers for SentencePiece based tokenizers - Breaking: remove Transfo-XL fast tokenizer (#7141) 2020-10-08 11:32:16 +02:00
test_tokenization_xlm_prophetnet.py ProphetNet (#7157) 2020-10-19 17:36:09 +02:00
test_tokenization_xlm_roberta.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_xlnet.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_trainer.py Make Trainer evaluation handle dynamic seq_length (#8336) 2020-11-05 15:13:51 -05:00
test_trainer_callback.py Fix a bug for `CallbackHandler.callback_list` (#8052) 2020-10-27 10:37:04 -04:00
test_trainer_distributed.py [testing] port test_trainer_distributed to distributed pytest + TestCasePlus enhancements (#8107) 2020-10-28 11:51:32 -04:00
test_trainer_tpu.py Add predict step accumulation (#7767) 2020-10-14 11:41:45 -04:00
test_trainer_utils.py Add predict step accumulation (#7767) 2020-10-14 11:41:45 -04:00
test_utils_check_copies.py Get a better error when check_copies fails (#7457) 2020-09-30 10:05:14 +02:00