huggingface-transformers/src/transformers
Lysandre Debut e09e54fd9d
MT5 should have an autotokenizer (#8743)
* MT5 should have an autotokenizer

* Different configurations should be able to point to same tokenizers
2020-11-24 09:50:25 -05:00
..
benchmark
commands Fix model templates (#8595) 2020-11-17 10:35:38 -05:00
data Fix DataCollatorForLanguageModeling (#8621) 2020-11-18 10:02:50 -05:00
models MT5 should have an autotokenizer (#8743) 2020-11-24 09:50:25 -05:00
utils gpt2 and t5 parallel modeling (#8696) 2020-11-23 14:41:23 -05:00
__init__.py Add early stopping callback to pytorch trainer (#8581) 2020-11-23 17:25:35 -05:00
activations.py
activations_tf.py
configuration_utils.py Better filtering of the model outputs in Trainer (#8633) 2020-11-19 10:43:15 -05:00
convert_graph_to_onnx.py
convert_pytorch_checkpoint_to_tf2.py
convert_slow_tokenizer.py
convert_slow_tokenizers_checkpoints_to_fast.py
convert_tf_hub_seq_to_seq_bert_to_pytorch.py
file_utils.py Change default cache path (#8734) 2020-11-23 13:56:45 -05:00
generation_beam_search.py
generation_logits_process.py Vectorize RepetitionPenaltyLogitsProcessor to improve performance (#8598) 2020-11-20 19:59:06 +01:00
generation_tf_utils.py Tokenizers: ability to load from model subfolder (#8586) 2020-11-17 08:58:45 -05:00
generation_utils.py moved temperature wrapper before topP/topK (#8686) 2020-11-20 19:33:54 +01:00
hf_api.py
hf_argparser.py
integrations.py
modelcard.py Tokenizers: ability to load from model subfolder (#8586) 2020-11-17 08:58:45 -05:00
modeling_flax_utils.py
modeling_outputs.py
modeling_tf_outputs.py
modeling_tf_pytorch_utils.py consistent ignore keys + make private (#8737) 2020-11-23 12:33:13 -08:00
modeling_tf_utils.py consistent ignore keys + make private (#8737) 2020-11-23 12:33:13 -08:00
modeling_utils.py consistent ignore keys + make private (#8737) 2020-11-23 12:33:13 -08:00
optimization.py
optimization_tf.py Fix many typos (#8708) 2020-11-21 22:58:10 -05:00
pipelines.py Remove deprecated (#8604) 2020-11-17 15:11:29 -05:00
testing_utils.py Fix a few last paths for the new repo org (#8666) 2020-11-19 11:56:42 -05:00
tokenization_utils.py Remove deprecated (#8604) 2020-11-17 15:11:29 -05:00
tokenization_utils_base.py [tokenizers] convert_to_tensors: don't reconvert when the type is already right (#8283) 2020-11-19 12:06:01 -08:00
tokenization_utils_fast.py Remove deprecated (#8604) 2020-11-17 15:11:29 -05:00
trainer.py gpt2 and t5 parallel modeling (#8696) 2020-11-23 14:41:23 -05:00
trainer_callback.py Add early stopping callback to pytorch trainer (#8581) 2020-11-23 17:25:35 -05:00
trainer_pt_utils.py
trainer_tf.py Remove deprecated (#8604) 2020-11-17 15:11:29 -05:00
trainer_utils.py
training_args.py Document new training argument 2020-11-23 15:02:59 -05:00
training_args_tf.py