7b093813e2
* Start adding own BERTScore implementation * Prepare the basic backbone for own BERTScore * Make working BERTScore with all_layers=True + init bert_score in torchmetrics * Fix cuda device placing * Use IDF only if asked * Add data collators * Remove old parts of code * Fix IDF rescaling and add new tests + fix type * Add new tests for IDF * Add explicit dtypes when used torch.cat to make this work with older PT versions * Adjust code to work with the DDP plus some changes * Add a support for the DDP mode and add the corresponding test * Add a suport for verbose using tqdm loader * Fix a bug with tokenizer and add hash_code * Fix transformers import * Add support for the user's own model * Add the corresponding example * Fix error raised by default tokenizer * Add support for the rescale with baseline * Clean some code + add some docstirngs * Run bert-ddp tests only if torch.distributed.is_available() * Use smaller model, 'albert-base-v2', for testing because of OOM issues * Set join=False for mp_spawn in the ddp_test Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| bert_score-own_model.py | ||