This commit is contained in:
Taku Kudo 2017-03-08 17:18:54 +09:00
Родитель 7bd6cf7654
Коммит f4d062f6e0
1 изменённых файлов: 2 добавлений и 0 удалений

Просмотреть файл

@ -1,5 +1,7 @@
# SentencePiece
[![Build Status](https://travis-ci.org/google/sentencepiece.svg?branch=master)](https://travis-ci.org/google/sentencepiece)
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for
Neural Network-based text generation systems where the vocabulary size
is predetermined prior to the neural model training. SentencePiece implements