Taku Kudo
|
d64cc9ada6
|
Merge pull request #128 from google/sr
Added new API to get bos/eos/unk/pad ids
|
2018-07-13 01:39:08 +09:00 |
Taku Kudo
|
256c6f5bb7
|
Added new API to get bos/eos/unk/pad ids
|
2018-07-13 01:24:46 +09:00 |
|
Taku Kudo
|
983c0f5aeb
|
Update README.md
|
2018-07-12 09:38:11 +09:00 |
|
Taku Kudo
|
f949f9e571
|
Merge pull request #124 from johndpope/patch-1
typo
|
2018-07-03 08:38:48 +09:00 |
John Pope
|
11bbbf2781
|
typo
|
2018-07-02 14:44:32 -04:00 |
|
Taku Kudo
|
ee4ca7fd2e
|
Update normalization.md
|
2018-06-30 16:11:01 +09:00 |
|
Taku Kudo
|
6c86c2f07d
|
Changed the hard-limit of --mining_sentence_size
|
2018-06-30 00:55:31 +09:00 |
|
Taku Kudo
|
8e9254bdb7
|
Merge pull request #123 from google/sr
Added normalization with Unicode case folding
|
2018-06-30 00:17:29 +09:00 |
|
Taku Kudo
|
573586854e
|
Added normalization with Unicode case folding
|
2018-06-29 15:17:18 +09:00 |
|
Taku Kudo
|
65cae492a7
|
Update README.md
|
2018-06-29 11:10:39 +09:00 |
|
Taku Kudo
|
d598296450
|
Update README.md
|
2018-06-29 02:47:11 +09:00 |
|
Taku Kudo
|
e605990832
|
Update README.md
|
2018-06-29 02:45:55 +09:00 |
|
Taku Kudo
|
6f84d6bfa5
|
Update README.md
|
2018-06-29 02:44:57 +09:00 |
|
Taku Kudo
|
f4d0ddce6d
|
Merge pull request #112 from neubig/fix-mac-compile
Fixed mac compile error.
Seems the error reported on travis is not related to this pullrequest. Thank you for fixing it.
|
2018-06-28 17:06:24 +09:00 |
|
Taku Kudo
|
c01d21bfbf
|
Updated test.sh to fix build error on OSX.
|
2018-06-27 14:44:30 +09:00 |
|
Taku Kudo
|
8c91faf5d9
|
Small bug fixes
|
2018-06-27 02:42:24 +09:00 |
|
Taku Kudo
|
035cb974be
|
Merge pull request #120 from google/sr
Added rule for tensorflow build
|
2018-06-26 17:31:59 +09:00 |
|
Taku Kudo
|
147faabd3f
|
Added rule for tensorflow build
|
2018-06-26 17:19:13 +09:00 |
|
Taku Kudo
|
5e7cee1b1e
|
Merge pull request #118 from google/sr
Added Tensorflow module
|
2018-06-26 16:36:54 +09:00 |
|
Taku Kudo
|
81d1a091fb
|
Added Tensorflow module
|
2018-06-26 14:59:55 +09:00 |
|
Taku Kudo
|
65da95da9a
|
Added licence header
|
2018-06-26 13:41:29 +09:00 |
|
Taku Kudo
|
323af54cd6
|
Making a static link for python wheel package
|
2018-06-25 15:38:36 +09:00 |
|
Taku Kudo
|
bfa93cc8fc
|
Merge pull request #117 from google/sr
Add LoadFromSerialiedProto to Python wrapper
|
2018-06-24 23:12:32 +09:00 |
|
Taku Kudo
|
293b1863b9
|
Add LoadFromSerialiedProto to Python wrapper
|
2018-06-24 22:33:25 +09:00 |
|
Taku Kudo
|
0eccb9aa0d
|
Merge pull request #116 from google/sr
Add LoadFromSerialiedProto
|
2018-06-23 14:41:34 +09:00 |
|
Taku Kudo
|
313f6feb5b
|
Add LoadFromSerialiedProto
|
2018-06-22 13:54:18 +09:00 |
Graham Neubig
|
1162701ce9
|
Merge branch 'master' of github.com:google/sentencepiece into fix-mac-compile
|
2018-06-20 08:00:49 -04:00 |
|
Taku Kudo
|
cff66162c3
|
Remove empty lines from example data
|
2018-06-20 17:23:18 +09:00 |
|
Taku Kudo
|
ed6f832234
|
Merge pull request #115 from google/sr
Fixes the usage of strerror_r
|
2018-06-20 10:58:29 +09:00 |
|
Taku Kudo
|
23959e3c94
|
Fixes the usage of strerror_r
|
2018-06-20 10:37:28 +09:00 |
|
Taku Kudo
|
0fd7f6b331
|
Update .travis.yml
|
2018-06-20 02:07:01 +09:00 |
|
Taku Kudo
|
425468daf2
|
Update test.sh
|
2018-06-20 01:55:39 +09:00 |
|
Taku Kudo
|
116d2afe5f
|
Update test.sh
|
2018-06-20 01:38:03 +09:00 |
|
Taku Kudo
|
ed10037d2d
|
Update test.sh
|
2018-06-20 01:26:46 +09:00 |
|
Taku Kudo
|
d5293c93e2
|
Merge pull request #113 from google/sr
Avoids copy in Python2 Unicode mode.
|
2018-06-20 00:25:51 +09:00 |
|
Taku Kudo
|
5a246f5cef
|
Avoids copy in Python2 Unicode mode.
|
2018-06-19 23:29:12 +09:00 |
|
Taku Kudo
|
2d9df1e6dc
|
Update test.sh
|
2018-06-19 22:28:27 +09:00 |
|
Taku Kudo
|
c6047dc9be
|
Update test.sh
|
2018-06-19 14:27:31 +09:00 |
|
Taku Kudo
|
fbd7c2b8f7
|
Update sentencepiece_processor.h
|
2018-06-19 12:42:57 +09:00 |
|
Graham Neubig
|
4af15dd3c6
|
Fixed error
|
2018-06-18 17:18:25 -04:00 |
|
Taku Kudo
|
dd1af3ba0c
|
Update README.md
|
2018-06-18 21:17:27 +09:00 |
|
Taku Kudo
|
271adf6024
|
Update README.md
|
2018-06-18 21:16:53 +09:00 |
|
Taku Kudo
|
03136f198b
|
Fixed build error on clang.
|
2018-06-18 21:02:08 +09:00 |
|
Taku Kudo
|
ce0f85c2bb
|
Merge pull request #110 from google/sr
Introduced minimum string_wrapper to remove extra string copy
|
2018-06-18 21:01:15 +09:00 |
|
Taku Kudo
|
905c49e6b4
|
Introduced minimum string_wrapper to remove extra string copy
|
2018-06-18 20:16:15 +09:00 |
|
Taku Kudo
|
a0c7145a30
|
Merge pull request #108 from google/sr
remove src/stringpiece.h
|
2018-06-18 10:18:00 +09:00 |
|
Taku Kudo
|
936df42c2c
|
remove src/stringpiece.h
|
2018-06-18 09:50:42 +09:00 |
|
Taku Kudo
|
7e88d734cc
|
Merge pull request #107 from google/sr
Uses absl::string_view instead of StringPiece
|
2018-06-18 09:46:42 +09:00 |
|
Taku Kudo
|
75c18c6e04
|
Uses abs::string_view instead of StringPiece
|
2018-06-18 09:31:16 +09:00 |
|
Taku Kudo
|
6884e10ccd
|
Merge pull request #106 from google/sr
hMinor fixes
|
2018-06-17 17:07:23 +09:00 |