Taku Kudo
|
ce0f85c2bb
|
Merge pull request #110 from google/sr
Introduced minimum string_wrapper to remove extra string copy
|
2018-06-18 21:01:15 +09:00 |
Taku Kudo
|
905c49e6b4
|
Introduced minimum string_wrapper to remove extra string copy
|
2018-06-18 20:16:15 +09:00 |
|
Taku Kudo
|
a0c7145a30
|
Merge pull request #108 from google/sr
remove src/stringpiece.h
|
2018-06-18 10:18:00 +09:00 |
|
Taku Kudo
|
936df42c2c
|
remove src/stringpiece.h
|
2018-06-18 09:50:42 +09:00 |
|
Taku Kudo
|
7e88d734cc
|
Merge pull request #107 from google/sr
Uses absl::string_view instead of StringPiece
|
2018-06-18 09:46:42 +09:00 |
|
Taku Kudo
|
75c18c6e04
|
Uses abs::string_view instead of StringPiece
|
2018-06-18 09:31:16 +09:00 |
|
Taku Kudo
|
6884e10ccd
|
Merge pull request #106 from google/sr
hMinor fixes
|
2018-06-17 17:07:23 +09:00 |
|
Taku Kudo
|
f941443ff0
|
Update README.md
|
2018-06-17 17:02:01 +09:00 |
|
Taku Kudo
|
74a7e18077
|
Minor fixes
|
2018-06-17 16:39:40 +09:00 |
|
Taku Kudo
|
d91124834a
|
Update README.md
|
2018-06-16 23:23:25 +09:00 |
|
Taku Kudo
|
bcdfc037b1
|
Merge pull request #105 from google/sr
Splits travis rule for Python wrapper
|
2018-06-16 23:18:53 +09:00 |
|
Taku Kudo
|
0a30c9bac1
|
Support snake case in Python module
|
2018-06-16 22:58:24 +09:00 |
|
Taku Kudo
|
d5f501059b
|
Splits travis rule for Python wrapper
|
2018-06-16 18:32:16 +09:00 |
|
Taku Kudo
|
68aba64804
|
Merge pull request #104 from google/sr
Minor fixes.
|
2018-06-16 17:03:03 +09:00 |
|
Taku Kudo
|
511b831968
|
Minor fixes.
|
2018-06-16 16:22:16 +09:00 |
|
Taku Kudo
|
4093e91909
|
Update api.md
|
2018-06-11 12:53:08 +09:00 |
|
Taku Kudo
|
ec00ff6e2d
|
Update normalization.md
|
2018-06-11 12:46:55 +09:00 |
|
Taku Kudo
|
02c8505329
|
Minor style fixes.
|
2018-06-11 12:43:57 +09:00 |
|
Taku Kudo
|
6173f9860f
|
Merge pull request #100 from google/sr
Support an empty normalization and other minor fixes
|
2018-06-11 12:36:50 +09:00 |
|
Taku Kudo
|
7875b8b8c5
|
Support an empty normalziation and other minor fixes
|
2018-06-11 11:28:36 +09:00 |
|
Taku Kudo
|
f46fad6c41
|
Update normalization.md
|
2018-06-11 10:36:10 +09:00 |
|
Taku Kudo
|
a59ce99ce3
|
Merge pull request #99 from kant/patch-2
Added link on string #32
|
2018-06-11 10:23:02 +09:00 |
Darío Hereñú
|
b915766b48
|
Added link on string #32
|
2018-06-10 22:08:22 -03:00 |
|
Taku Kudo
|
20e68fa7c4
|
added missing include
|
2018-06-11 09:13:07 +09:00 |
|
Taku Kudo
|
910bab1a2c
|
Merge pull request #98 from google/sr
Uses NMT_NFKC rule by default.
|
2018-06-10 14:16:08 +09:00 |
|
Taku Kudo
|
a65ca0d829
|
Uses NMT_NFKC rule by default.
|
2018-06-10 01:15:34 +09:00 |
|
Taku Kudo
|
a574ce183c
|
Update README.md
|
2018-06-09 00:34:58 +09:00 |
|
Taku Kudo
|
a929b63458
|
Update README.md
|
2018-06-09 00:32:55 +09:00 |
|
Taku Kudo
|
53e4ae415e
|
Update README.md
|
2018-06-09 00:26:48 +09:00 |
|
Taku Kudo
|
b35f05dda3
|
Merge pull request #97 from google/sr
Allows to define duplicated user defined symbols
|
2018-06-08 22:53:25 +09:00 |
|
Taku Kudo
|
db1eeac985
|
Allows to define duplicated user defined symbols
|
2018-06-08 22:10:13 +09:00 |
|
Taku Kudo
|
5d3f99b0d2
|
Merge pull request #95 from google/sr
Support user defined symbols in Char/BPE
|
2018-06-08 00:57:11 +09:00 |
|
Taku Kudo
|
54ccef78b8
|
Support user defined symbols in Char/BPE
|
2018-06-08 00:06:42 +09:00 |
|
Taku Kudo
|
7edac0b4ef
|
Merge pull request #92 from google/sr
Added --generate_vocabulary option to spm_encode
|
2018-06-07 01:01:05 +09:00 |
|
Taku Kudo
|
53ea373084
|
Added --generate_vocabulary option to spm_encode
|
2018-06-07 00:30:16 +09:00 |
|
Taku Kudo
|
fc7130f394
|
Merge pull request #91 from google/sr
Support vocab restriction feature in BPE model.
|
2018-06-06 19:22:59 +09:00 |
|
Taku Kudo
|
aeec94b63a
|
Support vocab restriction feature in BPE model.
|
2018-06-06 19:18:53 +09:00 |
|
Taku Kudo
|
93d84a6f3c
|
Merge pull request #90 from google/sr
Support vocab restriction feature
|
2018-06-06 18:07:54 +09:00 |
|
Taku Kudo
|
e437e30bb4
|
Support vocab restriction feature
|
2018-06-06 16:47:59 +09:00 |
|
Taku Kudo
|
c6e84aebc9
|
Merge pull request #89 from google/sr
Minor style fixes
|
2018-06-05 02:29:13 +09:00 |
|
Taku Kudo
|
2ff4267b91
|
Minor style fixes
|
2018-06-05 01:44:15 +09:00 |
|
Taku Kudo
|
506aa4595a
|
Merge pull request #88 from google/sr
Updated normalizer
|
2018-06-04 21:02:32 +09:00 |
|
Taku Kudo
|
4e3bcf1373
|
Updated normalizer
|
2018-06-04 20:32:37 +09:00 |
|
Taku Kudo
|
4f7af0dfad
|
Merge pull request #86 from google/sr
Made DecodeUTF8 more strict.
|
2018-05-13 22:03:47 +09:00 |
|
Taku Kudo
|
4a200b8974
|
Made DecodeUTF8 more strict.
|
2018-05-13 21:31:51 +09:00 |
|
Taku Kudo
|
eb43a63e5d
|
Merge pull request #85 from google/sr
s/PopulateNormalizationSpec/PopulateNormalizerSpec/
|
2018-05-12 00:07:07 +09:00 |
|
Taku Kudo
|
2e01a0890e
|
s/PopulateNormalizationSpec/PopulateNormalizerSpec/
|
2018-05-11 23:24:12 +09:00 |
|
Taku Kudo
|
49da7daf91
|
Merge pull request #84 from google/sr
Fixed build errors
|
2018-05-11 23:15:35 +09:00 |
|
Taku Kudo
|
f3b1fb8233
|
Fixed build errors
|
2018-05-11 22:11:22 +09:00 |
|
Taku Kudo
|
b15b0ef272
|
Merge pull request #83 from google/sr
CHECK to util::Status migration for Builder
|
2018-05-11 21:39:14 +09:00 |