Граф коммитов

241 Коммитов

Автор SHA1 Сообщение Дата
Taku Kudo 03136f198b
Fixed build error on clang. 2018-06-18 21:02:08 +09:00
Taku Kudo ce0f85c2bb
Merge pull request #110 from google/sr
Introduced minimum string_wrapper to remove extra string copy
2018-06-18 21:01:15 +09:00
Taku Kudo 905c49e6b4 Introduced minimum string_wrapper to remove extra string copy 2018-06-18 20:16:15 +09:00
Taku Kudo a0c7145a30
Merge pull request #108 from google/sr
remove src/stringpiece.h
2018-06-18 10:18:00 +09:00
Taku Kudo 936df42c2c remove src/stringpiece.h 2018-06-18 09:50:42 +09:00
Taku Kudo 7e88d734cc
Merge pull request #107 from google/sr
Uses absl::string_view instead of StringPiece
2018-06-18 09:46:42 +09:00
Taku Kudo 75c18c6e04 Uses abs::string_view instead of StringPiece 2018-06-18 09:31:16 +09:00
Taku Kudo 6884e10ccd
Merge pull request #106 from google/sr
hMinor fixes
2018-06-17 17:07:23 +09:00
Taku Kudo f941443ff0
Update README.md 2018-06-17 17:02:01 +09:00
Taku Kudo 74a7e18077 Minor fixes 2018-06-17 16:39:40 +09:00
Taku Kudo d91124834a
Update README.md 2018-06-16 23:23:25 +09:00
Taku Kudo bcdfc037b1
Merge pull request #105 from google/sr
Splits travis rule for Python wrapper
2018-06-16 23:18:53 +09:00
Taku Kudo 0a30c9bac1 Support snake case in Python module 2018-06-16 22:58:24 +09:00
Taku Kudo d5f501059b Splits travis rule for Python wrapper 2018-06-16 18:32:16 +09:00
Taku Kudo 68aba64804
Merge pull request #104 from google/sr
Minor fixes.
2018-06-16 17:03:03 +09:00
Taku Kudo 511b831968 Minor fixes. 2018-06-16 16:22:16 +09:00
Taku Kudo 4093e91909
Update api.md 2018-06-11 12:53:08 +09:00
Taku Kudo ec00ff6e2d
Update normalization.md 2018-06-11 12:46:55 +09:00
Taku Kudo 02c8505329 Minor style fixes. 2018-06-11 12:43:57 +09:00
Taku Kudo 6173f9860f
Merge pull request #100 from google/sr
Support an empty normalization and other minor fixes
2018-06-11 12:36:50 +09:00
Taku Kudo 7875b8b8c5 Support an empty normalziation and other minor fixes 2018-06-11 11:28:36 +09:00
Taku Kudo f46fad6c41
Update normalization.md 2018-06-11 10:36:10 +09:00
Taku Kudo a59ce99ce3
Merge pull request #99 from kant/patch-2
Added link on string #32
2018-06-11 10:23:02 +09:00
Darío Hereñú b915766b48
Added link on string #32 2018-06-10 22:08:22 -03:00
Taku Kudo 20e68fa7c4 added missing include 2018-06-11 09:13:07 +09:00
Taku Kudo 910bab1a2c
Merge pull request #98 from google/sr
Uses NMT_NFKC rule by default.
2018-06-10 14:16:08 +09:00
Taku Kudo a65ca0d829 Uses NMT_NFKC rule by default. 2018-06-10 01:15:34 +09:00
Taku Kudo a574ce183c
Update README.md 2018-06-09 00:34:58 +09:00
Taku Kudo a929b63458
Update README.md 2018-06-09 00:32:55 +09:00
Taku Kudo 53e4ae415e
Update README.md 2018-06-09 00:26:48 +09:00
Taku Kudo b35f05dda3
Merge pull request #97 from google/sr
Allows to define duplicated user defined symbols
2018-06-08 22:53:25 +09:00
Taku Kudo db1eeac985 Allows to define duplicated user defined symbols 2018-06-08 22:10:13 +09:00
Taku Kudo 5d3f99b0d2
Merge pull request #95 from google/sr
Support user defined symbols in Char/BPE
2018-06-08 00:57:11 +09:00
Taku Kudo 54ccef78b8 Support user defined symbols in Char/BPE 2018-06-08 00:06:42 +09:00
Taku Kudo 7edac0b4ef
Merge pull request #92 from google/sr
Added --generate_vocabulary option to spm_encode
2018-06-07 01:01:05 +09:00
Taku Kudo 53ea373084 Added --generate_vocabulary option to spm_encode 2018-06-07 00:30:16 +09:00
Taku Kudo fc7130f394
Merge pull request #91 from google/sr
Support vocab restriction feature in BPE model.
2018-06-06 19:22:59 +09:00
Taku Kudo aeec94b63a Support vocab restriction feature in BPE model. 2018-06-06 19:18:53 +09:00
Taku Kudo 93d84a6f3c
Merge pull request #90 from google/sr
Support vocab restriction feature
2018-06-06 18:07:54 +09:00
Taku Kudo e437e30bb4 Support vocab restriction feature 2018-06-06 16:47:59 +09:00
Taku Kudo c6e84aebc9
Merge pull request #89 from google/sr
Minor style fixes
2018-06-05 02:29:13 +09:00
Taku Kudo 2ff4267b91 Minor style fixes 2018-06-05 01:44:15 +09:00
Taku Kudo 506aa4595a
Merge pull request #88 from google/sr
Updated normalizer
2018-06-04 21:02:32 +09:00
Taku Kudo 4e3bcf1373 Updated normalizer 2018-06-04 20:32:37 +09:00
Taku Kudo 4f7af0dfad
Merge pull request #86 from google/sr
Made DecodeUTF8 more strict.
2018-05-13 22:03:47 +09:00
Taku Kudo 4a200b8974 Made DecodeUTF8 more strict. 2018-05-13 21:31:51 +09:00
Taku Kudo eb43a63e5d
Merge pull request #85 from google/sr
s/PopulateNormalizationSpec/PopulateNormalizerSpec/
2018-05-12 00:07:07 +09:00
Taku Kudo 2e01a0890e s/PopulateNormalizationSpec/PopulateNormalizerSpec/ 2018-05-11 23:24:12 +09:00
Taku Kudo 49da7daf91
Merge pull request #84 from google/sr
Fixed build errors
2018-05-11 23:15:35 +09:00
Taku Kudo f3b1fb8233 Fixed build errors 2018-05-11 22:11:22 +09:00