resec
|
266f274da0
|
Added C++ tag for all code blocks
|
2017-07-20 10:54:12 +08:00 |
resec
|
fe95e7c092
|
Added example on load model from std::istream
|
2017-07-20 10:50:38 +08:00 |
resec
|
bd5f5ba690
|
Impl std::istream variant to Load and LoadOrDie
Implemented for SentencePieceProcessor:
bool SentencePieceProcessor::Load(std::istream &istream)
void SentencePieceProcessor::LoadOrDie(std::istream &istream)
|
2017-07-20 10:13:15 +08:00 |
resec
|
f325534879
|
Add std::istream variant to Load and LoadOrDie
Added for SentencePieceProcessor:
virtual bool Load(std::istream &istream);
virtual void LoadOrDie(std::istream &istream);
|
2017-07-20 10:10:16 +08:00 |
resec
|
8ff52671f2
|
Merge pull request #2 from google/master
pull code from google master
|
2017-07-20 09:43:50 +08:00 |
Taku Kudo
|
e540f5cbbd
|
Merge pull request #17 from tsuchm/master
spm_encode should not ignore empty lines
|
2017-07-15 14:31:09 +09:00 |
TSUCHIYA Masatoshi
|
07c5c44ae6
|
Do not ignore empty lines.
|
2017-06-14 17:18:46 +09:00 |
Taku Kudo
|
904b943bbf
|
Merge pull request #16 from LappleApple/patch-1
Update and rename CONTRIBUTING to CONTRIBUTING.md
|
2017-06-10 00:59:26 +09:00 |
Lauri Apple
|
186cb0e3a6
|
Update and rename CONTRIBUTING to CONTRIBUTING.md
Made some light edits and added the .md so the Markdown would work.
|
2017-06-03 19:15:57 +02:00 |
Taku Kudo
|
7b9a30ab1f
|
Merge pull request #14 from frankxu2004/master
fixed a typo in the spm_train help text
|
2017-06-03 17:51:41 +09:00 |
Frank Xu
|
f31bdaf120
|
fixed a typo in the spm_train help text
|
2017-05-28 04:44:22 +08:00 |
Taku Kudo
|
589a773390
|
Merge pull request #13 from resec/master
Add support to use self-prepared protobuf lib
|
2017-05-16 14:59:26 +09:00 |
resec
|
8cbc7fccc6
|
Update README.md
|
2017-05-16 10:50:39 +08:00 |
Edmond
|
62498ab36c
|
add guiding for using self-prepared protobuf lib
|
2017-05-16 10:46:43 +08:00 |
Edmond
|
5d2a1ad8d3
|
support using user-defined protoc via env var PROTOC
|
2017-05-16 10:35:51 +08:00 |
Taku Kudo
|
74e55a18a7
|
Merge pull request #12 from kashif/os-x
added initial support to compile on OSX
|
2017-05-16 10:02:25 +09:00 |
Kashif Rasul
|
c840499762
|
fixed brew command
|
2017-05-15 11:13:45 +02:00 |
Kashif Rasul
|
7d2cea7e1c
|
ignore test files
|
2017-05-15 11:12:13 +02:00 |
Kashif Rasul
|
f55d4a88db
|
added initial support to compile on OSX
|
2017-05-15 11:07:42 +02:00 |
Taku Kudo
|
777e7133a1
|
Add SPM4k and Chars
|
2017-05-10 13:58:38 +09:00 |
Taku Kudo
|
5924294bf6
|
Fixed typos
|
2017-04-21 14:15:41 +09:00 |
Taku Kudo
|
5afdca579b
|
Added experimental results.
|
2017-04-21 13:58:06 +09:00 |
Taku Kudo
|
86f8eec66e
|
Added description for BLUE scorer
|
2017-04-06 21:50:41 +09:00 |
Taku Kudo
|
8eed0cb20f
|
Added description for BLUE scorer
|
2017-04-06 21:21:04 +09:00 |
Taku Kudo
|
49879ecb2a
|
Fixed typos
|
2017-04-06 21:16:44 +09:00 |
Taku Kudo
|
7b620b159f
|
Fixed itemizations
|
2017-04-06 21:09:06 +09:00 |
Taku Kudo
|
10f39d1417
|
Added new experimental results
|
2017-04-06 18:45:53 +09:00 |
Taku Kudo
|
b23ed045b1
|
Merge pull request #10 from mattn/fix-windows
Fix windows
|
2017-04-01 11:29:39 +09:00 |
Yasuhiro Matsumoto
|
4c2590ef35
|
remove duplicated whitespace
|
2017-03-31 14:49:24 +09:00 |
Yasuhiro Matsumoto
|
8700db8a5d
|
fix order of link libraries
symbols must be resolved left-to-right on link flags on Windows.
|
2017-03-31 14:34:28 +09:00 |
Yasuhiro Matsumoto
|
e77dc48c9a
|
define NOMINMAX if not defined
|
2017-03-31 14:34:20 +09:00 |
Taku Kudo
|
88d411e0c8
|
Added the description for ldconfig
|
2017-03-21 13:14:47 +09:00 |
Taku Kudo
|
71b632722e
|
Merge pull request #6 from dkorolev/master
A minor README tweak.
|
2017-03-21 13:09:33 +09:00 |
Dima
|
a4d5f42eb2
|
A minor README tweak.
|
2017-03-20 14:45:53 -07:00 |
Taku Kudo
|
93b6f93bfa
|
Updated README.md
|
2017-03-09 15:27:19 +09:00 |
Taku Kudo
|
84c2ec3a18
|
added coverage status
|
2017-03-08 22:15:54 +09:00 |
Taku Kudo
|
d806a71d0d
|
changed gcov version
|
2017-03-08 20:54:02 +09:00 |
Taku Kudo
|
e98495b26c
|
call make clean before coverage
|
2017-03-08 20:41:18 +09:00 |
Taku Kudo
|
7b6ee5127b
|
Changed the root dir
|
2017-03-08 20:32:21 +09:00 |
Taku Kudo
|
c7741e7736
|
Fixed travis.yml
|
2017-03-08 20:24:29 +09:00 |
Taku Kudo
|
ea9a2d335a
|
Fixed travis.yml
|
2017-03-08 20:06:00 +09:00 |
Taku Kudo
|
06ef7eda40
|
Fixed travis.yml
|
2017-03-08 20:01:09 +09:00 |
Taku Kudo
|
e52f1412d3
|
Merge branch 'master' of https://github.com/google/sentencepiece
|
2017-03-08 19:54:55 +09:00 |
Taku Kudo
|
25b376d09a
|
Coverage support
|
2017-03-08 19:54:07 +09:00 |
Taku Kudo
|
8ba8c63cd3
|
Merge pull request #3 from tetsuok/fix-stack-overflow
Fix stack-overflow in StringPiece
|
2017-03-08 17:21:44 +09:00 |
Taku Kudo
|
f4d062f6e0
|
Added travis status
|
2017-03-08 17:18:54 +09:00 |
Tetsuo Kiso
|
9e238d496d
|
Fix stack-overflow in StringPiece
The compiler complains that StringPiece::operator<< leads to stack
overflows due to the infinite recursion (-Winfinite-recursion).
|
2017-03-08 17:08:50 +09:00 |
Taku Kudo
|
7bd6cf7654
|
Changed the clang version to 3.7
|
2017-03-08 17:07:02 +09:00 |
Taku Kudo
|
83ca09a5aa
|
Fixed syntax error problem.
|
2017-03-08 16:56:27 +09:00 |
Taku Kudo
|
7e7057ad0e
|
Fixed syntax error problem.
|
2017-03-08 16:51:12 +09:00 |