nobu
287a34ae0d
* {ext,lib,test}/**/*.rb: removed trailing spaces.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@22784 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-03-06 03:56:38 +00:00
naruse
3c13fd9be0
* ext/nkf/nkf-utf8/nkf.c (nkf_buf): use nkf_char.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@21687 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-01-20 08:59:06 +00:00
usa
2ad3120ea6
* ext/nkf/nkf-utf8/nkf.c (nkf_buf_push): maybe a bug.
...
* ext/nkf/nkf-utf8/nkf.c (options): no need to support help option.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@21679 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-01-20 00:27:17 +00:00
naruse
13313688b2
* ext/nkf/nkf-utf8/nkf.c: Update nkf to 2.0.9.
...
revert -s meaning as Shift_JIS, etc.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@21676 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-01-19 18:52:42 +00:00
naruse
10ddffb278
* nkf.c: update to r1.188. fixes for 16bit environment.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@20128 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-11-07 02:59:38 +00:00
naruse
b87182fa7f
* ext/nkf/nkf-utf8/nkf.c (kanji_convert): output unicode chars.
...
[ruby-dev:36957]
* ext/nkf/nkf-utf8/nkf.c (numchar_getc): increase buffer size.
reported and patched at [ruby-dev:36957] by mame.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@20004 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-28 14:30:17 +00:00
kazu
4e0b83e95b
* ext/nkf/nkf.c (rb_nkf_convert): should specify type of variable.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19959 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-27 03:04:22 +00:00
naruse
f850cf2866
* ext/nkf/nkf.c (rb_nkf_convert): avoid GC.
...
reported in [ruby-dev:36909] and patched [ruby-dev:36941] by mame.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19953 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-26 16:08:03 +00:00
naruse
146ea3c398
* ext/nkf/nkf-utf8/utf8tbl.c: update table.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19683 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-05 01:10:41 +00:00
naruse
a6e736e09d
* ext/nkf/nkf.c (rb_nkf_enc_get): don't replicate encoding.
...
[ruby-dev:36575]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19675 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-04 10:06:26 +00:00
nobu
c3fda337a0
* ext/nkf/nkf-utf8/nkf.c: commit miss.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19630 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-29 15:51:35 +00:00
nobu
b921425c49
* ext/nkf/nkf-utf8/nkf.c: constified.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19629 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-29 15:47:46 +00:00
naruse
a9cc553e61
* ext/nkf/nkf-utf8/nkf.c: fix memory violation. mentioned by mame [ruby-dev:36373]
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19423 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-18 18:42:47 +00:00
naruse
b7464f8513
* ext/nkf/nkf.c (rb_nkf_convert): output of mime encode is US-ASCII.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18201 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-24 19:14:47 +00:00
nobu
e35550c3e7
* ext/nkf/nkf-utf8/nkf.c (struct input_code.name, input_codename):
...
constified.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18171 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-22 18:19:34 +00:00
naruse
ec18fc70a3
* ext/nkf/nkf-utf8/nkf.c (options): use input_endian.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17965 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-09 00:50:37 +00:00
naruse
404de438af
* ext/nkf/nkf-utf8/nkf.c (nkf_str_caseeql): added.
...
* ext/nkf/nkf-utf8/nkf.c (nkf_enc_find_index): use nkf_str_caseeql.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16515 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-21 21:23:51 +00:00
naruse
5dd3a0e2dd
* ext/nkf/nkf-utf8/nkf.c (nkf_enc_find_index):
...
use strcasecmp. [ruby-dev:34787]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16505 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-21 08:48:10 +00:00
naruse
5eb4d70c5f
* ext/nkf/nkf-utf8/nkf.c (rb_nkf_convert) (nkf_enc_without_bom):
...
reverted. nkf-utf8/nkf.c should be independent of ruby.
* ext/nkf/nkf.c (options):
moved from nkf-utf8/nkf.c.
override nkf's original settings for Unicode BOM.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16493 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-20 13:10:28 +00:00
nobu
7992fabaf4
* ext/nkf/nkf.c (rb_nkf_convert), ext/nkf/nkf-utf8/nkf.c
...
(nkf_enc_without_bom): BOM is not a part of encodings.
* ext/nkf/nkf.c (Init_nkf), ext/nkf/nkf-utf8/nkf.c (options):
UTF-{16,32} without endian have no sense.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16491 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-20 04:20:53 +00:00
naruse
0beaddc4e2
* ext/nkf/nkf-utf8/nkf.c (score_table_A0, score_table_F0):
...
type of content is unsigned char.
* ext/nkf/nkf-utf8/nkf.c (push_broken_buf): 'c' is nkf_char.
* ext/nkf/nkf-utf8/nkf.c (push_broken_buf): enc is 0 or pointer.
* ext/nkf//nkf.c (options): type of option is unsigned char.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16149 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-22 12:20:36 +00:00
naruse
17123b2958
* ext/nkf/nkf-utf8/nkf.c (z_conv): characters must be nkf_char.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16148 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-22 11:54:50 +00:00
mame
0a2053713b
* enc/trans/utf_16_32.c (fun_so_to_utf_16be, fun_so_to_utf_16le): add
...
parentheses to remove warnings of gcc.
* io.c (rb_io_getc): remove unused variables.
* compile.c (NODE_NEXT, NODE_REDO): remove unused labels.
* ext/nkf/nkf.c (rb_nkf_convert): remove unused variables.
* ext/syck/rubyext.c (syck_resolver_initialize,
syck_resolver_detect_implicit, syck_emitter_emit): remove unused
variables.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16061 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-17 13:22:40 +00:00
matz
5a8d5c873b
* ext/nkf/nkf-utf8/nkf.c (nkf_enc_from_index): BINARY does not
...
have in-bound encoding index.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15386 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-07 00:06:55 +00:00
nobu
02ca8ffbdc
* ext/nkf/nkf-utf8/nkf.h: set properties.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15275 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 12:50:44 +00:00
naruse
4aa64b35fa
* ext/nkf/nkf.c: raise error when no output encoding is given.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15269 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 08:55:31 +00:00
naruse
4a9d407e35
* ruby-trunk.
...
* lib/irb/ruby-lex.rb (RubyLex#buf_input): use chars.to_a.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15267 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 07:43:31 +00:00
naruse
086e5b1a63
* ext/nkf/nkt-utf8: update nkf.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15266 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 07:28:26 +00:00
naruse
dfca247f66
* ext/nkf/lib/kconv.rb (Kconv.tolocale): argument is str.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15050 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-14 14:37:29 +00:00
naruse
86da4be028
* ext/nkf/nkf.c: rdoc update.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15003 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-12 03:46:13 +00:00
naruse
353a69229d
* ext/nkf/nkf-utf8/nkf.c: fix bug: -m was -m0.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14997 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-11 19:33:37 +00:00
naruse
249c08716d
* ext/nkf/nkf-utf8/nkf.c: update to r1.163.
...
* ext/nkf/nkf.c: ASCII's canonical name is US-ASCII.
* ext/nkf/lib/kconv.rb (Kconv.isjis): force_encoding('BINARY').
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14983 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-11 01:03:23 +00:00
naruse
7d847f7c37
* ext/nkf/nkf-utf8/{nkf.c, utf8tbl.c}: Update nkf.
...
* ext/nkf/nkf.c: fix documents.
* ext/nkf/lib/kconv.rb: fix documents.
(Kconv.is*): use valid_encoding?.
(Kconv.isjis): defined.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14833 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-01 15:22:25 +00:00
naruse
03a1e25542
* ext/nkf/nkf.c (rb_nkf_enc_get): use rb_define_dummy_encoding.
...
* ext/nkf/nkf.c (Init_nkf): use rb_nkf_enc_get("ASCII").
* ext/nkf/nkf-utf8/nkf.c: Update 1.161.
* ext/nkf/nkf-utf9/config.h: default output encoding is now UTF-8.
* ext/nkf/lib/kconv.rb (Kconv.kconv): replace Encoding#name by
Encoding#to_s.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14520 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-23 09:37:51 +00:00
akr
38c303bb52
ext/nkf/nkf.c follow previous rb_ascii_encoding renaming.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14505 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-23 00:07:24 +00:00
naruse
a745e619d2
* ext/nkf/nkf.c (Init_nkf): use rb_ascii_encoding() for
...
rb_nkf_enc_get("US-ASCII").
* if use rb_nkf_enc_get("US-ASCII"), ruby will crash - this is bug?
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14484 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-22 08:49:28 +00:00
naruse
573bd7500b
* ext/nkf/nkf-utf8.c: Update nkf.c rev:1.157.
...
* ext/nkf/nkf.c (rb_nkf_enc_get): replicate proper based encoding.
* ext/nkf/kconv.c (Kconv#kconv, to*): use self.encoding as from_enc
when from_enc isn't given.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14481 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-22 08:36:30 +00:00
usa
b211ed6460
* parse.y (parser_str_new, rb_intern3): rb_default_encoding() renamed.
...
* ext/nkf/nkf.c (rb_nkf_putchar): ditto.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14444 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-21 20:11:17 +00:00
naruse
72d638fb2f
* ext/nkf/nkf-utf8/config.h (MIME_DECODE_DEFAULT, X0201_DEFAULT):
...
defined as FALSE. nkf and kconv don't decode MIME encoded string
and don't convert JIS X 0201 Katakana.
* test/nkf/test_kconv.rb: fix tests.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14417 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-21 07:50:31 +00:00
naruse
dec6ba8a22
* ext/nkf/nkf-utf8/nkf.c: Updated.
...
* ext/nkf/nkf.c (rb_nkf_enc_get): added.
(find encoding or replicate default encoding)
* ext/nkf/nkf.c (NKF::<ENCODING>): redefine encoding constant.
* ext/nkf/lib/kconv.rb (Kconv::<ENCODING>): redefined as Encoding.
* ext/nkf/lib/kconv.rb: refactoring.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14330 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-19 10:19:38 +00:00
naruse
0cf4378f14
* ext/nkf/nkf.c (NKF::_ENCODING): removed.
...
* ext/nkf/nkf.c (rb_nkf_kconv): renamed to rb_nkf_convert.
* ext/nkf/nkf.c (rb_nkf_convert): set encoding.
* ext/nkf/nkf.c (rb_nkf_guess1): removed.
* ext/nkf/nkf.c (rb_nkf_guess2): renamed to rb_nkf_guess.
* ext/nkf/nkf.c (rb_nkf_guess):
guess method now returns encoding object.
* ext/nkf/nkf-utf8/nkf.c: Update to nkf 2.0.8 2007-12-19.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14315 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-19 04:29:22 +00:00
naruse
01b097e475
* ext/nkf/lib/kconv.rb (tojis, tosjis, toeuc, toutf8):
...
set encoding. [ruby-dev:32447]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14101 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-04 09:06:41 +00:00
matz
f63aae063a
* ext/nkf/nkf.c, bin/ri, bin/irb: fixed typos in doc and comments.
...
a patch from Eugene Ossintsev <eugoss AT gmail.com>.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@13609 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-10-03 14:39:54 +00:00
naruse
3c17590061
* ext/nkf/nkf-utf8/nkf.c (kanji_convert): Fix guess fallback.
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@12436 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-06-05 05:11:04 +00:00
naruse
af1c416728
* lib/json.rb, lib/json, ext/json, test/json:
...
import JSON library.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@12428 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-06-04 12:31:26 +00:00
knu
42c647f6fc
* ext/nkf/nkf.c (rb_str_resize, rb_nkf_kconv, rb_nkf_guess1,
...
rb_nkf_guess2): Silence warnings regarding char * vs. unsigned
char * mismatch; submitted by Lyle Johnson
<lyle.johnson@gmail.com> in [ruby-core:10416].
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@11904 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-02-27 10:35:17 +00:00
naruse
47dae86617
* ext/nkf/nkf-utf8/{nkf.c,utf8tbl.c}:
...
imported nkf 2007-01-28.
* Fixed: can't decode MIME encode JIS string.
* Fixed: Fullwitdh-halfwidth conversion.
* Support DoCoMo's and Softbank's EMOJI
* Support CP932, CP5022x, eucJP-ms UDC
* Support UTF-32 encoding
* Support beyond BMP
[ruby-dev:29700] [ruby-dev:29922] [ruby-dev:30144]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@11649 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-02-06 15:08:59 +00:00
naruse
5300eecfb3
* ext/nkf/nkf-8/nkf.c: imported nkf 2.0.8 rev.110.
...
* Fix: check_bom cuts \xfe\xff\xXX\xXX of UTF-32.
* Add support --ic=UTF-32.
* Fix: can't guess UTF-16 and UTF-32.
* Fix: can't decode beyond BMP of UTF-16LE.
* ext/nkf/nkf.c (guess): Support UTF-32.
* ext/nkf/lib/kconv.rb (kconv): Support UTF-32.
* ext/nkf/lib/kconv.rb (to_utf32): new method.
* ext/nkf/lib/kconv.rb (to_utf32): new method.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10938 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-09-15 11:26:07 +00:00
naruse
976b4e5f8b
* ext/nkf/nkf-8/nkf.c: imported nkf 2.0.8 2006-09-15.
...
Add support for U+10000 - U+10FFFF
Add support UTF-32
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10937 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-09-14 20:27:56 +00:00
naruse
103f6728df
* ext/nkf/lib/kconv.rb (Kconv::toeuc): remove -m0 [ruby-dev:29505]
...
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10870 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-09-06 03:20:10 +00:00