Граф коммитов

174 Коммитов

Автор SHA1 Сообщение Дата
naruse 59c41661a7 * ext/nkf/nkf-utf8: Merge b0a6577a521d1bba5e19853f95d5c4b9be1072b5.
Support JIS X 0213 and some bugfixes.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@37800 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2012-11-22 08:47:30 +00:00
naruse 3d42b23557 * ext/nkf/nkf-utf8/nkf.c: Merge upstream: 50a383c84.
[ruby-dev:46128] [Bug #7005]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@36968 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2012-09-14 17:26:39 +00:00
naruse 1aab4196fa * ext/nkf/nkf.c (rb_nkf_convert): suppress warning.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@36966 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2012-09-14 16:07:49 +00:00
yugui e782fb8eea * common.mk (vm_backtrace.o): Added missing dependencies.
* ext/nkf/depend (nkf.o): ditto.

* ext/ripper/depend (ripper.o) ditto.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@36767 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2012-08-22 01:11:30 +00:00
naruse 05558e04b8 * ext/nkf/nkf-utf8/nkf.c: import nkf 2.1.2 (be9c280)
Bump version number/release date only.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@33225 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2011-09-08 12:17:06 +00:00
naruse e3532c8bde Revert "Change encoding from ISO-2022 to UTF-8"
This reverts commit r33213.
Don't change nkf which is imported from upstream.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@33218 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2011-09-07 22:17:55 +00:00
ayumin 9f4dd65e89 Change encoding from ISO-2022 to UTF-8
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@33213 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2011-09-07 17:56:24 +00:00
nobu 3a47cf3395 * remove trailing spaces.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31573 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2011-05-15 11:55:52 +00:00
naruse e3c3733a30 * ext/nkf/nkf-utf8/nkf.c: import nkf 7f18e30.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31175 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2011-03-25 06:46:55 +00:00
naruse 85eb93d062 * ext/nkf/lib/kconv.rb (String#kconv): fix typo and update rdoc.
patched by Kouhei Yanagita [ruby-dev:42696]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30112 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-12-07 11:47:39 +00:00
naruse f795d0f418 * ext/nkf/nkf-utf8/nkf.c: Fix type of mimeout_state.buf.
[nkf-bug:20079]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@28937 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-08-09 05:11:04 +00:00
nobu c53664c84d .cvsignore: have not been used already. [Bug #3468]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@28898 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-08-07 05:43:21 +00:00
naruse 2a0c12cce4 * ext/nkf/nkf-utf8/nkf.c: updated to b856dd07.
this cleans warnings.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@28090 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-05-30 09:48:28 +00:00
nobu 6d1940fed9 * ext/nkf/nkf.c (rb_nkf_convert, rb_nkf_guess): check too huge
string.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@27947 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-05-21 10:11:44 +00:00
naruse 9526ba4ef3 * ext/nkf/nkf-utf8/nkf.c: Update nkf 2010-04-28.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@27603 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-05-03 19:04:29 +00:00
nobu 977267c2e0 * ext/**/*.[ch]: removed trailing spaces.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@27437 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-04-22 08:04:13 +00:00
naruse b2ae252976 * ext/nkf/nkf-utf8/nkf.c: Refix [nkf-bug:21393]. (explicit -X)
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@27332 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-04-14 01:55:17 +00:00
naruse 4392ea3527 * ext/nkf/nkf-utf8/nkf.c: Fix: Windows Codepages wrongly convert
Halfwidth Katakana. [nkf-bug:21393]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@27329 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-04-13 11:37:55 +00:00
naruse e03b66ef18 * ext/nkf/nkf-utf8/nkf.c: import latest nkf. [master 9306cb0]
this also fixes [ruby-dev:40607]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@26935 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2010-03-15 01:37:45 +00:00
nobu 287a34ae0d * {ext,lib,test}/**/*.rb: removed trailing spaces.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@22784 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-03-06 03:56:38 +00:00
naruse 3c13fd9be0 * ext/nkf/nkf-utf8/nkf.c (nkf_buf): use nkf_char.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@21687 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-01-20 08:59:06 +00:00
usa 2ad3120ea6 * ext/nkf/nkf-utf8/nkf.c (nkf_buf_push): maybe a bug.
* ext/nkf/nkf-utf8/nkf.c (options): no need to support help option.



git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@21679 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-01-20 00:27:17 +00:00
naruse 13313688b2 * ext/nkf/nkf-utf8/nkf.c: Update nkf to 2.0.9.
revert -s meaning as Shift_JIS, etc.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@21676 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2009-01-19 18:52:42 +00:00
naruse 10ddffb278 * nkf.c: update to r1.188. fixes for 16bit environment.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@20128 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-11-07 02:59:38 +00:00
naruse b87182fa7f * ext/nkf/nkf-utf8/nkf.c (kanji_convert): output unicode chars.
[ruby-dev:36957]

* ext/nkf/nkf-utf8/nkf.c (numchar_getc): increase buffer size.
  reported and patched at [ruby-dev:36957] by mame.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@20004 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-28 14:30:17 +00:00
kazu 4e0b83e95b * ext/nkf/nkf.c (rb_nkf_convert): should specify type of variable.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19959 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-27 03:04:22 +00:00
naruse f850cf2866 * ext/nkf/nkf.c (rb_nkf_convert): avoid GC.
reported in [ruby-dev:36909] and patched [ruby-dev:36941] by mame.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19953 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-26 16:08:03 +00:00
naruse 146ea3c398 * ext/nkf/nkf-utf8/utf8tbl.c: update table.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19683 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-05 01:10:41 +00:00
naruse a6e736e09d * ext/nkf/nkf.c (rb_nkf_enc_get): don't replicate encoding.
[ruby-dev:36575]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19675 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-10-04 10:06:26 +00:00
nobu c3fda337a0 * ext/nkf/nkf-utf8/nkf.c: commit miss.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19630 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-29 15:51:35 +00:00
nobu b921425c49 * ext/nkf/nkf-utf8/nkf.c: constified.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19629 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-29 15:47:46 +00:00
naruse a9cc553e61 * ext/nkf/nkf-utf8/nkf.c: fix memory violation. mentioned by mame [ruby-dev:36373]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@19423 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-09-18 18:42:47 +00:00
naruse b7464f8513 * ext/nkf/nkf.c (rb_nkf_convert): output of mime encode is US-ASCII.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18201 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-24 19:14:47 +00:00
nobu e35550c3e7 * ext/nkf/nkf-utf8/nkf.c (struct input_code.name, input_codename):
constified.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18171 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-22 18:19:34 +00:00
naruse ec18fc70a3 * ext/nkf/nkf-utf8/nkf.c (options): use input_endian.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17965 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-07-09 00:50:37 +00:00
naruse 404de438af * ext/nkf/nkf-utf8/nkf.c (nkf_str_caseeql): added.
* ext/nkf/nkf-utf8/nkf.c (nkf_enc_find_index): use nkf_str_caseeql.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16515 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-21 21:23:51 +00:00
naruse 5dd3a0e2dd * ext/nkf/nkf-utf8/nkf.c (nkf_enc_find_index):
use strcasecmp. [ruby-dev:34787]

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16505 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-21 08:48:10 +00:00
naruse 5eb4d70c5f * ext/nkf/nkf-utf8/nkf.c (rb_nkf_convert) (nkf_enc_without_bom):
reverted. nkf-utf8/nkf.c should be independent of ruby.

* ext/nkf/nkf.c (options):
  moved from nkf-utf8/nkf.c. 
  override nkf's original settings for Unicode BOM.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16493 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-20 13:10:28 +00:00
nobu 7992fabaf4 * ext/nkf/nkf.c (rb_nkf_convert), ext/nkf/nkf-utf8/nkf.c
(nkf_enc_without_bom): BOM is not a part of encodings.

* ext/nkf/nkf.c (Init_nkf), ext/nkf/nkf-utf8/nkf.c (options):
  UTF-{16,32} without endian have no sense.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16491 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-05-20 04:20:53 +00:00
naruse 0beaddc4e2 * ext/nkf/nkf-utf8/nkf.c (score_table_A0, score_table_F0):
type of content is unsigned char.

* ext/nkf/nkf-utf8/nkf.c (push_broken_buf): 'c' is nkf_char.

* ext/nkf/nkf-utf8/nkf.c (push_broken_buf): enc is 0 or pointer.

* ext/nkf//nkf.c (options): type of option is unsigned char.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16149 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-22 12:20:36 +00:00
naruse 17123b2958 * ext/nkf/nkf-utf8/nkf.c (z_conv): characters must be nkf_char.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16148 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-22 11:54:50 +00:00
mame 0a2053713b * enc/trans/utf_16_32.c (fun_so_to_utf_16be, fun_so_to_utf_16le): add
parentheses to remove warnings of gcc.

* io.c (rb_io_getc): remove unused variables.

* compile.c (NODE_NEXT, NODE_REDO): remove unused labels.

* ext/nkf/nkf.c (rb_nkf_convert): remove unused variables.

* ext/syck/rubyext.c (syck_resolver_initialize,
  syck_resolver_detect_implicit, syck_emitter_emit): remove unused
  variables.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16061 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-04-17 13:22:40 +00:00
matz 5a8d5c873b * ext/nkf/nkf-utf8/nkf.c (nkf_enc_from_index): BINARY does not
have in-bound encoding index.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15386 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-02-07 00:06:55 +00:00
nobu 02ca8ffbdc * ext/nkf/nkf-utf8/nkf.h: set properties.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15275 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 12:50:44 +00:00
naruse 4aa64b35fa * ext/nkf/nkf.c: raise error when no output encoding is given.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15269 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 08:55:31 +00:00
naruse 4a9d407e35 * ruby-trunk.
* lib/irb/ruby-lex.rb (RubyLex#buf_input): use chars.to_a.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15267 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 07:43:31 +00:00
naruse 086e5b1a63 * ext/nkf/nkt-utf8: update nkf.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15266 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-27 07:28:26 +00:00
naruse dfca247f66 * ext/nkf/lib/kconv.rb (Kconv.tolocale): argument is str.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15050 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-14 14:37:29 +00:00
naruse 86da4be028 * ext/nkf/nkf.c: rdoc update.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15003 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-12 03:46:13 +00:00
naruse 353a69229d * ext/nkf/nkf-utf8/nkf.c: fix bug: -m was -m0.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14997 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-11 19:33:37 +00:00
naruse 249c08716d * ext/nkf/nkf-utf8/nkf.c: update to r1.163.
* ext/nkf/nkf.c: ASCII's canonical name is US-ASCII.

* ext/nkf/lib/kconv.rb (Kconv.isjis): force_encoding('BINARY').


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14983 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-11 01:03:23 +00:00
naruse 7d847f7c37 * ext/nkf/nkf-utf8/{nkf.c, utf8tbl.c}: Update nkf.
* ext/nkf/nkf.c: fix documents.

* ext/nkf/lib/kconv.rb: fix documents.
  (Kconv.is*): use valid_encoding?.
  (Kconv.isjis): defined.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14833 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2008-01-01 15:22:25 +00:00
naruse 03a1e25542 * ext/nkf/nkf.c (rb_nkf_enc_get): use rb_define_dummy_encoding.
* ext/nkf/nkf.c (Init_nkf): use rb_nkf_enc_get("ASCII").

* ext/nkf/nkf-utf8/nkf.c: Update 1.161.

* ext/nkf/nkf-utf9/config.h: default output encoding is now UTF-8.

* ext/nkf/lib/kconv.rb (Kconv.kconv): replace Encoding#name by
  Encoding#to_s.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14520 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-23 09:37:51 +00:00
akr 38c303bb52 ext/nkf/nkf.c follow previous rb_ascii_encoding renaming.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14505 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-23 00:07:24 +00:00
naruse a745e619d2 * ext/nkf/nkf.c (Init_nkf): use rb_ascii_encoding() for
rb_nkf_enc_get("US-ASCII").
  * if use rb_nkf_enc_get("US-ASCII"), ruby will crash - this is bug?


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14484 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-22 08:49:28 +00:00
naruse 573bd7500b * ext/nkf/nkf-utf8.c: Update nkf.c rev:1.157.
* ext/nkf/nkf.c (rb_nkf_enc_get): replicate proper based encoding.

* ext/nkf/kconv.c (Kconv#kconv, to*): use self.encoding as from_enc
  when from_enc isn't given.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14481 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-22 08:36:30 +00:00
usa b211ed6460 * parse.y (parser_str_new, rb_intern3): rb_default_encoding() renamed.
* ext/nkf/nkf.c (rb_nkf_putchar): ditto.



git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14444 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-21 20:11:17 +00:00
naruse 72d638fb2f * ext/nkf/nkf-utf8/config.h (MIME_DECODE_DEFAULT, X0201_DEFAULT):
defined as FALSE.  nkf and kconv don't decode MIME encoded string
 and don't convert JIS X 0201 Katakana.

* test/nkf/test_kconv.rb: fix tests.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14417 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-21 07:50:31 +00:00
naruse dec6ba8a22 * ext/nkf/nkf-utf8/nkf.c: Updated.
* ext/nkf/nkf.c (rb_nkf_enc_get): added.
  (find encoding or replicate default encoding)

* ext/nkf/nkf.c (NKF::<ENCODING>): redefine encoding constant.

* ext/nkf/lib/kconv.rb (Kconv::<ENCODING>): redefined as Encoding.

* ext/nkf/lib/kconv.rb: refactoring.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14330 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-19 10:19:38 +00:00
naruse 0cf4378f14 * ext/nkf/nkf.c (NKF::_ENCODING): removed.
* ext/nkf/nkf.c (rb_nkf_kconv): renamed to rb_nkf_convert.

* ext/nkf/nkf.c (rb_nkf_convert): set encoding.

* ext/nkf/nkf.c (rb_nkf_guess1): removed.

* ext/nkf/nkf.c (rb_nkf_guess2): renamed to rb_nkf_guess.

* ext/nkf/nkf.c (rb_nkf_guess):
  guess method now returns encoding object.

* ext/nkf/nkf-utf8/nkf.c: Update to nkf 2.0.8 2007-12-19.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14315 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-19 04:29:22 +00:00
naruse 01b097e475 * ext/nkf/lib/kconv.rb (tojis, tosjis, toeuc, toutf8):
set encoding. [ruby-dev:32447]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@14101 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-12-04 09:06:41 +00:00
matz f63aae063a * ext/nkf/nkf.c, bin/ri, bin/irb: fixed typos in doc and comments.
a patch from Eugene Ossintsev  <eugoss AT gmail.com>.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@13609 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-10-03 14:39:54 +00:00
naruse 3c17590061 * ext/nkf/nkf-utf8/nkf.c (kanji_convert): Fix guess fallback.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@12436 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-06-05 05:11:04 +00:00
naruse af1c416728 * lib/json.rb, lib/json, ext/json, test/json:
import JSON library.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@12428 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-06-04 12:31:26 +00:00
knu 42c647f6fc * ext/nkf/nkf.c (rb_str_resize, rb_nkf_kconv, rb_nkf_guess1,
rb_nkf_guess2): Silence warnings regarding char * vs. unsigned
  char * mismatch; submitted by Lyle Johnson
  <lyle.johnson@gmail.com> in [ruby-core:10416].


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@11904 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-02-27 10:35:17 +00:00
naruse 47dae86617 * ext/nkf/nkf-utf8/{nkf.c,utf8tbl.c}:
imported nkf 2007-01-28.
  * Fixed: can't decode MIME encode JIS string.
  * Fixed: Fullwitdh-halfwidth conversion.
  * Support DoCoMo's and Softbank's EMOJI
  * Support CP932, CP5022x, eucJP-ms UDC
  * Support UTF-32 encoding
  * Support beyond BMP
  [ruby-dev:29700] [ruby-dev:29922] [ruby-dev:30144]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@11649 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2007-02-06 15:08:59 +00:00
naruse 5300eecfb3 * ext/nkf/nkf-8/nkf.c: imported nkf 2.0.8 rev.110.
* Fix: check_bom cuts \xfe\xff\xXX\xXX of UTF-32.
  * Add support --ic=UTF-32.
  * Fix: can't guess UTF-16 and UTF-32.
  * Fix: can't decode beyond BMP of UTF-16LE.

* ext/nkf/nkf.c (guess): Support UTF-32.

* ext/nkf/lib/kconv.rb (kconv): Support UTF-32.

* ext/nkf/lib/kconv.rb (to_utf32): new method.

* ext/nkf/lib/kconv.rb (to_utf32): new method.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10938 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-09-15 11:26:07 +00:00
naruse 976b4e5f8b * ext/nkf/nkf-8/nkf.c: imported nkf 2.0.8 2006-09-15.
Add support for U+10000 - U+10FFFF
  Add support UTF-32


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10937 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-09-14 20:27:56 +00:00
naruse 103f6728df * ext/nkf/lib/kconv.rb (Kconv::toeuc): remove -m0 [ruby-dev:29505]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10870 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-09-06 03:20:10 +00:00
matz 25c50cd193 * ruby.h (struct RString): embed small strings.
(RSTRING_LEN): defined for accessing string members.
  (RSTRING_PTR): ditto.

* string.c: use RSTRING_LEN and RSTRING_PTR.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10809 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-08-31 10:30:33 +00:00
naruse 2d99616ec8 * ext/nkf/lib/kconv.rb (Kconv::RegexpEucjp): fix regexp for euc-jp [ruby-dev:29344]
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10755 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-08-22 03:41:46 +00:00
akr 934847fbeb add extconf.h to .cvsignore.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10375 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-06-24 01:15:08 +00:00
naruse a59c6fe7c9 * kconv.rb: remove default -m0 and fix document.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10329 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-06-19 14:40:23 +00:00
naruse 5c691de442 * ext/nkf/nkf-utf8/nkf.c: imported nkf 2.0.7
* Fix: fallback in CP51932
  * ANSI C
  * Fix bug arround MIME encode NL


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10328 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-06-19 14:25:06 +00:00
matz 9b383bd6cf * sprintf.c (rb_str_format): allow %c to print one character
string (e.g. ?x).

* lib/tempfile.rb (Tempfile::make_tmpname): put dot between
  basename and pid.  [ruby-talk:196272]
* parse.y (do_block): remove -> style block.

* parse.y (parser_yylex): remove tLAMBDA_ARG.

* eval.c (rb_call0): binding for the return event hook should have
  consistent scope.  [ruby-core:07928]

* eval.c (proc_invoke): return behavior should depend whether it
  is surrounded by a lambda or a mere block.

* eval.c (formal_assign): handles post splat arguments.

* eval.c (rb_call0): ditto.

* st.c (strhash): use FNV-1a hash.

* parse.y (parser_yylex): removed experimental ';;' terminator.

* eval.c (rb_node_arity): should be aware of post splat arguments.

* eval.c (rb_proc_arity): ditto.

* parse.y (f_args): syntax rule enhanced to support arguments
  after the splat.

* parse.y (block_param): ditto for block parameters.

* parse.y (f_post_arg): mandatory formal arguments after the splat
  argument.

* parse.y (new_args_gen): generate nodes for mandatory formal
  arguments after the splat argument.

* eval.c (rb_eval): dispatch mandatory formal arguments after the
  splat argument.

* parse.y (args): allow more than one splat in the argument list.

* parse.y (method_call): allow aref [] to accept all kind of
  method argument, including assocs, splat, and block argument.

* eval.c (SETUP_ARGS0): prepare block argument as well.

* lib/mathn.rb (Integer): remove Integer#gcd2. [ruby-core:07931]

* eval.c (error_line): print receivers true/false/nil specially.

* eval.c (rb_proc_yield): handles parameters in yield semantics.

* eval.c (nil_yield): gives LocalJumpError to denote no block
  error.

* io.c (rb_io_getc): now takes one-character string.

* string.c (rb_str_hash): use FNV-1a hash from Fowler/Noll/Vo
  hashing algorithm.

* string.c (rb_str_aref): str[0] now returns 1 character string,
  instead of a fixnum.	[Ruby2]

* parse.y (parser_yylex): ?c now returns 1 character string,
  instead of a fixnum.	[Ruby2]

* string.c (rb_str_aset): no longer support fixnum insertion.

* eval.c (umethod_bind): should not update original class.
  [ruby-dev:28636]

* eval.c (ev_const_get): should support constant access from
  within instance_eval().  [ruby-dev:28327]

* time.c (time_timeval): should round for usec floating
  number.  [ruby-core:07896]

* time.c (time_add): ditto.

* dir.c (sys_warning): should not call a vararg function
  rb_sys_warning() indirectly.	[ruby-core:07886]

* numeric.c (flo_divmod): the first element of Float#divmod should
  be an integer. [ruby-dev:28589]

* test/ruby/test_float.rb: add tests for divmod, div, modulo and remainder.

* re.c (rb_reg_initialize): should not allow modifying literal
  regexps.  frozen check moved from rb_reg_initialize_m as well.

* re.c (rb_reg_initialize): should not modify untainted objects in
  safe levels higher than 3.

* re.c (rb_memcmp): type change from char* to const void*.

* dir.c (dir_close): should not close untainted dir stream.

* dir.c (GetDIR): add tainted/frozen check for each dir operation.

* lib/rdoc/parsers/parse_rb.rb (RDoc::RubyParser::parse_symbol_arg):
  typo fixed.  a patch from Florian Gross <florg at florg.net>.

* eval.c (EXEC_EVENT_HOOK): trace_func may remove itself from
  event_hooks.	no guarantee for arbitrary hook deletion.
  [ruby-dev:28632]

* util.c (ruby_strtod): differ addition to minimize error.
  [ruby-dev:28619]

* util.c (ruby_strtod): should not raise ERANGE when the input
  string does not have any digits.  [ruby-dev:28629]

* eval.c (proc_invoke): should restore old ruby_frame->block.
  thanks to ts <decoux at moulon.inra.fr>.  [ruby-core:07833]
  also fix [ruby-dev:28614] as well.

* signal.c (trap): sig should be less then NSIG.  Coverity found
  this bug.  a patch from Kevin Tew <tewk at tewk.com>.
  [ruby-core:07823]

* math.c (math_log2): add new method inspired by
  [ruby-talk:191237].

* math.c (math_log): add optional base argument to Math::log().
  [ruby-talk:191308]

* ext/syck/emitter.c (syck_scan_scalar): avoid accessing
  uninitialized array element.	a patch from Pat Eyler
  <rubypate at gmail.com>.  [ruby-core:07809]

* array.c (rb_ary_fill): initialize local variables first.  a
  patch from Pat Eyler <rubypate at gmail.com>.	 [ruby-core:07810]

* ext/syck/yaml2byte.c (syck_yaml2byte_handler): need to free
  type_tag.  a patch from Pat Eyler <rubypate at gmail.com>.
  [ruby-core:07808]

* ext/socket/socket.c (make_hostent_internal): accept ai_family
  check from Sam Roberts <sroberts at uniserve.com>.
  [ruby-core:07691]

* util.c (ruby_strtod): should not cut off 18 digits for no
  reason.  [ruby-core:07796]

* array.c (rb_ary_fill): internalize local variable "beg" to
  pacify Coverity.  [ruby-core:07770]

* pack.c (pack_unpack): now supports CRLF newlines.  a patch from
  <tommy at tmtm.org>.	[ruby-dev:28601]

* applied code clean-up patch from Stefan Huehner
  <stefan at huehner.org>.  [ruby-core:07764]

* lib/jcode.rb (String::tr_s): should have translated non
  squeezing character sequence (i.e. a character) as well.  thanks
  to Hiroshi Ichikawa <gimite at gimite.ddo.jp> [ruby-list:42090]

* ext/socket/socket.c: document update patch from Sam Roberts
  <sroberts at uniserve.com>.  [ruby-core:07701]

* lib/mathn.rb (Integer): need not to remove gcd2.  a patch from
  NARUSE, Yui <naruse at airemix.com>.	[ruby-dev:28570]

* parse.y (arg): too much NEW_LIST()

* eval.c (SETUP_ARGS0): remove unnecessary access to nd_alen.

* eval.c (rb_eval): use ARGSCAT for NODE_OP_ASGN1.
  [ruby-dev:28585]

* parse.y (arg): use NODE_ARGSCAT for placeholder.

* lib/getoptlong.rb (GetoptLong::get): RDoc update patch from
  mathew <meta at pobox.com>.  [ruby-core:07738]

* variable.c (rb_const_set): raise error when no target klass is
  supplied.  [ruby-dev:28582]

* prec.c (prec_prec_f): documentation patch from
  <gerardo.santana at gmail.com>.  [ruby-core:07689]

* bignum.c (rb_big_pow): second operand may be too big even if
  it's a Fixnum.  [ruby-talk:187984]

* README.EXT: update symbol description.  [ruby-talk:188104]

* COPYING: explicitly note GPLv2.  [ruby-talk:187922]

* parse.y: remove some obsolete syntax rules (unparenthesized
  method calls in argument list).

* eval.c (rb_call0): insecure calling should be checked for non
  NODE_SCOPE method invocations too.

* eval.c (rb_alias): should preserve the current safe level as
  well as method definition.

* process.c (rb_f_sleep): remove RDoc description about SIGALRM
  which is not valid on the current implementation. [ruby-dev:28464]

 Thu Mar 23 21:40:47 2006  K.Kosako  <sndgk393 AT ybb.ne.jp>

* eval.c (method_missing): should support argument splat in
  super.  a bug in combination of super, splat and
  method_missing.  [ruby-talk:185438]

* configure.in: Solaris SunPro compiler -rapth patch from
  <kuwa at labs.fujitsu.com>.  [ruby-dev:28443]

* configure.in: remove enable_rpath=no for Solaris.
  [ruby-dev:28440]

* ext/win32ole/win32ole.c (ole_val2olevariantdata): change behavior
  of converting  OLE Variant object with VT_ARRAY|VT_UI1 and Ruby
  String object.

* ruby.1: a clarification patch from David Lutterkort
  <dlutter at redhat.com>.  [ruby-core:7508]

* lib/rdoc/ri/ri_paths.rb (RI::Paths): adding paths from rubygems
  directories.	a patch from Eric Hodel <drbrain at segment7.net>.
  [ruby-core:07423]

* eval.c (rb_clear_cache_by_class): clearing wrong cache.

* ext/extmk.rb: use :remove_destination to install extension libraries
  to avoid SEGV.  [ruby-dev:28417]

* eval.c (rb_thread_fd_writable): should not re-schedule output
  from KILLED thread (must be error printing).

* array.c (rb_ary_flatten_bang): allow specifying recursion
  level.  [ruby-talk:182170]

* array.c (rb_ary_flatten): ditto.

* gc.c (add_heap): a heap_slots may overflow.  a patch from Stefan
  Weil <weil at mail.berlios.de>.

* eval.c (rb_call): use separate cache for fcall/vcall
  invocation.

* eval.c (rb_eval): NODE_FCALL, NODE_VCALL can call local
  functions.

* eval.c (rb_mod_local): a new method to specify newly added
  visibility "local".

* eval.c (search_method): search for local methods which are
  visible only from the current class.

* class.c (rb_class_local_methods): a method to list local methods.

* object.c (Init_Object): add BasicObject class as a top level
  BlankSlate class.

* ruby.h (SYM2ID): should not cast to signed long.
  [ruby-core:07414]

* class.c (rb_include_module): allow module duplication.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10235 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-06-09 21:20:17 +00:00
usa e72073102c * ext/nkf/nkf-utf8/nkf.c (nkf_each_char_to_hex, encode_fallback_subchar,
e2w_conv): support C90 compiler.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10065 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-03-29 01:12:22 +00:00
naruse e49d874542 * ext/nkf/nkf-utf8/{nkf.c, utf8tbl.c}: imported nkf 2.0.6.
* Add --ic / --oc option and mapping tables.
  * Add fallback option.
  * Add --no-best-fit-chars option.
  * Fix some bugs.

* ext/nkf/nkf.c (nkf_split_options): added for parse option string.

* ext/nkf/lib/kconv.rb (Kconv.to*): add -m0.
  Note that Kconv.to* still imply -X.

* ext/nkf/test.rb: Removed.  Obsolete by test/nkf.

* ext/.document: enabled documents in nkf and kconv

* ext/nkf/nkf.c, ext/nkf/lib/kconv.rb: Add rdoc.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@10057 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2006-03-27 13:48:21 +00:00
nobu ec12edb11c * lib/scanf.rb (Scanf::FormatSpecifier#letter, #width): use matched
substring directly.

* ext/nkf/lib/kconv.rb (Kconv.conv): get rid of nil.to_a.

* test/ruby/test_assignment.rb, test/ruby/test_iterator.rb: followed
  change of sample/test.rb.

* test/net/http/test_http.rb: removed superfluous splatting stars.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@9360 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-10-08 10:45:52 +00:00
naruse 311d02a322 * ext/nkf/lib/kconv.rb: ensure that symbol_to_option is private_class_method
and all other methods are module_function
  fixed: [ruby-dev:26808]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8999 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-08-17 12:59:57 +00:00
naruse 2bf3c6b631 * ext/nkf/lib/kconv.rb: Kconv.kconv is now alias of Kconv.conv
* ext/nkf/lib/kconv.rb: remove nkf dependend symbols fomr SYMBOL_TO_OPTION


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8978 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-08-12 23:19:58 +00:00
naruse 0580cf2696 * ext/nkf/nkf-utf8/{nkf.c,utf8tbl.c,config.h}:
import 1.76
  [ruby-dev:26592] nkf constification


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8815 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-07-21 16:13:08 +00:00
naruse c065b233c6 * ext/nkf/nkf-utf8/nkf.c: import nkf.c 1.73
fix: TestKconv 1F


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8786 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-07-17 20:03:35 +00:00
naruse 04826ff77b * ext/nkf/lib/kconv.rb: fix typo.
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8730 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-07-05 15:25:36 +00:00
naruse 26f0a39bb3 * ext/nkf/nkf-utf8/{nkf.c,utf8tbl.c,config.h}:
imported nkf.c 1.70 (support UTF-8-MAC)

* ext/nkf/lib/kconv.rb: add :utf8mac and :internalunicode


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8729 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-07-05 15:19:36 +00:00
naruse 8e70a60da0 * ext/nkf/lib/kconv.rb: add Kconv::VERSION
* ext/nkf/lib/kconv.rb (conv): can process arrayed options
* ext/nkf/nkf-utf8/nkf.c: imported Revision 1.69
* ext/nkf/nkf-utf8/utf8tbl.c: imported Revision 1.9


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8667 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-06-27 16:53:48 +00:00
naruse 73812eca67 * ext/nkf/lib/kconv.rb: remove constants
Iconv_Shift_JIS, Uconv_EUC_JP, Iconv_UTF8
* ext/nkf/lib/kconv.rb: add module functions to Kconv
  conv, {eucjp, shiftjis, utf8}?, guess_as_symbol
* ext/nkf/lib/kconv.rb: add instance methods to String
  conv, {eucjp, shiftjis, utf8}?
* ext/nkf/lib/kconv.rb: add aliases Kconv.to_* and String#to_*


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8660 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-06-25 02:50:50 +00:00
naruse cddaecb1ae * ext/nkf/nkf-utf8/nkf.c: follow nkf 2.0.5
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8440 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-05-12 08:42:36 +00:00
naruse afb7b3e1f8 * ext/nkf/nkf-utf8/nkf.c: follow nkf 1.66
fixed: [ruby-dev:25828]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8109 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-03-07 16:22:18 +00:00
naruse 1ff4571913 * ext/nkf/nkf-utf8/nkf.c: follow nkf 1.65
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8077 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-03-05 07:53:14 +00:00
naruse 076d6dfc8a * ext/nkf/nkf-utf8/nkf.c: follow nkf 1.63
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8063 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-03-03 22:12:03 +00:00
naruse e5d5c0d8fc * ext/nkf/nkf-utf8/nkf.c: follow nkf 1.62
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@8061 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-03-03 14:27:17 +00:00
naruse 621f6c0b6f * follow original utf8tbl.c,v 1.8
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7870 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-02-02 18:36:51 +00:00
naruse c298b3fe14 * follow original config.h,v 1.7
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7869 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-02-02 18:36:18 +00:00
naruse cf84cf931a * ext/nkf/nkf-utf8/nkf.c: follow nkf.c,v 1.57
support JISX0212
                          fixed: [Ruby-dev:25617]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7868 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-02-02 18:31:20 +00:00
naruse 3eac379906 * ext/nkf/lib/kconv.rb (guess_old): not use NKF.guess_old
but NKF.guess1. fixed: [ruby-dev:25491]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7816 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2005-01-24 07:10:44 +00:00
nobu 70a1eecdb9 * ext/nkf/nkf-utf8/nkf.c (reinit): should initialize all static
variables.  fixed: [ruby-list:40445]


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7673 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2004-12-28 06:42:33 +00:00
nobu 1b9d66dfeb * ext/nkf/lib/kconv.rb (Kconv::RegexpEucjp): second byte is up to
0xfe.

* ext/nkf/lib/kconv.rb (Kconv#kconv): should handle UTF8 and UTF16
  properly.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7672 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2004-12-28 06:26:34 +00:00
naruse 32e79507bb * original nkf2 revision 1.47
* mime encode/decode are improved
* --cp932inv turns on as default
* add long name option --cp932 which turns on all CP932 option


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7433 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2004-12-01 21:12:10 +00:00
naruse 3cf6e46e62 * add constant NKF::VERSION
* NKF.guess becomes an alias of NKF.guess2 (based on nkf2)


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7432 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2004-12-01 21:09:02 +00:00
naruse 6efefe35b3 * add --no-cp932
git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@7431 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2004-12-01 21:07:22 +00:00