Граф коммитов

67077 Коммитов

Автор SHA1 Сообщение Дата
git dc2eb6f7b2 * 2021-08-09 [ci skip] 2021-08-09 08:41:15 +09:00
Samuel Williams 48c43f7783 Rework the readline test to be more robust.
- Capture that the child is started by initial log line.
- More robust handling of child status reaping.
- Direct exit without sucess mesage if `#readline` receives input.
2021-08-09 11:40:56 +12:00
Samuel Williams 3a8cadcf8f Reduce chance to receive EBADF when closing an IO from another thread. 2021-08-08 22:12:14 +12:00
Nobuyoshi Nakada 587f501c7c
Make bit flags `reason` unsigned 2021-08-08 17:13:33 +09:00
aycabta ca2dd6d35a Use #full_message instead of #backtrace_locations 2021-08-08 15:43:03 +09:00
Nobuyoshi Nakada f81964568f
Suppress warnings when GC_ENABLE_INCREMENTAL_MARK == 0 2021-08-08 15:13:49 +09:00
git c6398d3d7c * 2021-08-08 [ci skip] 2021-08-08 09:25:01 +09:00
aycabta 40ccb87a49 Show backtrace locations when I/O timed out 2021-08-08 09:25:12 +09:00
aycabta 1fe73128cd Use TERM=xterm for tests on Solaris 2021-08-07 22:58:59 +09:00
aycabta f092a9606e Set TERM env for some CI environments 2021-08-07 21:16:49 +09:00
Nobuyoshi Nakada 6e60fc2945
Group commands on GitHub Actions 2021-08-07 18:32:24 +09:00
S-H-GAMELINKS ac7986f46a Remove unneeded rb_fiber_transfer_kw declaration 2021-08-07 17:18:20 +12:00
S.H 9b3fcfbbb9
Suppress unused-result warnings
* Hide read function warning in string_spec_RSTRING_PTR_read function

* The type of `read` may be `ssize_t`

Co-authored-by: Nobuyoshi Nakada <nobu@ruby-lang.org>
2021-08-07 12:50:55 +09:00
Nobuyoshi Nakada e5dd40b1f3
Stop force-recycling evacuated array [Bug #18065] 2021-08-07 12:34:45 +09:00
Jeremy Evans d16b68cb22 Use Rational for Float#round with ndigits > 14
ndigits higher than 14 can result in values that are slightly too
large due to floating point limitations.  Converting to rational
for the calculation and then back to float fixes these issues.

Fixes [Bug #14635]
Fixes [Bug #17183]

Co-authored by: Yusuke Endoh <mame@ruby-lang.org>
2021-08-06 15:03:51 -07:00
git 0d3520b063 * 2021-08-07 [ci skip] 2021-08-07 02:15:19 +09:00
Jeremy Evans 1a05dc03f9 Make backtrace generation work outward from current frame
This fixes multiple bugs found in the partial backtrace
optimization added in 3b24b7914c.
These bugs occurs when passing a start argument to caller where
the start argument lands on a iseq frame without a pc.

Before this commit, the following code results in the same
line being printed twice, both for the #each method.

```ruby
def a; [1].group_by { b } end
def b; puts(caller(2, 1).first, caller(3, 1).first) end
a
```

After this commit and in Ruby 2.7, the lines are different,
with the first line being for each and the second for group_by.

Before this commit, the following code can either segfault or
result in an infinite loop:

```ruby
def foo
  caller_locations(2, 1).inspect # segfault
  caller_locations(2, 1)[0].path # infinite loop
end

1.times.map { 1.times.map { foo } }
```

After this commit, this code works correctly.

This commit completely refactors the backtrace handling.
Instead of processing the backtrace from the outermost
frame working in, process it from the innermost frame
working out.  This is much faster for partial backtraces,
since you only access the control frames you need to in
order to construct the backtrace.

To handle cfunc frames in the new design, they start
out with no location information.  We increment a counter
for each cfunc frame added.  When an iseq frame with pc
is accessed, after adding the iseq backtrace location,
we use the location for the iseq backtrace location for
all of the directly preceding cfunc backtrace locations.

If the last backtrace line is a cfunc frame, we continue
scanning for iseq frames until the end control frame, and
use the location information from the first one for the
trailing cfunc frames in the backtrace.

As only rb_ec_partial_backtrace_object uses the new
backtrace implementation, remove all of the function
pointers and inline the functions.  This makes the
process easier to understand.

Restore the Ruby 2.7 implementation of backtrace_each and
use it for all the other functions that called
backtrace_each other than rb_ec_partial_backtrace_object.
All other cases requested the entire backtrace, so there
is no advantage of using the new algorithm for those.
Additionally, there are implicit assumptions in the other
code that the backtrace processing works inward instead
of outward.

Remove the cfunc/iseq union in rb_backtrace_location_t,
and remove the prev_loc member for cfunc.  Both cfunc and
iseq types can now have iseq and pc entries, so the
location information can be accessed the same way for each.
This avoids the need for a extra backtrace location entry
to store an iseq backtrace location if the final entry in
the backtrace is a cfunc. This is also what fixes the
segfault and infinite loop issues in the above bugs.

Here's Ruby pseudocode for the new algorithm, where start
and length are the arguments to caller or caller_locations:

```ruby
end_cf = VM.end_control_frame.next
cf = VM.start_control_frame
size = VM.num_control_frames - 2
bt = []
cfunc_counter = 0

if length.nil? || length > size
  length = size
end

while cf != end_cf && bt.size != length
  if cf.iseq?
    if cf.instruction_pointer?
      if start > 0
        start -= 1
      else
        bt << cf.iseq_backtrace_entry
        cf_counter.times do |i|
          bt[-1 - i].loc = cf.loc
        end
        cfunc_counter = 0
      end
    end
  elsif cf.cfunc?
    if start > 0
      start -= 1
    else
      bt << cf.cfunc_backtrace_entry
      cfunc_counter += 1
    end
  end

  cf = cf.prev
end

if cfunc_counter > 0
  while cf != end_cf
    if (cf.iseq? && cf.instruction_pointer?)
      cf_counter.times do |i|
        bt[-i].loc = cf.loc
      end
    end
    cf = cf.prev
  end
end
```

With the following benchmark, which uses a call depth of
around 100 (common in many Ruby applications):

```ruby
class T
  def test(depth, &block)
    if depth == 0
      yield self
    else
      test(depth - 1, &block)
    end
  end
  def array
    Array.new
  end
  def first
    caller_locations(1, 1)
  end
  def full
    caller_locations
  end
end

t = T.new
t.test((ARGV.first || 100).to_i) do
  Benchmark.ips do |x|
    x.report ('caller_loc(1, 1)') {t.first}
    x.report ('caller_loc') {t.full}
    x.report ('Array.new') {t.array}
    x.compare!
  end
end
```

Results before commit:

```
Calculating -------------------------------------
    caller_loc(1, 1)    281.159k (_ 0.7%) i/s -      1.426M in   5.073055s
          caller_loc     15.836k (_ 2.1%) i/s -     79.450k in   5.019426s
           Array.new      1.852M (_ 2.5%) i/s -      9.296M in   5.022511s

Comparison:
           Array.new:  1852297.5 i/s
    caller_loc(1, 1):   281159.1 i/s - 6.59x  (_ 0.00) slower
          caller_loc:    15835.9 i/s - 116.97x  (_ 0.00) slower
```

Results after commit:

```
Calculating -------------------------------------
    caller_loc(1, 1)    562.286k (_ 0.8%) i/s -      2.858M in   5.083249s
          caller_loc     16.402k (_ 1.0%) i/s -     83.200k in   5.072963s
           Array.new      1.853M (_ 0.1%) i/s -      9.278M in   5.007523s

Comparison:
           Array.new:  1852776.5 i/s
    caller_loc(1, 1):   562285.6 i/s - 3.30x  (_ 0.00) slower
          caller_loc:    16402.3 i/s - 112.96x  (_ 0.00) slower
```

This shows that the speed of caller_locations(1, 1) has roughly
doubled, and the speed of caller_locations with no arguments
has improved slightly.  So this new algorithm is significant faster,
much simpler, and fixes bugs in the previous algorithm.

Fixes [Bug #18053]
2021-08-06 10:15:01 -07:00
Nobuyoshi Nakada d868c8f08f
Make jobserver available 2021-08-06 20:58:13 +09:00
Nobuyoshi Nakada 3e7fb4b91d
Check the result of tigetstr 2021-08-06 13:34:25 +09:00
Nobuyoshi Nakada 9bfb8ea671
Fix caching of curses_dl 2021-08-06 13:33:47 +09:00
Yusuke Endoh 7af21a78fa test/reline/test_terminfo.rb: skip when setupterm fails
http://rubyci.s3.amazonaws.com/solaris11-gcc/ruby-master/log/20210806T000008Z.fail.html.gz
```
  1) Error:
Reline::Terminfo::Test#test_tigetstr:
Reline::Terminfo::TerminfoError: The terminfo database could not be found.
    /export/home/chkbuild/chkbuild-gcc/tmp/build/20210806T000008Z/ruby/lib/reline/terminfo.rb:84:in `setupterm'
    /export/home/chkbuild/chkbuild-gcc/tmp/build/20210806T000008Z/ruby/test/reline/test_terminfo.rb:6:in `setup'
```
2021-08-06 10:39:25 +09:00
aycabta e687b6f4da Show Readline::VERSION for debugging 2021-08-06 03:55:58 +09:00
git 983630b5fd * 2021-08-06 [ci skip] 2021-08-06 03:50:33 +09:00
aycabta 9b56668bf8 Omit test_interrupt_in_other_thread with Editline 2021-08-06 03:50:02 +09:00
aycabta 6414334d3c Fix reversal of assertion result 2021-08-06 03:17:51 +09:00
aycabta cd57b39f79 Fix control structure to preperly catch Timeout::Error 2021-08-06 03:15:58 +09:00
aycabta 7bcbee37b5 Fix the result of checking the existence of constants being reversed 2021-08-06 02:51:10 +09:00
Nobuyoshi Nakada bda56a03a6
Build rubyspec CAPI extensions 2021-08-05 22:30:48 +09:00
aycabta 1cb5a669d3 Show log when timed out 2021-08-05 19:39:22 +09:00
aycabta 042d4c8133 Remove an unused variable 2021-08-04 23:35:08 +09:00
Kazuhiro NISHIYAMA a97837de1a
Fix a link [ci skip] 2021-08-05 17:25:17 +09:00
Nobuyoshi Nakada ae275f67ce Show WorkingSetSize as RSS on Windows 2021-08-05 17:14:38 +09:00
Koichi Sasada 228b3e43be check GC.enable'd status
Check GC.enable'd status before and after test execution.

Write this checker in gc_checker.rb, it was renamed from
gc_compact_checker.rb.
2021-08-05 17:11:50 +09:00
Yusuke Endoh 405644f38c Revert "Removed extinit.o from main programs"
This reverts commit ac86fcbfd0.

This change broke "--disable-shared --with-static-linked-ext".
2021-08-05 14:48:24 +09:00
Nobuyoshi Nakada 3bb6410914
Use equivalent `__FILE__` 2021-08-05 14:15:30 +09:00
Nobuyoshi Nakada 594c3df9a9
Tests for Windows can run only on Windows
Should not directly require "reline/windows.rb" which should be
loaded by "reline.rb".
2021-08-05 13:58:07 +09:00
git bc8bc072f4 * 2021-08-05 [ci skip] 2021-08-05 05:11:29 +09:00
Peter Zhu 1fd0a2e4a6 Reenable GC at the end of test
The test disables GC but never reenables it. Before this patch, running
all tests would have a peak RSS in the main process of >4GB. After this
patch, peak RSS in the main process is <500MB.
2021-08-04 16:11:08 -04:00
Nobuyoshi Nakada 5f2987d6c2
Fix relative paths from core_assertions.rb 2021-08-04 20:39:12 +09:00
aycabta 6e55facdb3 Run interrupt test except on Windows 2021-08-04 18:29:42 +09:00
aycabta aba10ea61e Add a load path to require 'helper' 2021-08-04 18:29:42 +09:00
aycabta 335c12826a Show the log of test_interrupt_in_other_thread when failed 2021-08-04 18:29:42 +09:00
aycabta 17ef7a98ef Check the existence of the test classes 2021-08-04 18:29:42 +09:00
aycabta 5ca0a51ffd Add a test for handling SIGINT in other thread 2021-08-04 18:29:42 +09:00
aycabta de93b8b069 Handle SIGINT in other thread correctly
Co-authored-by: Koichi Sasada <ko1@atdot.net>
2021-08-04 18:29:42 +09:00
aycabta 5bb7b57129 Use Symbol of signal for trap 2021-08-04 18:29:42 +09:00
Nobuyoshi Nakada 1f2b3f2529
Remove an extraneous escape
Since a3fb97465d, this string is not inside the here-document.
2021-08-04 16:59:18 +09:00
git 6e8bbabc2b * 2021-08-04 [ci skip] 2021-08-04 05:39:21 +09:00
Peter Zhu c463a5e008 Fix indentation in string.c
7 spaces were used for 2 levels of indentation. This commit changes it
to use 8 spaces.
2021-08-03 16:39:02 -04:00
Samuel Williams 2d4f29e77e Fix potential hang when joining threads.
If the thread termination invokes user code after `th->status` becomes
`THREAD_KILLED`, and the user unblock function causes that `th->status` to
become something else (e.g. `THREAD_RUNNING`), threads waiting in
`thread_join_sleep` will hang forever. We move the unblock function call
to before the thread status is updated, and allow threads to join as soon
as `th->value` becomes defined.

This reverts commit 6505c77501.
2021-08-03 22:23:48 +12:00