Граф коммитов

64 Коммитов

Автор SHA1 Сообщение Дата
Alan Wu f36a5a98c0 style: line break before "else" 2021-10-20 18:19:41 -04:00
Alan Wu ec4998bd69 style: switch statements indent
Case labels get half an indent and the opening brace is on the same line
as "switch".
2021-10-20 18:19:41 -04:00
Alan Wu a10cf74e5c style: align pointer "*" to the right 2021-10-20 18:19:41 -04:00
Maxime Chevalier-Boisvert 0c1aa17556 Remove a few more uses of the global cb/ocb 2021-10-20 18:19:41 -04:00
Maxime Chevalier-Boisvert f1eb48cb23 Step 2 to remove the global cb/ocb objects. 2021-10-20 18:19:41 -04:00
Alan Wu 82405ac48a Add counters for tracking invalidations 2021-10-20 18:19:41 -04:00
John Hawthorn fbde1d9bee Store block callee_cme in darray
This allows a block version to have dependencies on multiple CMEs.
2021-10-20 18:19:39 -04:00
Aaron Patterson 0ca04e2dd4 Only clear the JIT function when we invalidate the entry block
We should only clear the JIT function when the entry point is
invalidated.  Right now we only support compiling functions with a PC
offset of zero (functions that take optional parameters can start at
non-zero PC), so this patch just checks that the index is 0 before
clearing the jit function
2021-10-20 18:19:39 -04:00
Alan Wu bd876c243a TracePoint support
This change fixes some cases where YJIT fails to fire tracing events.
Most of the situations YJIT did not handle correctly involves enabling
tracing while running inside generated code.

A new operation to invalidate all generated code is added, which uses
patching to make generated code exit at the next VM instruction
boundary. A new routine called `jit_prepare_routine_call()` is
introduced to facilitate this and should be used when generating code
that could allocate, or could otherwise use `RB_VM_LOCK_ENTER()`.

The `c_return` event is fired in the middle of an instruction as opposed
to at an instruction boundary, so it requires special handling. C method
call return points are patched to go to a fucntion which does everything
the interpreter does, including firing the `c_return` event. The
generated code for C method calls normally does not fire the event.

Invalided code should not change after patching so the exits are not
clobbered. A new variable is introduced to track the region of code that
should not change.
2021-10-20 18:19:39 -04:00
Jean Boussier 0dc3bba6f2 Allow to compile with --yjit-stats support but not the full RUBY_DEBUG
RUBY_DEBUG have a very significant performance overhead. Enough that
YJIT with RUBY_DEBUG is noticeably slower than the interpreter without
RUBY_DEBUG.

This makes it hard to collect yjit-stats in production environments.

By allowing to collect JIT statistics without the RUBy_DEBUG overhead,
I hope to make such use cases smoother.
2021-10-20 18:19:39 -04:00
John Hawthorn 8fa0ee4d40 Use callee-saved regs for REG_SP, REG_EP, REG_CFP 2021-10-20 18:19:39 -04:00
John Hawthorn ed8aa3409a Detach mapping to local in ctx_set_local_type
Similar to the previous fix to ctx_clear_local_types, we must detach
mappings to a local if we are changing its value.
2021-10-20 18:19:38 -04:00
John Hawthorn 6d852e847e Fix stack size check for ctx_get_opnd_type
Previously all stack operands would become unknown once the stack grew
beyond a certain size. This worked, but unnecessarily hid available
information.
2021-10-20 18:19:38 -04:00
John Hawthorn 48dca3348a Move yjit_type_of_value into yjit_core.c 2021-10-20 18:19:38 -04:00
John Hawthorn d78ea4abec Implement verify_ctx for debugging 2021-10-20 18:19:38 -04:00
John Hawthorn 2e707ee66f Don't generate entry point when PC != 0
If we hit this at PC > 0 (ie. with an optional argument) the provided
types and context are likely incorrect and it is likely this block can't
be used.
2021-10-20 18:19:38 -04:00
John Hawthorn 641ef34dde Allow upgrading first N types when stack is large 2021-10-20 18:19:38 -04:00
John Hawthorn 5d155fc8a1 Improve comments for mapping functions 2021-10-20 18:19:38 -04:00
John Hawthorn 42574768a1 Fix ctx_clear_local_types 2021-10-20 18:19:38 -04:00
John Hawthorn 250b97da9b Make ctx_diff aware of mappings 2021-10-20 18:19:38 -04:00
John Hawthorn 6c80150d40 Introduce ctx_{get,set}_opnd_mapping 2021-10-20 18:19:38 -04:00
John Hawthorn 4ea69e5c0b Rename to ctx_upgrade_opnd_type 2021-10-20 18:19:38 -04:00
Aaron Patterson e8617d0e7e Make sure we can still compile with the JIT disabled
If `--disable-jit-support` is passed to configure, then `jit_func` is
removed from the iseq body and we can't compile YJIT.  This commit
detects when the JIT function pointer is gone and disables YJIT in that
case.
2021-10-20 18:19:38 -04:00
Aaron Patterson 8fd3e0e9ff Fix BOP invalidation
Instead of mutating the iseqs, just clear the JIT function.
2021-10-20 18:19:38 -04:00
Aaron Patterson 05b5a7f011 Add a guard that we start executing on the first PC
Methods with optional parameters don't always start executing at the
first PC, but we compile all methods assuming that they do.  This commit
adds a guard to ensure that we're actually starting at the first PC for
methods with optional params
2021-10-20 18:19:37 -04:00
Aaron Patterson 0fdcdd267f fix alignment 2021-10-20 18:19:37 -04:00
John Hawthorn cb5571eece Flatten mappings when clearing locals
We clear locals when we know their values might change (ex. when
performing a method call). However previously values on the stack which
were originally pushed from a local would still point back to that
local.

With this commit, when clearing locals, we'll now iterate over the
mappings of the stack and copy the known type from the local to the
stack mapping, removing the association to the local.

This should mean both that we'll retain any information we already know
about the local type, and that if a local is modified we won't
incorrectly infer it's new type from the existing value on the stack.
2021-10-20 18:19:37 -04:00
Noah Gibbs 25792c17d4 Convert yjit static stat variables to counters 2021-10-20 18:19:36 -04:00
Maxime Chevalier-Boisvert 7030cae969 Try running with more YJIT options in CI to surface more bugs 2021-10-20 18:19:36 -04:00
Maxime Chevalier-Boisvert f54e6e1310 Update comment 2021-10-20 18:19:36 -04:00
Maxime Chevalier-Boisvert ecd4487a48 Remove #define MAX_VERSIONS, now using command-line option 2021-10-20 18:19:36 -04:00
Maxime Chevalier-Boisvert 99341d4a18 Fix issue in yjit_free_block causing segfault
This addresses issue #55
2021-10-20 18:19:35 -04:00
Maxime Chevalier-Boisvert bce6dea72d Fix assertions in `invalidate_block_version()`, add small repro (#14)
* Fix block invalidation assertions

* Add Alan's small repro for double invalidation bug
2021-10-20 18:19:34 -04:00
Maxime Chevalier-Boisvert 96f4f918b0 Implement greedy versioning. Refactor versioning logic. (#10)
* Implement eager versioning. Refactor versioning logic.

* Add --version-limit and --greedy-versioning command-line args
2021-10-20 18:19:34 -04:00
Maxime Chevalier-Boisvert 60496b6666 Pass self type through method calls 2021-10-20 18:19:34 -04:00
Maxime Chevalier-Boisvert 0cc73ca2a9 Malloc branch entries (#112)
* Malloc branch entries

* Add ASM comment for stack overflow check

* WIP

* Fix branch GC code. Add rb_darray_remove_unordered().

* Fix block end_pos after branch rewriting. Remove dst_patched bits.
2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert 646c7b3ff6 Temporarily increase MAX_BRANCHES until we have a better solution 2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert dac830553e Diff the local types in ctx_diff() 2021-10-20 18:19:33 -04:00
Alan Wu 4442029ec4 move assert. opnd.idx doesn't make sense for OPND_SELF 2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert 53ff2d791d Fix bug in ctx_set_local_type() 2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert 6164274c76 Re-enable local type tracking, until first call 2021-10-20 18:19:33 -04:00
Alan Wu 31acd22d3b Assert for running out of branches in all builds 2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert f6e3f75c2b Introduce concept of YJIT instruction operands 2021-10-20 18:19:33 -04:00
Alan Wu b626dd7211 YJIT: Fancier opt_getinlinecache
Make sure `opt_getinlinecache` is in a block all on its own, and
invalidate it from the interpreter when `opt_setinlinecache`.
It will recompile with a filled cache the second time around.
This lets YJIT runs well when the IC for constant is cold.
2021-10-20 18:19:33 -04:00
Alan Wu e81d1f4ae3 Fix stack-use-after-scope in gen_direct_jump()
ASAN can catch these type of things for us, but the scraper can't
handle ASAN :/.

To be more resilient to refactoring, extend the lifetime of
`generic_ctx` in branch_stub_hit() too.
2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert 42af04efee Add flag bits to avoid compiling stubs multiple times.
Fixes bug involving ractors and branch stubs.
2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert cbbae12a96 Keep track of local types in the context 2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert e98d2c5ec8 Add ctcx_stack_push_local() 2021-10-20 18:19:33 -04:00
Maxime Chevalier-Boisvert 0881e018b5 Add comments and asserts for clarity 2021-10-20 18:19:32 -04:00
Maxime Chevalier-Boisvert 131fc9c074 Readd const arguments 2021-10-20 18:19:32 -04:00