• Leszek Swirski's avatar
    Reland^3 "[serializer] Allocate during deserialization" · 3f4e9bbe
    Leszek Swirski authored
    This is a reland of c4a062a9
    which was a reland of 28a30c57
    which was a reland of 5d7a29c9
    
    Fixes TSAN errors from non-atomic writes in the deserializer. Now all
    writes are (relaxed) atomic.
    
    Original change's description:
    > Reland^2 "[serializer] Allocate during deserialization"
    >
    > This is a reland of 28a30c57
    > which was a reland of 5d7a29c9
    >
    > The crashes were from calling RegisterDeserializerFinished on a null
    > Isolate pointer, for a deserializer that was never initialised
    > (specifically, ReadOnlyDeserializer when ROHeap is shared).
    >
    > Original change's description:
    > > Reland "[serializer] Allocate during deserialization"
    > >
    > > This is a reland of 5d7a29c9
    > >
    > > This reland shuffles around the order of checks in Heap::AllocateRawWith
    > > to not check the new space addresses until it's known that this is a new
    > > space allocation. This fixes an UBSan failure during read-only space
    > > deserialization, which happens before the new space is initialized.
    > >
    > > It also fixes some issues discovered by --stress-snapshot, around
    > > serializing ThinStrings (which are now elided as part of serialization),
    > > handle counts (I bumped the maximum handle count in that check), and
    > > clearing map transitions (the map backpointer field needed a Smi
    > > uninitialized value check).
    > >
    > > Original change's description:
    > > > [serializer] Allocate during deserialization
    > > >
    > > > This patch removes the concept of reservations and a specialized
    > > > deserializer allocator, and instead makes the deserializer allocate
    > > > directly with the Heap's Allocate method.
    > > >
    > > > The major consequence of this is that the GC can now run during
    > > > deserialization, which means that:
    > > >
    > > >   a) Deserialized objects are visible to the GC, and
    > > >   b) Objects that the deserializer/deserialized objects point to can
    > > >      move.
    > > >
    > > > Point a) is mostly not a problem due to previous work in making
    > > > deserialized objects "GC valid", i.e. making sure that they have a valid
    > > > size before any subsequent allocation/safepoint. We now additionally
    > > > have to initialize the allocated space with a valid tagged value -- this
    > > > is a magic Smi value to keep "uninitialized" checks simple.
    > > >
    > > > Point b) is solved by Handlifying the deserializer. This involves
    > > > changing any vectors of objects into vectors of Handles, and any object
    > > > keyed map into an IdentityMap (we can't use Handles as keys because
    > > > the object's address is no longer a stable hash).
    > > >
    > > > Back-references can no longer be direct chunk offsets, so instead the
    > > > deserializer stores a Handle to each deserialized object, and the
    > > > backreference is an index into this handle array. This encoding could
    > > > be optimized in the future with e.g. a second pass over the serialized
    > > > array which emits a different bytecode for objects that are and aren't
    > > > back-referenced.
    > > >
    > > > Additionally, the slot-walk over objects to initialize them can no
    > > > longer use absolute slot offsets, as again an object may move and its
    > > > slot address would become invalid. Now, slots are walked as relative
    > > > offsets to a Handle to the object, or as absolute slots for the case of
    > > > root pointers. A concept of "slot accessor" is introduced to share the
    > > > code between these two modes, and writing the slot (including write
    > > > barriers) is abstracted into this accessor.
    > > >
    > > > Finally, the Code body walk is modified to deserialize all objects
    > > > referred to by RelocInfos before doing the RelocInfo walk itself. This
    > > > is because RelocInfoIterator uses raw pointers, so we cannot allocate
    > > > during a RelocInfo walk.
    > > >
    > > > As a drive-by, the VariableRawData bytecode is tweaked to use tagged
    > > > size rather than byte size -- the size is expected to be tagged-aligned
    > > > anyway, so now we get an extra few bits in the size encoding.
    > > >
    > > > Bug: chromium:1075999
    > > > Change-Id: I672c42f553f2669888cc5e35d692c1b8ece1845e
    > > > Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/2404451
    > > > Commit-Queue: Leszek Swirski <leszeks@chromium.org>
    > > > Reviewed-by: Jakob Gruber <jgruber@chromium.org>
    > > > Reviewed-by: Ulan Degenbaev <ulan@chromium.org>
    > > > Cr-Commit-Position: refs/heads/master@{#70229}
    > >
    > > Bug: chromium:1075999
    > > Change-Id: Ibc77cc48b3440b4a28b09746cfc47e50c340ce54
    > > Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/2440828
    > > Commit-Queue: Leszek Swirski <leszeks@chromium.org>
    > > Auto-Submit: Leszek Swirski <leszeks@chromium.org>
    > > Reviewed-by: Ulan Degenbaev <ulan@chromium.org>
    > > Reviewed-by: Jakob Gruber <jgruber@chromium.org>
    > > Cr-Commit-Position: refs/heads/master@{#70267}
    >
    > Tbr: jgruber@chromium.org,ulan@chromium.org
    > Bug: chromium:1075999
    > Change-Id: Iaa8dc54895866ada0e34a7c9e8fff9ae1cb13f2d
    > Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/2444991
    > Reviewed-by: Ulan Degenbaev <ulan@chromium.org>
    > Commit-Queue: Leszek Swirski <leszeks@chromium.org>
    > Cr-Commit-Position: refs/heads/master@{#70279}
    
    Tbr: jgruber@chromium.org,ulan@chromium.org
    Cq-Include-Trybots: luci.v8.try:v8_linux64_tsan_rel_ng,v8_linux64_tsan_no_cm_rel_ng,v8_linux64_tsan_isolates_rel_ng
    Bug: chromium:1075999
    Change-Id: I0b9b11644aebc4cc8b07c62a0f765b24e4d73d89
    Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/2445872
    Commit-Queue: Leszek Swirski <leszeks@chromium.org>
    Auto-Submit: Leszek Swirski <leszeks@chromium.org>
    Reviewed-by: 's avatarDominik Inführ <dinfuehr@chromium.org>
    Cr-Commit-Position: refs/heads/master@{#70288}
    3f4e9bbe
Name
Last commit
Last update
..
base Loading commit data...
cppgc Loading commit data...
cppgc-js Loading commit data...
third-party Loading commit data...
OWNERS Loading commit data...
allocation-observer.cc Loading commit data...
allocation-observer.h Loading commit data...
allocation-stats.h Loading commit data...
array-buffer-sweeper.cc Loading commit data...
array-buffer-sweeper.h Loading commit data...
barrier.h Loading commit data...
base-space.cc Loading commit data...
base-space.h Loading commit data...
basic-memory-chunk.cc Loading commit data...
basic-memory-chunk.h Loading commit data...
code-object-registry.cc Loading commit data...
code-object-registry.h Loading commit data...
code-stats.cc Loading commit data...
code-stats.h Loading commit data...
combined-heap.cc Loading commit data...
combined-heap.h Loading commit data...
concurrent-allocator-inl.h Loading commit data...
concurrent-allocator.cc Loading commit data...
concurrent-allocator.h Loading commit data...
concurrent-marking.cc Loading commit data...
concurrent-marking.h Loading commit data...
conservative-stack-visitor.cc Loading commit data...
conservative-stack-visitor.h Loading commit data...
embedder-tracing.cc Loading commit data...
embedder-tracing.h Loading commit data...
factory-base-inl.h Loading commit data...
factory-base.cc Loading commit data...
factory-base.h Loading commit data...
factory-inl.h Loading commit data...
factory.cc Loading commit data...
factory.h Loading commit data...
finalization-registry-cleanup-task.cc Loading commit data...
finalization-registry-cleanup-task.h Loading commit data...
free-list-inl.h Loading commit data...
free-list.cc Loading commit data...
free-list.h Loading commit data...
gc-idle-time-handler.cc Loading commit data...
gc-idle-time-handler.h Loading commit data...
gc-tracer.cc Loading commit data...
gc-tracer.h Loading commit data...
heap-controller.cc Loading commit data...
heap-controller.h Loading commit data...
heap-inl.h Loading commit data...
heap-write-barrier-inl.h Loading commit data...
heap-write-barrier.cc Loading commit data...
heap-write-barrier.h Loading commit data...
heap.cc Loading commit data...
heap.h Loading commit data...
incremental-marking-inl.h Loading commit data...
incremental-marking-job.cc Loading commit data...
incremental-marking-job.h Loading commit data...
incremental-marking.cc Loading commit data...
incremental-marking.h Loading commit data...
index-generator.cc Loading commit data...
index-generator.h Loading commit data...
invalidated-slots-inl.h Loading commit data...
invalidated-slots.cc Loading commit data...
invalidated-slots.h Loading commit data...
item-parallel-job.cc Loading commit data...
item-parallel-job.h Loading commit data...
large-spaces.cc Loading commit data...
large-spaces.h Loading commit data...
list.h Loading commit data...
local-allocator-inl.h Loading commit data...
local-allocator.h Loading commit data...
local-factory-inl.h Loading commit data...
local-factory.cc Loading commit data...
local-factory.h Loading commit data...
local-heap-inl.h Loading commit data...
local-heap.cc Loading commit data...
local-heap.h Loading commit data...
mark-compact-inl.h Loading commit data...
mark-compact.cc Loading commit data...
mark-compact.h Loading commit data...
marking-barrier-inl.h Loading commit data...
marking-barrier.cc Loading commit data...
marking-barrier.h Loading commit data...
marking-visitor-inl.h Loading commit data...
marking-visitor.h Loading commit data...
marking-worklist-inl.h Loading commit data...
marking-worklist.cc Loading commit data...
marking-worklist.h Loading commit data...
marking.cc Loading commit data...
marking.h Loading commit data...
memory-allocator.cc Loading commit data...
memory-allocator.h Loading commit data...
memory-chunk-inl.h Loading commit data...
memory-chunk-layout.cc Loading commit data...
memory-chunk-layout.h Loading commit data...
memory-chunk.cc Loading commit data...
memory-chunk.h Loading commit data...
memory-measurement-inl.h Loading commit data...
memory-measurement.cc Loading commit data...
memory-measurement.h Loading commit data...
memory-reducer.cc Loading commit data...
memory-reducer.h Loading commit data...
new-spaces-inl.h Loading commit data...
new-spaces.cc Loading commit data...
new-spaces.h Loading commit data...
object-start-bitmap.h Loading commit data...
object-stats.cc Loading commit data...
object-stats.h Loading commit data...
objects-visiting-inl.h Loading commit data...
objects-visiting.cc Loading commit data...
objects-visiting.h Loading commit data...
paged-spaces-inl.h Loading commit data...
paged-spaces.cc Loading commit data...
paged-spaces.h Loading commit data...
parallel-work-item.h Loading commit data...
read-only-heap-inl.h Loading commit data...
read-only-heap.cc Loading commit data...
read-only-heap.h Loading commit data...
read-only-spaces.cc Loading commit data...
read-only-spaces.h Loading commit data...
remembered-set-inl.h Loading commit data...
remembered-set.h Loading commit data...
safepoint.cc Loading commit data...
safepoint.h Loading commit data...
scavenge-job.cc Loading commit data...
scavenge-job.h Loading commit data...
scavenger-inl.h Loading commit data...
scavenger.cc Loading commit data...
scavenger.h Loading commit data...
setup-heap-internal.cc Loading commit data...
slot-set.cc Loading commit data...
slot-set.h Loading commit data...
spaces-inl.h Loading commit data...
spaces.cc Loading commit data...
spaces.h Loading commit data...
stress-marking-observer.cc Loading commit data...
stress-marking-observer.h Loading commit data...
stress-scavenge-observer.cc Loading commit data...
stress-scavenge-observer.h Loading commit data...
sweeper.cc Loading commit data...
sweeper.h Loading commit data...
worklist.h Loading commit data...