truffle: src/share/vm/gc_implementation/g1/satbQueue.cpp annotate

annotate src/share/vm/gc_implementation/g1/satbQueue.cpp @ 12233:40136aa2cdb1

8010722: assert: failed: heap size is too big for compressed oops Summary: Use conservative assumptions of required alignment for the various garbage collector components into account when determining the maximum heap size that supports compressed oops. Using this conservative value avoids several circular dependencies in the calculation. Reviewed-by: stefank, dholmes

author	tschatzl
date	Wed, 11 Sep 2013 16:25:02 +0200
parents	da91efe96a93
children	89ac31a5a7a7

rev	line source
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1 /*
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	2 * Copyright (c) 2001, 2012, Oracle and/or its affiliates. All rights reserved.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	4 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	7 * published by the Free Software Foundation.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	8 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	13 * accompanied this code).
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	14 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	18 *
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1317 diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1317 diff changeset	20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1317 diff changeset	21 * questions.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	22 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	23 */
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	24
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	25 #include "precompiled.hpp"
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	26 #include "gc_implementation/g1/g1CollectedHeap.inline.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	27 #include "gc_implementation/g1/satbQueue.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	28 #include "memory/allocation.inline.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	29 #include "memory/sharedHeap.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: 6197 diff changeset	30 #include "oops/oop.inline.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	31 #include "runtime/mutexLocker.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	32 #include "runtime/thread.hpp"
3979 4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	33 #include "runtime/vmThread.hpp"
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	34
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	35 void ObjPtrQueue::flush() {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	36 // The buffer might contain refs into the CSet. We have to filter it
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	37 // first before we flush it, otherwise we might end up with an
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	38 // enqueued buffer with refs into the CSet which breaks our invariants.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	39 filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	40 PtrQueue::flush();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	41 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	42
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	43 // This method removes entries from an SATB buffer that will not be
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	44 // useful to the concurrent marking threads. An entry is removed if it
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	45 // satisfies one of the following conditions:
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	46 //
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	47 // * it points to an object outside the G1 heap (G1's concurrent
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	48 // marking only visits objects inside the G1 heap),
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	49 // * it points to an object that has been allocated since marking
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	50 // started (according to SATB those objects do not need to be
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	51 // visited during marking), or
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	52 // * it points to an object that has already been marked (no need to
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	53 // process it again).
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	54 //
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	55 // The rest of the entries will be retained and are compacted towards
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	56 // the top of the buffer. Note that, because we do not allow old
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	57 // regions in the CSet during marking, all objects on the CSet regions
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	58 // are young (eden or survivors) and therefore implicitly live. So any
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	59 // references into the CSet will be removed during filtering.
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	60
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	61 void ObjPtrQueue::filter() {
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	62 G1CollectedHeap* g1h = G1CollectedHeap::heap();
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	63 void** buf = _buf;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	64 size_t sz = _sz;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	65
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	66 if (buf == NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	67 // nothing to do
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	68 return;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	69 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	70
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	71 // Used for sanity checking at the end of the loop.
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	72 debug_only(size_t entries = 0; size_t retained = 0;)
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	73
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	74 size_t i = sz;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	75 size_t new_index = sz;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	76
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	77 while (i > _index) {
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	78 assert(i > 0, "we should have at least one more entry to process");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	79 i -= oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	80 debug_only(entries += 1;)
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	81 oop* p = (oop*) &buf[byte_index_to_index((int) i)];
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	82 oop obj = *p;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	83 // NULL the entry so that unused parts of the buffer contain NULLs
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	84 // at the end. If we are going to retain it we will copy it to its
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	85 // final place. If we have retained all entries we have visited so
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	86 // far, we'll just end up copying it to the same place.
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	87 *p = NULL;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	88
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	89 bool retain = g1h->is_obj_ill(obj);
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	90 if (retain) {
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	91 assert(new_index > 0, "we should not have already filled up the buffer");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	92 new_index -= oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	93 assert(new_index >= i,
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	94 "new_index should never be below i, as we alwaysr compact 'up'");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	95 oop* new_p = (oop*) &buf[byte_index_to_index((int) new_index)];
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	96 assert(new_p >= p, "the destination location should never be below "
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	97 "the source as we always compact 'up'");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	98 assert(*new_p == NULL,
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	99 "we should have already cleared the destination location");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	100 *new_p = obj;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	101 debug_only(retained += 1;)
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	102 }
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	103 }
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	104
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	105 #ifdef ASSERT
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	106 size_t entries_calc = (sz - _index) / oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	107 assert(entries == entries_calc, "the number of entries we counted "
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	108 "should match the number of entries we calculated");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	109 size_t retained_calc = (sz - new_index) / oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	110 assert(retained == retained_calc, "the number of retained entries we counted "
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	111 "should match the number of retained entries we calculated");
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	112 #endif // ASSERT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	113
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	114 _index = new_index;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	115 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	116
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	117 // This method will first apply the above filtering to the buffer. If
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	118 // post-filtering a large enough chunk of the buffer has been cleared
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	119 // we can re-use the buffer (instead of enqueueing it) and we can just
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	120 // allow the mutator to carry on executing using the same buffer
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	121 // instead of replacing it.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	122
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	123 bool ObjPtrQueue::should_enqueue_buffer() {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	124 assert(_lock == NULL \|\| _lock->owned_by_self(),
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	125 "we should have taken the lock before calling this");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	126
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	127 // Even if G1SATBBufferEnqueueingThresholdPercent == 0 we have to
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	128 // filter the buffer given that this will remove any references into
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	129 // the CSet as we currently assume that no such refs will appear in
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	130 // enqueued buffers.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	131
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	132 // This method should only be called if there is a non-NULL buffer
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	133 // that is full.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	134 assert(_index == 0, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	135 assert(_buf != NULL, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	136
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	137 filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	138
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	139 size_t sz = _sz;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	140 size_t all_entries = sz / oopSize;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	141 size_t retained_entries = (sz - _index) / oopSize;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	142 size_t perc = retained_entries * 100 / all_entries;
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	143 bool should_enqueue = perc > (size_t) G1SATBBufferEnqueueingThresholdPercent;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	144 return should_enqueue;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	145 }
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	146
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	147 void ObjPtrQueue::apply_closure(ObjectClosure* cl) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	148 if (_buf != NULL) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	149 apply_closure_to_buffer(cl, _buf, _index, _sz);
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	150 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	151 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	152
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	153 void ObjPtrQueue::apply_closure_and_empty(ObjectClosure* cl) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	154 if (_buf != NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	155 apply_closure_to_buffer(cl, _buf, _index, _sz);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	156 _index = _sz;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	157 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	158 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	159
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	160 void ObjPtrQueue::apply_closure_to_buffer(ObjectClosure* cl,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	161 void** buf, size_t index, size_t sz) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	162 if (cl == NULL) return;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	163 for (size_t i = index; i < sz; i += oopSize) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	164 oop obj = (oop)buf[byte_index_to_index((int)i)];
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	165 // There can be NULL entries because of destructors.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	166 if (obj != NULL) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	167 cl->do_object(obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	168 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	169 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	170 }
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	171
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	172 #ifndef PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	173 // Helpful for debugging
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	174
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	175 void ObjPtrQueue::print(const char* name) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	176 print(name, _buf, _index, _sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	177 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	178
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	179 void ObjPtrQueue::print(const char* name,
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	180 void** buf, size_t index, size_t sz) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	181 gclog_or_tty->print_cr(" SATB BUFFER [%s] buf: "PTR_FORMAT" "
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	182 "index: "SIZE_FORMAT" sz: "SIZE_FORMAT,
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	183 name, buf, index, sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	184 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	185 #endif // PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	186
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	187 #ifdef ASSERT
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	188 void ObjPtrQueue::verify_oops_in_buffer() {
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	189 if (_buf == NULL) return;
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	190 for (size_t i = _index; i < _sz; i += oopSize) {
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	191 oop obj = (oop)_buf[byte_index_to_index((int)i)];
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	192 assert(obj != NULL && obj->is_oop(true /* ignore mark word */),
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	193 "Not an oop");
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	194 }
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	195 }
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	196 #endif
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	197
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	198 #ifdef _MSC_VER // the use of 'this' below gets a warning, make it go away
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	199 #pragma warning( disable:4355 ) // 'this' : used in base member initializer list
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	200 #endif // _MSC_VER
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	201
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	202 SATBMarkQueueSet::SATBMarkQueueSet() :
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	203 PtrQueueSet(), _closure(NULL), _par_closures(NULL),
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	204 _shared_satb_queue(this, true /perm/) { }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	205
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	206 void SATBMarkQueueSet::initialize(Monitor* cbl_mon, Mutex* fl_lock,
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	207 int process_completed_threshold,
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	208 Mutex* lock) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	209 PtrQueueSet::initialize(cbl_mon, fl_lock, process_completed_threshold, -1);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	210 _shared_satb_queue.set_lock(lock);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	211 if (ParallelGCThreads > 0) {
6197 d2a62e0f25eb 6995781: Native Memory Tracking (Phase 1) zgu parents: 4787 diff changeset	212 _par_closures = NEW_C_HEAP_ARRAY(ObjectClosure*, ParallelGCThreads, mtGC);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	213 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	214 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	215
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	216 void SATBMarkQueueSet::handle_zero_index_for_thread(JavaThread* t) {
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	217 DEBUG_ONLY(t->satb_mark_queue().verify_oops_in_buffer();)
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	218 t->satb_mark_queue().handle_zero_index();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	219 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	220
1317 d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	221 #ifdef ASSERT
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	222 void SATBMarkQueueSet::dump_active_values(JavaThread* first,
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	223 bool expected_active) {
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	224 gclog_or_tty->print_cr("SATB queue active values for Java Threads");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	225 gclog_or_tty->print_cr(" SATB queue set: active is %s",
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	226 (is_active()) ? "TRUE" : "FALSE");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	227 gclog_or_tty->print_cr(" expected_active is %s",
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	228 (expected_active) ? "TRUE" : "FALSE");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	229 for (JavaThread* t = first; t; t = t->next()) {
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	230 bool active = t->satb_mark_queue().is_active();
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	231 gclog_or_tty->print_cr(" thread %s, active is %s",
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	232 t->name(), (active) ? "TRUE" : "FALSE");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	233 }
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	234 }
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	235 #endif // ASSERT
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	236
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	237 void SATBMarkQueueSet::set_active_all_threads(bool b,
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	238 bool expected_active) {
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	239 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	240 JavaThread* first = Threads::first();
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	241
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	242 #ifdef ASSERT
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	243 if (_all_active != expected_active) {
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	244 dump_active_values(first, expected_active);
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	245
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	246 // I leave this here as a guarantee, instead of an assert, so
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	247 // that it will still be compiled in if we choose to uncomment
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	248 // the #ifdef ASSERT in a product build. The whole block is
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	249 // within an #ifdef ASSERT so the guarantee will not be compiled
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	250 // in a product build anyway.
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	251 guarantee(false,
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	252 "SATB queue set has an unexpected active value");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	253 }
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	254 #endif // ASSERT
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	255 _all_active = b;
1317 d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	256
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	257 for (JavaThread* t = first; t; t = t->next()) {
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	258 #ifdef ASSERT
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	259 bool active = t->satb_mark_queue().is_active();
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	260 if (active != expected_active) {
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	261 dump_active_values(first, expected_active);
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	262
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	263 // I leave this here as a guarantee, instead of an assert, so
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	264 // that it will still be compiled in if we choose to uncomment
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	265 // the #ifdef ASSERT in a product build. The whole block is
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	266 // within an #ifdef ASSERT so the guarantee will not be compiled
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	267 // in a product build anyway.
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	268 guarantee(false,
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	269 "thread has an unexpected active value in its SATB queue");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	270 }
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	271 #endif // ASSERT
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	272 t->satb_mark_queue().set_active(b);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	273 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	274 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	275
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	276 void SATBMarkQueueSet::filter_thread_buffers() {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	277 for(JavaThread* t = Threads::first(); t; t = t->next()) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	278 t->satb_mark_queue().filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	279 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	280 shared_satb_queue()->filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	281 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	282
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	283 void SATBMarkQueueSet::set_closure(ObjectClosure* closure) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	284 _closure = closure;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	285 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	286
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	287 void SATBMarkQueueSet::set_par_closure(int i, ObjectClosure* par_closure) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	288 assert(ParallelGCThreads > 0 && _par_closures != NULL, "Precondition");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	289 _par_closures[i] = par_closure;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	290 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	291
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	292 void SATBMarkQueueSet::iterate_closure_all_threads() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	293 for(JavaThread* t = Threads::first(); t; t = t->next()) {
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	294 t->satb_mark_queue().apply_closure_and_empty(_closure);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	295 }
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	296 shared_satb_queue()->apply_closure_and_empty(_closure);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	297 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	298
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	299 void SATBMarkQueueSet::par_iterate_closure_all_threads(int worker) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	300 SharedHeap* sh = SharedHeap::heap();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	301 int parity = sh->strong_roots_parity();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	302
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	303 for(JavaThread* t = Threads::first(); t; t = t->next()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	304 if (t->claim_oops_do(true, parity)) {
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	305 t->satb_mark_queue().apply_closure_and_empty(_par_closures[worker]);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	306 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	307 }
3979 4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	308
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	309 // We also need to claim the VMThread so that its parity is updated
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	310 // otherwise the next call to Thread::possibly_parallel_oops_do inside
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	311 // a StrongRootsScope might skip the VMThread because it has a stale
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	312 // parity that matches the parity set by the StrongRootsScope
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	313 //
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	314 // Whichever worker succeeds in claiming the VMThread gets to do
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	315 // the shared queue.
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	316
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	317 VMThread* vmt = VMThread::vm_thread();
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	318 if (vmt->claim_oops_do(true, parity)) {
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	319 shared_satb_queue()->apply_closure_and_empty(_par_closures[worker]);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	320 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	321 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	322
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	323 bool SATBMarkQueueSet::apply_closure_to_completed_buffer_work(bool par,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	324 int worker) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	325 BufferNode* nd = NULL;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	326 {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	327 MutexLockerEx x(_cbl_mon, Mutex::_no_safepoint_check_flag);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	328 if (_completed_buffers_head != NULL) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	329 nd = _completed_buffers_head;
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	330 _completed_buffers_head = nd->next();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	331 if (_completed_buffers_head == NULL) _completed_buffers_tail = NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	332 _n_completed_buffers--;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	333 if (_n_completed_buffers == 0) _process_completed = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	334 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	335 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	336 ObjectClosure* cl = (par ? _par_closures[worker] : _closure);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	337 if (nd != NULL) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	338 void **buf = BufferNode::make_buffer_from_node(nd);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	339 ObjPtrQueue::apply_closure_to_buffer(cl, buf, 0, _sz);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	340 deallocate_buffer(buf);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	341 return true;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	342 } else {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	343 return false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	344 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	345 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	346
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	347 void SATBMarkQueueSet::iterate_completed_buffers_read_only(ObjectClosure* cl) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	348 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	349 assert(cl != NULL, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	350
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	351 BufferNode* nd = _completed_buffers_head;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	352 while (nd != NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	353 void** buf = BufferNode::make_buffer_from_node(nd);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	354 ObjPtrQueue::apply_closure_to_buffer(cl, buf, 0, _sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	355 nd = nd->next();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	356 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	357 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	358
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	359 void SATBMarkQueueSet::iterate_thread_buffers_read_only(ObjectClosure* cl) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	360 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	361 assert(cl != NULL, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	362
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	363 for (JavaThread* t = Threads::first(); t; t = t->next()) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	364 t->satb_mark_queue().apply_closure(cl);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	365 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	366 shared_satb_queue()->apply_closure(cl);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	367 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	368
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	369 #ifndef PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	370 // Helpful for debugging
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	371
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	372 #define SATB_PRINTER_BUFFER_SIZE 256
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	373
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	374 void SATBMarkQueueSet::print_all(const char* msg) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	375 char buffer[SATB_PRINTER_BUFFER_SIZE];
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	376 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	377
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	378 gclog_or_tty->cr();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	379 gclog_or_tty->print_cr("SATB BUFFERS [%s]", msg);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	380
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	381 BufferNode* nd = _completed_buffers_head;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	382 int i = 0;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	383 while (nd != NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	384 void** buf = BufferNode::make_buffer_from_node(nd);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	385 jio_snprintf(buffer, SATB_PRINTER_BUFFER_SIZE, "Enqueued: %d", i);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	386 ObjPtrQueue::print(buffer, buf, 0, _sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	387 nd = nd->next();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	388 i += 1;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	389 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	390
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	391 for (JavaThread* t = Threads::first(); t; t = t->next()) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	392 jio_snprintf(buffer, SATB_PRINTER_BUFFER_SIZE, "Thread: %s", t->name());
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	393 t->satb_mark_queue().print(buffer);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	394 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	395
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	396 shared_satb_queue()->print("Shared");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	397
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	398 gclog_or_tty->cr();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	399 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	400 #endif // PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	401
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	402 void SATBMarkQueueSet::abandon_partial_marking() {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	403 BufferNode* buffers_to_delete = NULL;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	404 {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	405 MutexLockerEx x(_cbl_mon, Mutex::_no_safepoint_check_flag);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	406 while (_completed_buffers_head != NULL) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	407 BufferNode* nd = _completed_buffers_head;
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	408 _completed_buffers_head = nd->next();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	409 nd->set_next(buffers_to_delete);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	410 buffers_to_delete = nd;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	411 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	412 _completed_buffers_tail = NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	413 _n_completed_buffers = 0;
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	414 DEBUG_ONLY(assert_completed_buffer_list_len_correct_locked());
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	415 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	416 while (buffers_to_delete != NULL) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	417 BufferNode* nd = buffers_to_delete;
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	418 buffers_to_delete = nd->next();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	419 deallocate_buffer(BufferNode::make_buffer_from_node(nd));
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	420 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	421 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	422 // So we can safely manipulate these queues.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	423 for (JavaThread* t = Threads::first(); t; t = t->next()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	424 t->satb_mark_queue().reset();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	425 }
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	426 shared_satb_queue()->reset();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	427 }

Mercurial > hg > truffle

annotate src/share/vm/gc_implementation/g1/satbQueue.cpp @ 12233:40136aa2cdb1