graal-compiler: src/share/vm/gc_implementation/g1/satbQueue.cpp annotate

annotate src/share/vm/gc_implementation/g1/satbQueue.cpp @ 17833:bfdf528be8e8

8038498: Fix includes and C inlining after 8035330 Summary: Change 8035330: Remove G1ParScanPartialArrayClosure and G1ParScanHeapEvacClosure broke the debug build on AIX. The method do_oop_partial_array() is added in a header, but requires the inline function par_write_ref() through several inlined calls. In some cpp files, like arguments.cpp, par_write_ref() is not defined as the corresponding inline header and is not included. The AIX debug VM does not start because of the missing symbol. This change solves this by cleaning up include dependencies. Reviewed-by: tschatzl, stefank

author	tschatzl
date	Fri, 04 Apr 2014 10:43:56 +0200
parents	f99e331f6ef6
children	e5d78f318aec 8847586c9037

rev	line source
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1 /*
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	2 * Copyright (c) 2001, 2012, Oracle and/or its affiliates. All rights reserved.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	4 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	7 * published by the Free Software Foundation.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	8 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	13 * accompanied this code).
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	14 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	18 *
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1317 diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1317 diff changeset	20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1317 diff changeset	21 * questions.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	22 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	23 */
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	24
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	25 #include "precompiled.hpp"
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	26 #include "gc_implementation/g1/g1CollectedHeap.inline.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	27 #include "gc_implementation/g1/satbQueue.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	28 #include "memory/allocation.inline.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	29 #include "memory/sharedHeap.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: 6197 diff changeset	30 #include "oops/oop.inline.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	31 #include "runtime/mutexLocker.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1552 diff changeset	32 #include "runtime/thread.hpp"
3979 4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	33 #include "runtime/vmThread.hpp"
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	34
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	35 void ObjPtrQueue::flush() {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	36 // The buffer might contain refs into the CSet. We have to filter it
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	37 // first before we flush it, otherwise we might end up with an
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	38 // enqueued buffer with refs into the CSet which breaks our invariants.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	39 filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	40 PtrQueue::flush();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	41 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	42
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	43 // This method removes entries from an SATB buffer that will not be
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	44 // useful to the concurrent marking threads. An entry is removed if it
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	45 // satisfies one of the following conditions:
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	46 //
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	47 // * it points to an object outside the G1 heap (G1's concurrent
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	48 // marking only visits objects inside the G1 heap),
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	49 // * it points to an object that has been allocated since marking
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	50 // started (according to SATB those objects do not need to be
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	51 // visited during marking), or
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	52 // * it points to an object that has already been marked (no need to
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	53 // process it again).
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	54 //
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	55 // The rest of the entries will be retained and are compacted towards
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	56 // the top of the buffer. Note that, because we do not allow old
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	57 // regions in the CSet during marking, all objects on the CSet regions
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	58 // are young (eden or survivors) and therefore implicitly live. So any
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	59 // references into the CSet will be removed during filtering.
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	60
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	61 void ObjPtrQueue::filter() {
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	62 G1CollectedHeap* g1h = G1CollectedHeap::heap();
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	63 void** buf = _buf;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	64 size_t sz = _sz;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	65
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	66 if (buf == NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	67 // nothing to do
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	68 return;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	69 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	70
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	71 // Used for sanity checking at the end of the loop.
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	72 debug_only(size_t entries = 0; size_t retained = 0;)
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	73
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	74 size_t i = sz;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	75 size_t new_index = sz;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	76
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	77 while (i > _index) {
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	78 assert(i > 0, "we should have at least one more entry to process");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	79 i -= oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	80 debug_only(entries += 1;)
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	81 oop* p = (oop*) &buf[byte_index_to_index((int) i)];
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	82 oop obj = *p;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	83 // NULL the entry so that unused parts of the buffer contain NULLs
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	84 // at the end. If we are going to retain it we will copy it to its
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	85 // final place. If we have retained all entries we have visited so
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	86 // far, we'll just end up copying it to the same place.
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	87 *p = NULL;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	88
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	89 bool retain = g1h->is_obj_ill(obj);
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	90 if (retain) {
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	91 assert(new_index > 0, "we should not have already filled up the buffer");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	92 new_index -= oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	93 assert(new_index >= i,
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	94 "new_index should never be below i, as we alwaysr compact 'up'");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	95 oop* new_p = (oop*) &buf[byte_index_to_index((int) new_index)];
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	96 assert(new_p >= p, "the destination location should never be below "
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	97 "the source as we always compact 'up'");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	98 assert(*new_p == NULL,
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	99 "we should have already cleared the destination location");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	100 *new_p = obj;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	101 debug_only(retained += 1;)
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	102 }
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	103 }
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	104
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	105 #ifdef ASSERT
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	106 size_t entries_calc = (sz - _index) / oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	107 assert(entries == entries_calc, "the number of entries we counted "
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	108 "should match the number of entries we calculated");
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	109 size_t retained_calc = (sz - new_index) / oopSize;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	110 assert(retained == retained_calc, "the number of retained entries we counted "
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	111 "should match the number of retained entries we calculated");
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	112 #endif // ASSERT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	113
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	114 _index = new_index;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	115 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	116
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	117 // This method will first apply the above filtering to the buffer. If
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	118 // post-filtering a large enough chunk of the buffer has been cleared
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	119 // we can re-use the buffer (instead of enqueueing it) and we can just
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	120 // allow the mutator to carry on executing using the same buffer
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	121 // instead of replacing it.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	122
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	123 bool ObjPtrQueue::should_enqueue_buffer() {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	124 assert(_lock == NULL \|\| _lock->owned_by_self(),
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	125 "we should have taken the lock before calling this");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	126
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	127 // Even if G1SATBBufferEnqueueingThresholdPercent == 0 we have to
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	128 // filter the buffer given that this will remove any references into
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	129 // the CSet as we currently assume that no such refs will appear in
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	130 // enqueued buffers.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	131
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	132 // This method should only be called if there is a non-NULL buffer
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	133 // that is full.
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	134 assert(_index == 0, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	135 assert(_buf != NULL, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	136
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	137 filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	138
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	139 size_t sz = _sz;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	140 size_t all_entries = sz / oopSize;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	141 size_t retained_entries = (sz - _index) / oopSize;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	142 size_t perc = retained_entries * 100 / all_entries;
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	143 bool should_enqueue = perc > (size_t) G1SATBBufferEnqueueingThresholdPercent;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	144 return should_enqueue;
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	145 }
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 1972 diff changeset	146
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	147 void ObjPtrQueue::apply_closure(ObjectClosure* cl) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	148 if (_buf != NULL) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	149 apply_closure_to_buffer(cl, _buf, _index, _sz);
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	150 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	151 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	152
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	153 void ObjPtrQueue::apply_closure_and_empty(ObjectClosure* cl) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	154 if (_buf != NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	155 apply_closure_to_buffer(cl, _buf, _index, _sz);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	156 _index = _sz;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	157 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	158 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	159
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	160 void ObjPtrQueue::apply_closure_to_buffer(ObjectClosure* cl,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	161 void** buf, size_t index, size_t sz) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	162 if (cl == NULL) return;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	163 for (size_t i = index; i < sz; i += oopSize) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	164 oop obj = (oop)buf[byte_index_to_index((int)i)];
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	165 // There can be NULL entries because of destructors.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	166 if (obj != NULL) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	167 cl->do_object(obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	168 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	169 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	170 }
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	171
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	172 #ifndef PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	173 // Helpful for debugging
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	174
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	175 void ObjPtrQueue::print(const char* name) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	176 print(name, _buf, _index, _sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	177 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	178
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	179 void ObjPtrQueue::print(const char* name,
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	180 void** buf, size_t index, size_t sz) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	181 gclog_or_tty->print_cr(" SATB BUFFER [%s] buf: "PTR_FORMAT" "
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	182 "index: "SIZE_FORMAT" sz: "SIZE_FORMAT,
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	183 name, buf, index, sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	184 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	185 #endif // PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	186
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	187 #ifdef ASSERT
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	188 void ObjPtrQueue::verify_oops_in_buffer() {
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	189 if (_buf == NULL) return;
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	190 for (size_t i = _index; i < _sz; i += oopSize) {
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	191 oop obj = (oop)_buf[byte_index_to_index((int)i)];
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	192 assert(obj != NULL && obj->is_oop(true /* ignore mark word */),
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	193 "Not an oop");
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	194 }
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	195 }
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	196 #endif
df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	197
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	198 #ifdef _MSC_VER // the use of 'this' below gets a warning, make it go away
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	199 #pragma warning( disable:4355 ) // 'this' : used in base member initializer list
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	200 #endif // _MSC_VER
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	201
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	202 SATBMarkQueueSet::SATBMarkQueueSet() :
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	203 PtrQueueSet(), _closure(NULL), _par_closures(NULL),
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	204 _shared_satb_queue(this, true /perm/) { }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	205
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	206 void SATBMarkQueueSet::initialize(Monitor* cbl_mon, Mutex* fl_lock,
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	207 int process_completed_threshold,
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	208 Mutex* lock) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	209 PtrQueueSet::initialize(cbl_mon, fl_lock, process_completed_threshold, -1);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	210 _shared_satb_queue.set_lock(lock);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	211 if (ParallelGCThreads > 0) {
6197 d2a62e0f25eb 6995781: Native Memory Tracking (Phase 1) zgu parents: 4787 diff changeset	212 _par_closures = NEW_C_HEAP_ARRAY(ObjectClosure*, ParallelGCThreads, mtGC);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	213 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	214 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	215
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	216 void SATBMarkQueueSet::handle_zero_index_for_thread(JavaThread* t) {
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	217 DEBUG_ONLY(t->satb_mark_queue().verify_oops_in_buffer();)
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	218 t->satb_mark_queue().handle_zero_index();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	219 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	220
1317 d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	221 #ifdef ASSERT
17747 f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	222 void SATBMarkQueueSet::dump_active_states(bool expected_active) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	223 gclog_or_tty->print_cr("Expected SATB active state: %s",
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	224 expected_active ? "ACTIVE" : "INACTIVE");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	225 gclog_or_tty->print_cr("Actual SATB active states:");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	226 gclog_or_tty->print_cr(" Queue set: %s", is_active() ? "ACTIVE" : "INACTIVE");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	227 for (JavaThread* t = Threads::first(); t; t = t->next()) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	228 gclog_or_tty->print_cr(" Thread \"%s\" queue: %s", t->name(),
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	229 t->satb_mark_queue().is_active() ? "ACTIVE" : "INACTIVE");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	230 }
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	231 gclog_or_tty->print_cr(" Shared queue: %s",
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	232 shared_satb_queue()->is_active() ? "ACTIVE" : "INACTIVE");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	233 }
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	234
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	235 void SATBMarkQueueSet::verify_active_states(bool expected_active) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	236 // Verify queue set state
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	237 if (is_active() != expected_active) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	238 dump_active_states(expected_active);
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	239 guarantee(false, "SATB queue set has an unexpected active state");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	240 }
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	241
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	242 // Verify thread queue states
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	243 for (JavaThread* t = Threads::first(); t; t = t->next()) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	244 if (t->satb_mark_queue().is_active() != expected_active) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	245 dump_active_states(expected_active);
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	246 guarantee(false, "Thread SATB queue has an unexpected active state");
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	247 }
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	248 }
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	249
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	250 // Verify shared queue state
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	251 if (shared_satb_queue()->is_active() != expected_active) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	252 dump_active_states(expected_active);
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	253 guarantee(false, "Shared SATB queue has an unexpected active state");
1317 d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	254 }
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	255 }
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	256 #endif // ASSERT
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	257
17747 f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	258 void SATBMarkQueueSet::set_active_all_threads(bool active, bool expected_active) {
1317 d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	259 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	260 #ifdef ASSERT
17747 f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	261 verify_active_states(expected_active);
1317 d4197f8d516a 6935821: G1: threads created during marking do not active their SATB queues tonyp parents: 1111 diff changeset	262 #endif // ASSERT
17747 f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	263 _all_active = active;
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	264 for (JavaThread* t = Threads::first(); t; t = t->next()) {
f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	265 t->satb_mark_queue().set_active(active);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	266 }
17747 f99e331f6ef6 8029162: G1: Shared SATB queue never enabled pliden parents: 6725 diff changeset	267 shared_satb_queue()->set_active(active);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	268 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	269
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	270 void SATBMarkQueueSet::filter_thread_buffers() {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	271 for(JavaThread* t = Threads::first(); t; t = t->next()) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	272 t->satb_mark_queue().filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	273 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	274 shared_satb_queue()->filter();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	275 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	276
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	277 void SATBMarkQueueSet::set_closure(ObjectClosure* closure) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	278 _closure = closure;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	279 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	280
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	281 void SATBMarkQueueSet::set_par_closure(int i, ObjectClosure* par_closure) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	282 assert(ParallelGCThreads > 0 && _par_closures != NULL, "Precondition");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	283 _par_closures[i] = par_closure;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	284 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	285
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	286 void SATBMarkQueueSet::iterate_closure_all_threads() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	287 for(JavaThread* t = Threads::first(); t; t = t->next()) {
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	288 t->satb_mark_queue().apply_closure_and_empty(_closure);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	289 }
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	290 shared_satb_queue()->apply_closure_and_empty(_closure);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	291 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	292
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	293 void SATBMarkQueueSet::par_iterate_closure_all_threads(int worker) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	294 SharedHeap* sh = SharedHeap::heap();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	295 int parity = sh->strong_roots_parity();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	296
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	297 for(JavaThread* t = Threads::first(); t; t = t->next()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	298 if (t->claim_oops_do(true, parity)) {
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	299 t->satb_mark_queue().apply_closure_and_empty(_par_closures[worker]);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	300 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	301 }
3979 4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	302
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	303 // We also need to claim the VMThread so that its parity is updated
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	304 // otherwise the next call to Thread::possibly_parallel_oops_do inside
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	305 // a StrongRootsScope might skip the VMThread because it has a stale
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	306 // parity that matches the parity set by the StrongRootsScope
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	307 //
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	308 // Whichever worker succeeds in claiming the VMThread gets to do
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	309 // the shared queue.
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	310
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	311 VMThread* vmt = VMThread::vm_thread();
4dfb2df418f2 6484982: G1: process references during evacuation pauses johnc parents: 2149 diff changeset	312 if (vmt->claim_oops_do(true, parity)) {
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	313 shared_satb_queue()->apply_closure_and_empty(_par_closures[worker]);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	314 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	315 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	316
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	317 bool SATBMarkQueueSet::apply_closure_to_completed_buffer_work(bool par,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	318 int worker) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	319 BufferNode* nd = NULL;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	320 {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	321 MutexLockerEx x(_cbl_mon, Mutex::_no_safepoint_check_flag);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	322 if (_completed_buffers_head != NULL) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	323 nd = _completed_buffers_head;
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	324 _completed_buffers_head = nd->next();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	325 if (_completed_buffers_head == NULL) _completed_buffers_tail = NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	326 _n_completed_buffers--;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	327 if (_n_completed_buffers == 0) _process_completed = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	328 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	329 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	330 ObjectClosure* cl = (par ? _par_closures[worker] : _closure);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	331 if (nd != NULL) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	332 void **buf = BufferNode::make_buffer_from_node(nd);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	333 ObjPtrQueue::apply_closure_to_buffer(cl, buf, 0, _sz);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	334 deallocate_buffer(buf);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	335 return true;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	336 } else {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	337 return false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	338 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	339 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	340
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	341 void SATBMarkQueueSet::iterate_completed_buffers_read_only(ObjectClosure* cl) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	342 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	343 assert(cl != NULL, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	344
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	345 BufferNode* nd = _completed_buffers_head;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	346 while (nd != NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	347 void** buf = BufferNode::make_buffer_from_node(nd);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	348 ObjPtrQueue::apply_closure_to_buffer(cl, buf, 0, _sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	349 nd = nd->next();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	350 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	351 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	352
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	353 void SATBMarkQueueSet::iterate_thread_buffers_read_only(ObjectClosure* cl) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	354 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	355 assert(cl != NULL, "pre-condition");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	356
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	357 for (JavaThread* t = Threads::first(); t; t = t->next()) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	358 t->satb_mark_queue().apply_closure(cl);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	359 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	360 shared_satb_queue()->apply_closure(cl);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	361 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	362
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	363 #ifndef PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	364 // Helpful for debugging
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	365
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	366 #define SATB_PRINTER_BUFFER_SIZE 256
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	367
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	368 void SATBMarkQueueSet::print_all(const char* msg) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	369 char buffer[SATB_PRINTER_BUFFER_SIZE];
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	370 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	371
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	372 gclog_or_tty->cr();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	373 gclog_or_tty->print_cr("SATB BUFFERS [%s]", msg);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	374
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	375 BufferNode* nd = _completed_buffers_head;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	376 int i = 0;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	377 while (nd != NULL) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	378 void** buf = BufferNode::make_buffer_from_node(nd);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	379 jio_snprintf(buffer, SATB_PRINTER_BUFFER_SIZE, "Enqueued: %d", i);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	380 ObjPtrQueue::print(buffer, buf, 0, _sz);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	381 nd = nd->next();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	382 i += 1;
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	383 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	384
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	385 for (JavaThread* t = Threads::first(); t; t = t->next()) {
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	386 jio_snprintf(buffer, SATB_PRINTER_BUFFER_SIZE, "Thread: %s", t->name());
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	387 t->satb_mark_queue().print(buffer);
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	388 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	389
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	390 shared_satb_queue()->print("Shared");
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	391
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	392 gclog_or_tty->cr();
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	393 }
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	394 #endif // PRODUCT
2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	395
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	396 void SATBMarkQueueSet::abandon_partial_marking() {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	397 BufferNode* buffers_to_delete = NULL;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	398 {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	399 MutexLockerEx x(_cbl_mon, Mutex::_no_safepoint_check_flag);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	400 while (_completed_buffers_head != NULL) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	401 BufferNode* nd = _completed_buffers_head;
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	402 _completed_buffers_head = nd->next();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	403 nd->set_next(buffers_to_delete);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	404 buffers_to_delete = nd;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	405 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	406 _completed_buffers_tail = NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	407 _n_completed_buffers = 0;
845 df6caf649ff7 6700789: G1: Enable use of compressed oops with G1 heaps ysr parents: 342 diff changeset	408 DEBUG_ONLY(assert_completed_buffer_list_len_correct_locked());
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	409 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	410 while (buffers_to_delete != NULL) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	411 BufferNode* nd = buffers_to_delete;
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	412 buffers_to_delete = nd->next();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 845 diff changeset	413 deallocate_buffer(BufferNode::make_buffer_from_node(nd));
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	414 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	415 assert(SafepointSynchronize::is_at_safepoint(), "Must be at safepoint.");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	416 // So we can safely manipulate these queues.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	417 for (JavaThread* t = Threads::first(); t; t = t->next()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	418 t->satb_mark_queue().reset();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	419 }
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 3979 diff changeset	420 shared_satb_queue()->reset();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	421 }

Mercurial > hg > graal-compiler

annotate src/share/vm/gc_implementation/g1/satbQueue.cpp @ 17833:bfdf528be8e8