truffle: src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp annotate

annotate src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp @ 17833:bfdf528be8e8

8038498: Fix includes and C inlining after 8035330 Summary: Change 8035330: Remove G1ParScanPartialArrayClosure and G1ParScanHeapEvacClosure broke the debug build on AIX. The method do_oop_partial_array() is added in a header, but requires the inline function par_write_ref() through several inlined calls. In some cpp files, like arguments.cpp, par_write_ref() is not defined as the corresponding inline header and is not included. The AIX debug VM does not start because of the missing symbol. This change solves this by cleaning up include dependencies. Reviewed-by: tschatzl, stefank

author	tschatzl
date	Fri, 04 Apr 2014 10:43:56 +0200
parents	58fc1b1523dc
children	78bbf4d43a14

rev	line source
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1 /*
17467 55fb97c4c58d 8029233: Update copyright year to match last edit in jdk8 hotspot repository for 2013 mikael parents: 12835 diff changeset	2 * Copyright (c) 2001, 2013, Oracle and/or its affiliates. All rights reserved.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	4 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	7 * published by the Free Software Foundation.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	8 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	13 * accompanied this code).
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	14 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	18 *
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 752 diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 752 diff changeset	20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 752 diff changeset	21 * questions.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	22 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	23 */
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	24
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	25 #ifndef SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	26 #define SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	27
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	28 #include "gc_implementation/g1/concurrentMark.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	29 #include "gc_implementation/g1/g1CollectedHeap.hpp"
2433 abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	30 #include "gc_implementation/g1/g1AllocRegion.inline.hpp"
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	31 #include "gc_implementation/g1/g1CollectorPolicy.hpp"
17833 bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	32 #include "gc_implementation/g1/g1RemSet.inline.hpp"
12835 69944b868a32 8014555: G1: Memory ordering problem with Conc refinement and card marking mgerdin parents: 12343 diff changeset	33 #include "gc_implementation/g1/g1SATBCardTableModRefBS.hpp"
17736 58fc1b1523dc 8034079: G1: Refactor the HeapRegionSet hierarchy brutisso parents: 17467 diff changeset	34 #include "gc_implementation/g1/heapRegionSet.inline.hpp"
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 2134 diff changeset	35 #include "gc_implementation/g1/heapRegionSeq.inline.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	36 #include "utilities/taskqueue.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	37
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	38 // Inline functions for G1CollectedHeap
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	39
17833 bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	40 // Return the region with the given index. It assumes the index is valid.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	41 inline HeapRegion* G1CollectedHeap::region_at(uint index) const { return _hrs.at(index); }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	42
3766 c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	43 template <class T>
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	44 inline HeapRegion*
3766 c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	45 G1CollectedHeap::heap_region_containing(const T addr) const {
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	46 HeapRegion* hr = _hrs.addr_to_region((HeapWord*) addr);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	47 // hr can be null if addr in perm_gen
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	48 if (hr != NULL && hr->continuesHumongous()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	49 hr = hr->humongous_start_region();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	50 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	51 return hr;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	52 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	53
3766 c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	54 template <class T>
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	55 inline HeapRegion*
3766 c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	56 G1CollectedHeap::heap_region_containing_raw(const T addr) const {
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	57 assert(_g1_reserved.contains((const void*) addr), "invariant");
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	58 HeapRegion* res = _hrs.addr_to_region_unsafe((HeapWord*) addr);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	59 return res;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	60 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	61
17833 bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	62 inline void G1CollectedHeap::old_set_remove(HeapRegion* hr) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	63 _old_set.remove(hr);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	64 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	65
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	66 inline bool G1CollectedHeap::obj_in_cs(oop obj) {
3766 c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class tonyp parents: 2433 diff changeset	67 HeapRegion* r = _hrs.addr_to_region((HeapWord*) obj);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	68 return r != NULL && r->in_collection_set();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	69 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	70
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	71 inline HeapWord*
2433 abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	72 G1CollectedHeap::attempt_allocation(size_t word_size,
8853 2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine mgerdin parents: 6629 diff changeset	73 unsigned int* gc_count_before_ret,
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine mgerdin parents: 6629 diff changeset	74 int* gclocker_retry_count_ret) {
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	75 assert_heap_not_locked_and_not_at_safepoint();
2433 abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	76 assert(!isHumongous(word_size), "attempt_allocation() should not "
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	77 "be called for humongous allocation requests");
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	78
2433 abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	79 HeapWord* result = _mutator_alloc_region.attempt_allocation(word_size,
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	80 false /* bot_updates */);
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	81 if (result == NULL) {
8853 2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine mgerdin parents: 6629 diff changeset	82 result = attempt_allocation_slow(word_size,
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine mgerdin parents: 6629 diff changeset	83 gc_count_before_ret,
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine mgerdin parents: 6629 diff changeset	84 gclocker_retry_count_ret);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	85 }
2433 abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	86 assert_heap_not_locked();
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	87 if (result != NULL) {
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	88 dirty_young_block(result, word_size);
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	89 }
2433 abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path tonyp parents: 2152 diff changeset	90 return result;
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	91 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	92
3830 f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	93 inline HeapWord* G1CollectedHeap::survivor_attempt_allocation(size_t
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	94 word_size) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	95 assert(!isHumongous(word_size),
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	96 "we should not be seeing humongous-size allocations in this path");
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	97
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	98 HeapWord* result = _survivor_gc_alloc_region.attempt_allocation(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	99 false /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	100 if (result == NULL) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	101 MutexLockerEx x(FreeList_lock, Mutex::_no_safepoint_check_flag);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	102 result = _survivor_gc_alloc_region.attempt_allocation_locked(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	103 false /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	104 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	105 if (result != NULL) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	106 dirty_young_block(result, word_size);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	107 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	108 return result;
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	109 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	110
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	111 inline HeapWord* G1CollectedHeap::old_attempt_allocation(size_t word_size) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	112 assert(!isHumongous(word_size),
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	113 "we should not be seeing humongous-size allocations in this path");
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	114
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	115 HeapWord* result = _old_gc_alloc_region.attempt_allocation(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	116 true /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	117 if (result == NULL) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	118 MutexLockerEx x(FreeList_lock, Mutex::_no_safepoint_check_flag);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	119 result = _old_gc_alloc_region.attempt_allocation_locked(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	120 true /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	121 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	122 return result;
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	123 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3766 diff changeset	124
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	125 // It dirties the cards that cover the block so that so that the post
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	126 // write barrier never queues anything when updating objects on this
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	127 // block. It is assumed (and in fact we assert) that the block
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	128 // belongs to a young region.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	129 inline void
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	130 G1CollectedHeap::dirty_young_block(HeapWord* start, size_t word_size) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	131 assert_heap_not_locked();
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	132
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	133 // Assign the containing region to containing_hr so that we don't
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	134 // have to keep calling heap_region_containing_raw() in the
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	135 // asserts below.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	136 DEBUG_ONLY(HeapRegion* containing_hr = heap_region_containing_raw(start);)
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	137 assert(containing_hr != NULL && start != NULL && word_size > 0,
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	138 "pre-condition");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	139 assert(containing_hr->is_in(start), "it should contain start");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	140 assert(containing_hr->is_young(), "it should be young");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	141 assert(!containing_hr->isHumongous(), "it should not be humongous");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	142
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	143 HeapWord* end = start + word_size;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	144 assert(containing_hr->is_in(end - 1), "it should also contain end - 1");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	145
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	146 MemRegion mr(start, end);
12835 69944b868a32 8014555: G1: Memory ordering problem with Conc refinement and card marking mgerdin parents: 12343 diff changeset	147 g1_barrier_set()->g1_mark_as_young(mr);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	148 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	149
1709 5f429ee79634 6966222: G1: simplify TaskQueue overflow handling jcoomes parents: 1552 diff changeset	150 inline RefToScanQueue* G1CollectedHeap::task_queue(int i) const {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	151 return _task_queues->queue(i);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	152 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	153
6629 c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	154 inline bool G1CollectedHeap::isMarkedPrev(oop obj) const {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	155 return _cm->prevMarkBitMap()->isMarked((HeapWord *)obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	156 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	157
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	158 inline bool G1CollectedHeap::isMarkedNext(oop obj) const {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	159 return _cm->nextMarkBitMap()->isMarked((HeapWord *)obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	160 }
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	161
17833 bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	162
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	163 // This is a fast test on whether a reference points into the
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	164 // collection set or not. Assume that the reference
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	165 // points into the heap.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	166 inline bool G1CollectedHeap::in_cset_fast_test(oop obj) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	167 assert(_in_cset_fast_test != NULL, "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	168 assert(_g1_committed.contains((HeapWord) obj), err_msg("Given reference outside of heap, is "PTR_FORMAT, (HeapWord)obj));
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	169 // no need to subtract the bottom of the heap from obj,
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	170 // _in_cset_fast_test is biased
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	171 uintx index = cast_from_oop<uintx>(obj) >> HeapRegion::LogOfHRGrainBytes;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	172 bool ret = _in_cset_fast_test[index];
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	173 // let's make sure the result is consistent with what the slower
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	174 // test returns
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	175 assert( ret \|\| !obj_in_cs(obj), "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	176 assert(!ret \|\| obj_in_cs(obj), "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	177 return ret;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	178 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	179
6629 c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	180 #ifndef PRODUCT
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	181 // Support for G1EvacuationFailureALot
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	182
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	183 inline bool
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	184 G1CollectedHeap::evacuation_failure_alot_for_gc_type(bool gcs_are_young,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	185 bool during_initial_mark,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	186 bool during_marking) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	187 bool res = false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	188 if (during_marking) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	189 res \|= G1EvacuationFailureALotDuringConcMark;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	190 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	191 if (during_initial_mark) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	192 res \|= G1EvacuationFailureALotDuringInitialMark;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	193 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	194 if (gcs_are_young) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	195 res \|= G1EvacuationFailureALotDuringYoungGC;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	196 } else {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	197 // GCs are mixed
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	198 res \|= G1EvacuationFailureALotDuringMixedGC;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	199 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	200 return res;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	201 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	202
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	203 inline void
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	204 G1CollectedHeap::set_evacuation_failure_alot_for_current_gc() {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	205 if (G1EvacuationFailureALot) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	206 // Note we can't assert that _evacuation_failure_alot_for_current_gc
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	207 // is clear here. It may have been set during a previous GC but that GC
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	208 // did not copy enough objects (i.e. G1EvacuationFailureALotCount) to
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	209 // trigger an evacuation failure and clear the flags and and counts.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	210
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	211 // Check if we have gone over the interval.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	212 const size_t gc_num = total_collections();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	213 const size_t elapsed_gcs = gc_num - _evacuation_failure_alot_gc_number;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	214
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	215 _evacuation_failure_alot_for_current_gc = (elapsed_gcs >= G1EvacuationFailureALotInterval);
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	216
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	217 // Now check if G1EvacuationFailureALot is enabled for the current GC type.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	218 const bool gcs_are_young = g1_policy()->gcs_are_young();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	219 const bool during_im = g1_policy()->during_initial_mark_pause();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	220 const bool during_marking = mark_in_progress();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	221
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	222 _evacuation_failure_alot_for_current_gc &=
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	223 evacuation_failure_alot_for_gc_type(gcs_are_young,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	224 during_im,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	225 during_marking);
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	226 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	227 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	228
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	229 inline bool
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	230 G1CollectedHeap::evacuation_should_fail() {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	231 if (!G1EvacuationFailureALot \|\| !_evacuation_failure_alot_for_current_gc) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	232 return false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	233 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	234 // G1EvacuationFailureALot is in effect for current GC
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	235 // Access to _evacuation_failure_alot_count is not atomic;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	236 // the value does not have to be exact.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	237 if (++_evacuation_failure_alot_count < G1EvacuationFailureALotCount) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	238 return false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	239 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	240 _evacuation_failure_alot_count = 0;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	241 return true;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	242 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	243
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	244 inline void G1CollectedHeap::reset_evacuation_should_fail() {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	245 if (G1EvacuationFailureALot) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	246 _evacuation_failure_alot_gc_number = total_collections();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	247 _evacuation_failure_alot_count = 0;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	248 _evacuation_failure_alot_for_current_gc = false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	249 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	250 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	251 #endif // #ifndef PRODUCT
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures johnc parents: 3830 diff changeset	252
17833 bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	253 inline bool G1CollectedHeap::is_in_young(const oop obj) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	254 HeapRegion* hr = heap_region_containing(obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	255 return hr != NULL && hr->is_young();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	256 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	257
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	258 // We don't need barriers for initializing stores to objects
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	259 // in the young gen: for the SATB pre-barrier, there is no
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	260 // pre-value that needs to be remembered; for the remembered-set
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	261 // update logging post-barrier, we don't maintain remembered set
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	262 // information for young gen objects.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	263 inline bool G1CollectedHeap::can_elide_initializing_store_barrier(oop new_obj) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	264 return is_in_young(new_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	265 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	266
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	267 inline bool G1CollectedHeap::is_obj_dead(const oop obj) const {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	268 const HeapRegion* hr = heap_region_containing(obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	269 if (hr == NULL) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	270 if (obj == NULL) return false;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	271 else return true;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	272 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	273 else return is_obj_dead(obj, hr);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	274 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	275
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	276 inline bool G1CollectedHeap::is_obj_ill(const oop obj) const {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	277 const HeapRegion* hr = heap_region_containing(obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	278 if (hr == NULL) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	279 if (obj == NULL) return false;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	280 else return true;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	281 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	282 else return is_obj_ill(obj, hr);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	283 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	284
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	285 template <class T> inline void G1ParScanThreadState::immediate_rs_update(HeapRegion* from, T* p, int tid) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	286 if (!from->is_survivor()) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	287 _g1_rem->par_write_ref(from, p, tid);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	288 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	289 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	290
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	291 template <class T> void G1ParScanThreadState::update_rs(HeapRegion* from, T* p, int tid) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	292 if (G1DeferredRSUpdate) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	293 deferred_rs_update(from, p, tid);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	294 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	295 immediate_rs_update(from, p, tid);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	296 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	297 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	298
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	299
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	300 inline void G1ParScanThreadState::do_oop_partial_array(oop* p) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	301 assert(has_partial_array_mask(p), "invariant");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	302 oop from_obj = clear_partial_array_mask(p);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	303
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	304 assert(Universe::heap()->is_in_reserved(from_obj), "must be in heap.");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	305 assert(from_obj->is_objArray(), "must be obj array");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	306 objArrayOop from_obj_array = objArrayOop(from_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	307 // The from-space object contains the real length.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	308 int length = from_obj_array->length();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	309
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	310 assert(from_obj->is_forwarded(), "must be forwarded");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	311 oop to_obj = from_obj->forwardee();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	312 assert(from_obj != to_obj, "should not be chunking self-forwarded objects");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	313 objArrayOop to_obj_array = objArrayOop(to_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	314 // We keep track of the next start index in the length field of the
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	315 // to-space object.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	316 int next_index = to_obj_array->length();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	317 assert(0 <= next_index && next_index < length,
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	318 err_msg("invariant, next index: %d, length: %d", next_index, length));
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	319
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	320 int start = next_index;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	321 int end = length;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	322 int remainder = end - start;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	323 // We'll try not to push a range that's smaller than ParGCArrayScanChunk.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	324 if (remainder > 2 * ParGCArrayScanChunk) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	325 end = start + ParGCArrayScanChunk;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	326 to_obj_array->set_length(end);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	327 // Push the remainder before we process the range in case another
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	328 // worker has run out of things to do and can steal it.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	329 oop* from_obj_p = set_partial_array_mask(from_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	330 push_on_queue(from_obj_p);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	331 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	332 assert(length == end, "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	333 // We'll process the final range for this object. Restore the length
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	334 // so that the heap remains parsable in case of evacuation failure.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	335 to_obj_array->set_length(end);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	336 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	337 _scanner.set_region(_g1h->heap_region_containing_raw(to_obj));
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	338 // Process indexes [start,end). It will also process the header
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	339 // along with the first chunk (i.e., the chunk with start == 0).
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	340 // Note that at this point the length field of to_obj_array is not
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	341 // correct given that we are using it to keep track of the next
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	342 // start index. oop_iterate_range() (thankfully!) ignores the length
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	343 // field and only relies on the start / end parameters. It does
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	344 // however return the size of the object which will be incorrect. So
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	345 // we have to ignore it even if we wanted to use it.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	346 to_obj_array->oop_iterate_range(&_scanner, start, end);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	347 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	348
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	349 template <class T> inline void G1ParScanThreadState::deal_with_reference(T* ref_to_scan) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	350 if (!has_partial_array_mask(ref_to_scan)) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	351 // Note: we can use "raw" versions of "region_containing" because
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	352 // "obj_to_scan" is definitely in the heap, and is not in a
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	353 // humongous region.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	354 HeapRegion* r = _g1h->heap_region_containing_raw(ref_to_scan);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	355 do_oop_evac(ref_to_scan, r);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	356 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	357 do_oop_partial_array((oop*)ref_to_scan);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	358 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	359 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	360
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	361 inline void G1ParScanThreadState::deal_with_reference(StarTask ref) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	362 assert(verify_task(ref), "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	363 if (ref.is_narrow()) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	364 deal_with_reference((narrowOop*)ref);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	365 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	366 deal_with_reference((oop*)ref);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	367 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	368 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330 tschatzl parents: 17736 diff changeset	369
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	370 #endif // SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP

Mercurial > hg > truffle

annotate src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp @ 17833:bfdf528be8e8