Mercurial > hg > graal-jvmci-8

annotate src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp @ 20211:82693fb204a5

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
8038930: G1CodeRootSet::test fails with assert(_num_chunks_handed_out == 0) failed: No elements must have been handed out yet Summary: The test incorrectly assumed that it had been started with no other previous compilation activity. Fix this by allowing multiple code root free chunk lists, and use one separate from the global one to perform the test. Reviewed-by: brutisso
author tschatzl
date Wed, 16 Apr 2014 10:14:50 +0200
parents ce8f6bb717c9
children d7e2d5f2846b
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
1 /*
17937
78bbf4d43a14 8037816: Fix for 8036122 breaks build with Xcode5/clang
drchase
parents: 17833
diff changeset
2 * Copyright (c) 2001, 2014, Oracle and/or its affiliates. All rights reserved.
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
4 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
5 * This code is free software; you can redistribute it and/or modify it
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
6 * under the terms of the GNU General Public License version 2 only, as
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
7 * published by the Free Software Foundation.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
8 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
9 * This code is distributed in the hope that it will be useful, but WITHOUT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
12 * version 2 for more details (a copy is included in the LICENSE file that
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
13 * accompanied this code).
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
14 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
15 * You should have received a copy of the GNU General Public License version
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
16 * 2 along with this work; if not, write to the Free Software Foundation,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
18 *
1552
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories
trims
parents: 752
diff changeset
19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories
trims
parents: 752
diff changeset
20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories
trims
parents: 752
diff changeset
21 * questions.
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
22 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
23 */
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
24
1972
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
25 #ifndef SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
26 #define SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
27
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
28 #include "gc_implementation/g1/concurrentMark.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
29 #include "gc_implementation/g1/g1CollectedHeap.hpp"
2433
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
30 #include "gc_implementation/g1/g1AllocRegion.inline.hpp"
1973
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
31 #include "gc_implementation/g1/g1CollectorPolicy.hpp"
17833
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
32 #include "gc_implementation/g1/g1RemSet.inline.hpp"
12835
69944b868a32 8014555: G1: Memory ordering problem with Conc refinement and card marking
mgerdin
parents: 12343
diff changeset
33 #include "gc_implementation/g1/g1SATBCardTableModRefBS.hpp"
17736
58fc1b1523dc 8034079: G1: Refactor the HeapRegionSet hierarchy
brutisso
parents: 17467
diff changeset
34 #include "gc_implementation/g1/heapRegionSet.inline.hpp"
2149
7e37af9d69ef 7011379: G1: overly long concurrent marking cycles
tonyp
parents: 2134
diff changeset
35 #include "gc_implementation/g1/heapRegionSeq.inline.hpp"
20197
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
36 #include "runtime/orderAccess.inline.hpp"
1972
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
37 #include "utilities/taskqueue.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
38
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
39 // Inline functions for G1CollectedHeap
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
40
17833
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
41 // Return the region with the given index. It assumes the index is valid.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
42 inline HeapRegion* G1CollectedHeap::region_at(uint index) const { return _hrs.at(index); }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
43
3766
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
44 template <class T>
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
45 inline HeapRegion*
3766
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
46 G1CollectedHeap::heap_region_containing(const T addr) const {
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
47 HeapRegion* hr = _hrs.addr_to_region((HeapWord*) addr);
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
48 // hr can be null if addr in perm_gen
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
49 if (hr != NULL && hr->continuesHumongous()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
50 hr = hr->humongous_start_region();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
51 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
52 return hr;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
53 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
54
3766
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
55 template <class T>
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
56 inline HeapRegion*
3766
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
57 G1CollectedHeap::heap_region_containing_raw(const T addr) const {
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
58 assert(_g1_reserved.contains((const void*) addr), "invariant");
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
59 HeapRegion* res = _hrs.addr_to_region_unsafe((HeapWord*) addr);
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
60 return res;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
61 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
62
20197
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
63 inline void G1CollectedHeap::reset_gc_time_stamp() {
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
64 _gc_time_stamp = 0;
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
65 OrderAccess::fence();
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
66 // Clear the cached CSet starting regions and time stamps.
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
67 // Their validity is dependent on the GC timestamp.
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
68 clear_cset_start_regions();
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
69 }
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
70
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
71 inline void G1CollectedHeap::increment_gc_time_stamp() {
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
72 ++_gc_time_stamp;
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
73 OrderAccess::fence();
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
74 }
ce8f6bb717c9 8042195: Introduce umbrella header orderAccess.inline.hpp.
goetz
parents: 17937
diff changeset
75
17833
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
76 inline void G1CollectedHeap::old_set_remove(HeapRegion* hr) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
77 _old_set.remove(hr);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
78 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
79
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
80 inline bool G1CollectedHeap::obj_in_cs(oop obj) {
3766
c3f1170908be 7045330: G1: Simplify/fix the HeapRegionSeq class
tonyp
parents: 2433
diff changeset
81 HeapRegion* r = _hrs.addr_to_region((HeapWord*) obj);
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
82 return r != NULL && r->in_collection_set();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
83 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
84
1973
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
85 inline HeapWord*
2433
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
86 G1CollectedHeap::attempt_allocation(size_t word_size,
8853
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine
mgerdin
parents: 6629
diff changeset
87 unsigned int* gc_count_before_ret,
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine
mgerdin
parents: 6629
diff changeset
88 int* gclocker_retry_count_ret) {
2134
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS
tonyp
parents: 1991
diff changeset
89 assert_heap_not_locked_and_not_at_safepoint();
2433
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
90 assert(!isHumongous(word_size), "attempt_allocation() should not "
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
91 "be called for humongous allocation requests");
1973
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
92
2433
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
93 HeapWord* result = _mutator_alloc_region.attempt_allocation(word_size,
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
94 false /* bot_updates */);
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
95 if (result == NULL) {
8853
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine
mgerdin
parents: 6629
diff changeset
96 result = attempt_allocation_slow(word_size,
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine
mgerdin
parents: 6629
diff changeset
97 gc_count_before_ret,
2e093b564241 7014552: gc/lock/jni/jnilockXXX works too slow on 1-processor machine
mgerdin
parents: 6629
diff changeset
98 gclocker_retry_count_ret);
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
99 }
2433
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
100 assert_heap_not_locked();
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
101 if (result != NULL) {
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
102 dirty_young_block(result, word_size);
2134
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS
tonyp
parents: 1991
diff changeset
103 }
2433
abdfc822206f 7023069: G1: Introduce symmetric locking in the slow allocation path
tonyp
parents: 2152
diff changeset
104 return result;
2134
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS
tonyp
parents: 1991
diff changeset
105 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS
tonyp
parents: 1991
diff changeset
106
3830
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
107 inline HeapWord* G1CollectedHeap::survivor_attempt_allocation(size_t
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
108 word_size) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
109 assert(!isHumongous(word_size),
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
110 "we should not be seeing humongous-size allocations in this path");
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
111
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
112 HeapWord* result = _survivor_gc_alloc_region.attempt_allocation(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
113 false /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
114 if (result == NULL) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
115 MutexLockerEx x(FreeList_lock, Mutex::_no_safepoint_check_flag);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
116 result = _survivor_gc_alloc_region.attempt_allocation_locked(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
117 false /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
118 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
119 if (result != NULL) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
120 dirty_young_block(result, word_size);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
121 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
122 return result;
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
123 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
124
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
125 inline HeapWord* G1CollectedHeap::old_attempt_allocation(size_t word_size) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
126 assert(!isHumongous(word_size),
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
127 "we should not be seeing humongous-size allocations in this path");
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
128
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
129 HeapWord* result = _old_gc_alloc_region.attempt_allocation(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
130 true /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
131 if (result == NULL) {
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
132 MutexLockerEx x(FreeList_lock, Mutex::_no_safepoint_check_flag);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
133 result = _old_gc_alloc_region.attempt_allocation_locked(word_size,
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
134 true /* bot_updates */);
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
135 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
136 return result;
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
137 }
f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally
tonyp
parents: 3766
diff changeset
138
1973
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
139 // It dirties the cards that cover the block so that so that the post
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
140 // write barrier never queues anything when updating objects on this
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
141 // block. It is assumed (and in fact we assert) that the block
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
142 // belongs to a young region.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
143 inline void
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
144 G1CollectedHeap::dirty_young_block(HeapWord* start, size_t word_size) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
145 assert_heap_not_locked();
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
146
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
147 // Assign the containing region to containing_hr so that we don't
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
148 // have to keep calling heap_region_containing_raw() in the
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
149 // asserts below.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
150 DEBUG_ONLY(HeapRegion* containing_hr = heap_region_containing_raw(start);)
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
151 assert(containing_hr != NULL && start != NULL && word_size > 0,
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
152 "pre-condition");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
153 assert(containing_hr->is_in(start), "it should contain start");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
154 assert(containing_hr->is_young(), "it should be young");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
155 assert(!containing_hr->isHumongous(), "it should not be humongous");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
156
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
157 HeapWord* end = start + word_size;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
158 assert(containing_hr->is_in(end - 1), "it should also contain end - 1");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
159
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations
tonyp
parents: 1972
diff changeset
160 MemRegion mr(start, end);
12835
69944b868a32 8014555: G1: Memory ordering problem with Conc refinement and card marking
mgerdin
parents: 12343
diff changeset
161 g1_barrier_set()->g1_mark_as_young(mr);
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
162 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
163
1709
5f429ee79634 6966222: G1: simplify TaskQueue overflow handling
jcoomes
parents: 1552
diff changeset
164 inline RefToScanQueue* G1CollectedHeap::task_queue(int i) const {
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
165 return _task_queues->queue(i);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
166 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
167
6629
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
168 inline bool G1CollectedHeap::isMarkedPrev(oop obj) const {
342
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
169 return _cm->prevMarkBitMap()->isMarked((HeapWord *)obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
170 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
171
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
172 inline bool G1CollectedHeap::isMarkedNext(oop obj) const {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
173 return _cm->nextMarkBitMap()->isMarked((HeapWord *)obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector
ysr
parents:
diff changeset
174 }
1972
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
175
17833
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
176
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
177 // This is a fast test on whether a reference points into the
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
178 // collection set or not. Assume that the reference
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
179 // points into the heap.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
180 inline bool G1CollectedHeap::in_cset_fast_test(oop obj) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
181 assert(_in_cset_fast_test != NULL, "sanity");
17937
78bbf4d43a14 8037816: Fix for 8036122 breaks build with Xcode5/clang
drchase
parents: 17833
diff changeset
182 assert(_g1_committed.contains((HeapWord*) obj), err_msg("Given reference outside of heap, is "PTR_FORMAT, p2i((HeapWord*)obj)));
17833
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
183 // no need to subtract the bottom of the heap from obj,
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
184 // _in_cset_fast_test is biased
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
185 uintx index = cast_from_oop<uintx>(obj) >> HeapRegion::LogOfHRGrainBytes;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
186 bool ret = _in_cset_fast_test[index];
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
187 // let's make sure the result is consistent with what the slower
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
188 // test returns
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
189 assert( ret || !obj_in_cs(obj), "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
190 assert(!ret || obj_in_cs(obj), "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
191 return ret;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
192 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
193
6629
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
194 #ifndef PRODUCT
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
195 // Support for G1EvacuationFailureALot
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
196
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
197 inline bool
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
198 G1CollectedHeap::evacuation_failure_alot_for_gc_type(bool gcs_are_young,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
199 bool during_initial_mark,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
200 bool during_marking) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
201 bool res = false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
202 if (during_marking) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
203 res |= G1EvacuationFailureALotDuringConcMark;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
204 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
205 if (during_initial_mark) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
206 res |= G1EvacuationFailureALotDuringInitialMark;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
207 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
208 if (gcs_are_young) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
209 res |= G1EvacuationFailureALotDuringYoungGC;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
210 } else {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
211 // GCs are mixed
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
212 res |= G1EvacuationFailureALotDuringMixedGC;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
213 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
214 return res;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
215 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
216
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
217 inline void
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
218 G1CollectedHeap::set_evacuation_failure_alot_for_current_gc() {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
219 if (G1EvacuationFailureALot) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
220 // Note we can't assert that _evacuation_failure_alot_for_current_gc
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
221 // is clear here. It may have been set during a previous GC but that GC
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
222 // did not copy enough objects (i.e. G1EvacuationFailureALotCount) to
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
223 // trigger an evacuation failure and clear the flags and and counts.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
224
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
225 // Check if we have gone over the interval.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
226 const size_t gc_num = total_collections();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
227 const size_t elapsed_gcs = gc_num - _evacuation_failure_alot_gc_number;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
228
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
229 _evacuation_failure_alot_for_current_gc = (elapsed_gcs >= G1EvacuationFailureALotInterval);
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
230
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
231 // Now check if G1EvacuationFailureALot is enabled for the current GC type.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
232 const bool gcs_are_young = g1_policy()->gcs_are_young();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
233 const bool during_im = g1_policy()->during_initial_mark_pause();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
234 const bool during_marking = mark_in_progress();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
235
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
236 _evacuation_failure_alot_for_current_gc &=
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
237 evacuation_failure_alot_for_gc_type(gcs_are_young,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
238 during_im,
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
239 during_marking);
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
240 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
241 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
242
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
243 inline bool
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
244 G1CollectedHeap::evacuation_should_fail() {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
245 if (!G1EvacuationFailureALot || !_evacuation_failure_alot_for_current_gc) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
246 return false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
247 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
248 // G1EvacuationFailureALot is in effect for current GC
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
249 // Access to _evacuation_failure_alot_count is not atomic;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
250 // the value does not have to be exact.
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
251 if (++_evacuation_failure_alot_count < G1EvacuationFailureALotCount) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
252 return false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
253 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
254 _evacuation_failure_alot_count = 0;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
255 return true;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
256 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
257
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
258 inline void G1CollectedHeap::reset_evacuation_should_fail() {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
259 if (G1EvacuationFailureALot) {
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
260 _evacuation_failure_alot_gc_number = total_collections();
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
261 _evacuation_failure_alot_count = 0;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
262 _evacuation_failure_alot_for_current_gc = false;
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
263 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
264 }
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
265 #endif // #ifndef PRODUCT
c9814fadeb38 7041879: G1: introduce stress testing parameter to cause frequent evacuation failures
johnc
parents: 3830
diff changeset
266
17833
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
267 inline bool G1CollectedHeap::is_in_young(const oop obj) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
268 HeapRegion* hr = heap_region_containing(obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
269 return hr != NULL && hr->is_young();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
270 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
271
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
272 // We don't need barriers for initializing stores to objects
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
273 // in the young gen: for the SATB pre-barrier, there is no
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
274 // pre-value that needs to be remembered; for the remembered-set
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
275 // update logging post-barrier, we don't maintain remembered set
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
276 // information for young gen objects.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
277 inline bool G1CollectedHeap::can_elide_initializing_store_barrier(oop new_obj) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
278 return is_in_young(new_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
279 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
280
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
281 inline bool G1CollectedHeap::is_obj_dead(const oop obj) const {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
282 const HeapRegion* hr = heap_region_containing(obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
283 if (hr == NULL) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
284 if (obj == NULL) return false;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
285 else return true;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
286 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
287 else return is_obj_dead(obj, hr);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
288 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
289
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
290 inline bool G1CollectedHeap::is_obj_ill(const oop obj) const {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
291 const HeapRegion* hr = heap_region_containing(obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
292 if (hr == NULL) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
293 if (obj == NULL) return false;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
294 else return true;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
295 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
296 else return is_obj_ill(obj, hr);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
297 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
298
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
299 template <class T> inline void G1ParScanThreadState::immediate_rs_update(HeapRegion* from, T* p, int tid) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
300 if (!from->is_survivor()) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
301 _g1_rem->par_write_ref(from, p, tid);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
302 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
303 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
304
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
305 template <class T> void G1ParScanThreadState::update_rs(HeapRegion* from, T* p, int tid) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
306 if (G1DeferredRSUpdate) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
307 deferred_rs_update(from, p, tid);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
308 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
309 immediate_rs_update(from, p, tid);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
310 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
311 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
312
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
313
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
314 inline void G1ParScanThreadState::do_oop_partial_array(oop* p) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
315 assert(has_partial_array_mask(p), "invariant");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
316 oop from_obj = clear_partial_array_mask(p);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
317
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
318 assert(Universe::heap()->is_in_reserved(from_obj), "must be in heap.");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
319 assert(from_obj->is_objArray(), "must be obj array");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
320 objArrayOop from_obj_array = objArrayOop(from_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
321 // The from-space object contains the real length.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
322 int length = from_obj_array->length();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
323
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
324 assert(from_obj->is_forwarded(), "must be forwarded");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
325 oop to_obj = from_obj->forwardee();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
326 assert(from_obj != to_obj, "should not be chunking self-forwarded objects");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
327 objArrayOop to_obj_array = objArrayOop(to_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
328 // We keep track of the next start index in the length field of the
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
329 // to-space object.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
330 int next_index = to_obj_array->length();
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
331 assert(0 <= next_index && next_index < length,
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
332 err_msg("invariant, next index: %d, length: %d", next_index, length));
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
333
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
334 int start = next_index;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
335 int end = length;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
336 int remainder = end - start;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
337 // We'll try not to push a range that's smaller than ParGCArrayScanChunk.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
338 if (remainder > 2 * ParGCArrayScanChunk) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
339 end = start + ParGCArrayScanChunk;
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
340 to_obj_array->set_length(end);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
341 // Push the remainder before we process the range in case another
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
342 // worker has run out of things to do and can steal it.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
343 oop* from_obj_p = set_partial_array_mask(from_obj);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
344 push_on_queue(from_obj_p);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
345 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
346 assert(length == end, "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
347 // We'll process the final range for this object. Restore the length
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
348 // so that the heap remains parsable in case of evacuation failure.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
349 to_obj_array->set_length(end);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
350 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
351 _scanner.set_region(_g1h->heap_region_containing_raw(to_obj));
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
352 // Process indexes [start,end). It will also process the header
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
353 // along with the first chunk (i.e., the chunk with start == 0).
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
354 // Note that at this point the length field of to_obj_array is not
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
355 // correct given that we are using it to keep track of the next
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
356 // start index. oop_iterate_range() (thankfully!) ignores the length
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
357 // field and only relies on the start / end parameters. It does
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
358 // however return the size of the object which will be incorrect. So
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
359 // we have to ignore it even if we wanted to use it.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
360 to_obj_array->oop_iterate_range(&_scanner, start, end);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
361 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
362
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
363 template <class T> inline void G1ParScanThreadState::deal_with_reference(T* ref_to_scan) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
364 if (!has_partial_array_mask(ref_to_scan)) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
365 // Note: we can use "raw" versions of "region_containing" because
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
366 // "obj_to_scan" is definitely in the heap, and is not in a
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
367 // humongous region.
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
368 HeapRegion* r = _g1h->heap_region_containing_raw(ref_to_scan);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
369 do_oop_evac(ref_to_scan, r);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
370 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
371 do_oop_partial_array((oop*)ref_to_scan);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
372 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
373 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
374
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
375 inline void G1ParScanThreadState::deal_with_reference(StarTask ref) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
376 assert(verify_task(ref), "sanity");
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
377 if (ref.is_narrow()) {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
378 deal_with_reference((narrowOop*)ref);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
379 } else {
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
380 deal_with_reference((oop*)ref);
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
381 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
382 }
bfdf528be8e8 8038498: Fix includes and C inlining after 8035330
tschatzl
parents: 17736
diff changeset
383
1972
f95d63e2154a 6989984: Use standard include model for Hospot
stefank
parents: 1718
diff changeset
384 #endif // SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP