truffle: src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp annotate

annotate src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp @ 2152:0fa27f37d4d4

6977804: G1: remove the zero-filling thread Summary: This changeset removes the zero-filling thread from G1 and collapses the two free region lists we had before (the "free" and "unclean" lists) into one. The new free list uses the new heap region sets / lists abstractions that we'll ultimately use it to keep track of all regions in the heap. A heap region set was also introduced for the humongous regions. Finally, this change increases the concurrency between the thread that completes freeing regions (after a cleanup pause) and the rest of the system (before we'd have to wait for said thread to complete before allocating a new region). The changest also includes a lot of refactoring and code simplification. Reviewed-by: jcoomes, johnc

author	tonyp
date	Wed, 19 Jan 2011 19:30:42 -0500
parents	7e37af9d69ef
children	abdfc822206f

rev	line source
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1 /*
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	2 * Copyright (c) 2001, 2011, Oracle and/or its affiliates. All rights reserved.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	4 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	7 * published by the Free Software Foundation.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	8 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	13 * accompanied this code).
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	14 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	18 *
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 752 diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 752 diff changeset	20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 752 diff changeset	21 * questions.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	22 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	23 */
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	24
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	25 #ifndef SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	26 #define SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	27
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	28 #include "gc_implementation/g1/concurrentMark.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	29 #include "gc_implementation/g1/g1CollectedHeap.hpp"
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	30 #include "gc_implementation/g1/g1CollectorPolicy.hpp"
2149 7e37af9d69ef 7011379: G1: overly long concurrent marking cycles tonyp parents: 2134 diff changeset	31 #include "gc_implementation/g1/heapRegionSeq.inline.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	32 #include "utilities/taskqueue.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	33
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	34 // Inline functions for G1CollectedHeap
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	35
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	36 inline HeapRegion*
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	37 G1CollectedHeap::heap_region_containing(const void* addr) const {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	38 HeapRegion* hr = _hrs->addr_to_region(addr);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	39 // hr can be null if addr in perm_gen
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	40 if (hr != NULL && hr->continuesHumongous()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	41 hr = hr->humongous_start_region();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	42 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	43 return hr;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	44 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	45
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	46 inline HeapRegion*
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	47 G1CollectedHeap::heap_region_containing_raw(const void* addr) const {
526 818efdefcc99 6484956: G1: improve evacuation pause efficiency tonyp parents: 342 diff changeset	48 assert(_g1_reserved.contains(addr), "invariant");
752 a2957df801a1 6833576: G1: assert illegal index, growableArray.hpp:186 johnc parents: 579 diff changeset	49 size_t index = pointer_delta(addr, _g1_reserved.start(), 1)
a2957df801a1 6833576: G1: assert illegal index, growableArray.hpp:186 johnc parents: 579 diff changeset	50 >> HeapRegion::LogOfHRGrainBytes;
a2957df801a1 6833576: G1: assert illegal index, growableArray.hpp:186 johnc parents: 579 diff changeset	51
526 818efdefcc99 6484956: G1: improve evacuation pause efficiency tonyp parents: 342 diff changeset	52 HeapRegion* res = _hrs->at(index);
818efdefcc99 6484956: G1: improve evacuation pause efficiency tonyp parents: 342 diff changeset	53 assert(res == _hrs->addr_to_region(addr), "sanity");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	54 return res;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	55 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	56
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	57 inline bool G1CollectedHeap::obj_in_cs(oop obj) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	58 HeapRegion* r = _hrs->addr_to_region(obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	59 return r != NULL && r->in_collection_set();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	60 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	61
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	62 // See the comment in the .hpp file about the locking protocol and
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	63 // assumptions of this method (and other related ones).
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	64 inline HeapWord*
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	65 G1CollectedHeap::allocate_from_cur_alloc_region(HeapRegion* cur_alloc_region,
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	66 size_t word_size,
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	67 bool with_heap_lock) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	68 assert_not_at_safepoint();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	69 assert(with_heap_lock == Heap_lock->owned_by_self(),
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	70 "with_heap_lock and Heap_lock->owned_by_self() should be a tautology");
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	71 assert(cur_alloc_region != NULL, "pre-condition of the method");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	72 assert(cur_alloc_region->is_young(),
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	73 "we only support young current alloc regions");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	74 assert(!isHumongous(word_size), "allocate_from_cur_alloc_region() "
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	75 "should not be used for humongous allocations");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	76 assert(!cur_alloc_region->isHumongous(), "Catch a regression of this bug.");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	77
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	78 assert(!cur_alloc_region->is_empty(),
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	79 err_msg("region ["PTR_FORMAT","PTR_FORMAT"] should not be empty",
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	80 cur_alloc_region->bottom(), cur_alloc_region->end()));
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	81 HeapWord* result = cur_alloc_region->par_allocate_no_bot_updates(word_size);
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	82 if (result != NULL) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	83 assert(is_in(result), "result should be in the heap");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	84
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	85 if (with_heap_lock) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	86 Heap_lock->unlock();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	87 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	88 assert_heap_not_locked();
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	89 // Do the dirtying after we release the Heap_lock.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	90 dirty_young_block(result, word_size);
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	91 return result;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	92 }
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	93
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	94 if (with_heap_lock) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	95 assert_heap_locked();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	96 } else {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	97 assert_heap_not_locked();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	98 }
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	99 return NULL;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	100 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	101
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	102 // See the comment in the .hpp file about the locking protocol and
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	103 // assumptions of this method (and other related ones).
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	104 inline HeapWord*
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	105 G1CollectedHeap::attempt_allocation(size_t word_size) {
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	106 assert_heap_not_locked_and_not_at_safepoint();
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	107 assert(!isHumongous(word_size), "attempt_allocation() should not be called "
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	108 "for humongous allocation requests");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	109
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	110 HeapRegion* cur_alloc_region = _cur_alloc_region;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	111 if (cur_alloc_region != NULL) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	112 HeapWord* result = allocate_from_cur_alloc_region(cur_alloc_region,
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	113 word_size,
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	114 false /* with_heap_lock */);
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	115 assert_heap_not_locked();
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	116 if (result != NULL) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	117 return result;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	118 }
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	119 }
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	120
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	121 // Our attempt to allocate lock-free failed as the current
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	122 // allocation region is either NULL or full. So, we'll now take the
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	123 // Heap_lock and retry.
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	124 Heap_lock->lock();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	125
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	126 HeapWord* result = attempt_allocation_locked(word_size);
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	127 if (result != NULL) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	128 assert_heap_not_locked();
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	129 return result;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	130 }
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	131
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	132 assert_heap_locked();
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	133 return NULL;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	134 }
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	135
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	136 inline void
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	137 G1CollectedHeap::retire_cur_alloc_region_common(HeapRegion* cur_alloc_region) {
2152 0fa27f37d4d4 6977804: G1: remove the zero-filling thread tonyp parents: 2149 diff changeset	138 assert_heap_locked_or_at_safepoint(true /* should_be_vm_thread */);
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	139 assert(cur_alloc_region != NULL && cur_alloc_region == _cur_alloc_region,
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	140 "pre-condition of the call");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	141 assert(cur_alloc_region->is_young(),
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	142 "we only support young current alloc regions");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	143
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	144 // The region is guaranteed to be young
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	145 g1_policy()->add_region_to_incremental_cset_lhs(cur_alloc_region);
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	146 _summary_bytes_used += cur_alloc_region->used();
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	147 _cur_alloc_region = NULL;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	148 }
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	149
2134 b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	150 inline HeapWord*
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	151 G1CollectedHeap::attempt_allocation_locked(size_t word_size) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	152 assert_heap_locked_and_not_at_safepoint();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	153 assert(!isHumongous(word_size), "attempt_allocation_locked() "
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	154 "should not be called for humongous allocation requests");
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	155
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	156 // First, reread the current alloc region and retry the allocation
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	157 // in case somebody replaced it while we were waiting to get the
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	158 // Heap_lock.
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	159 HeapRegion* cur_alloc_region = _cur_alloc_region;
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	160 if (cur_alloc_region != NULL) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	161 HeapWord* result = allocate_from_cur_alloc_region(
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	162 cur_alloc_region, word_size,
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	163 true /* with_heap_lock */);
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	164 if (result != NULL) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	165 assert_heap_not_locked();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	166 return result;
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	167 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	168
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	169 // We failed to allocate out of the current alloc region, so let's
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	170 // retire it before getting a new one.
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	171 retire_cur_alloc_region(cur_alloc_region);
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	172 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	173
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	174 assert_heap_locked();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	175 // Try to get a new region and allocate out of it
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	176 HeapWord* result = replace_cur_alloc_region_and_allocate(word_size,
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	177 false, /* at_safepoint */
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	178 true, /* do_dirtying */
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	179 false /* can_expand */);
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	180 if (result != NULL) {
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	181 assert_heap_not_locked();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	182 return result;
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	183 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	184
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	185 assert_heap_locked();
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	186 return NULL;
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	187 }
b158bed62ef5 6994297: G1: do first-level slow-path allocations with a CAS tonyp parents: 1991 diff changeset	188
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	189 // It dirties the cards that cover the block so that so that the post
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	190 // write barrier never queues anything when updating objects on this
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	191 // block. It is assumed (and in fact we assert) that the block
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	192 // belongs to a young region.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	193 inline void
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	194 G1CollectedHeap::dirty_young_block(HeapWord* start, size_t word_size) {
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	195 assert_heap_not_locked();
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	196
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	197 // Assign the containing region to containing_hr so that we don't
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	198 // have to keep calling heap_region_containing_raw() in the
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	199 // asserts below.
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	200 DEBUG_ONLY(HeapRegion* containing_hr = heap_region_containing_raw(start);)
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	201 assert(containing_hr != NULL && start != NULL && word_size > 0,
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	202 "pre-condition");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	203 assert(containing_hr->is_in(start), "it should contain start");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	204 assert(containing_hr->is_young(), "it should be young");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	205 assert(!containing_hr->isHumongous(), "it should not be humongous");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	206
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	207 HeapWord* end = start + word_size;
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	208 assert(containing_hr->is_in(end - 1), "it should also contain end - 1");
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	209
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	210 MemRegion mr(start, end);
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	211 ((CardTableModRefBS*)_g1h->barrier_set())->dirty(mr);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	212 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	213
1709 5f429ee79634 6966222: G1: simplify TaskQueue overflow handling jcoomes parents: 1552 diff changeset	214 inline RefToScanQueue* G1CollectedHeap::task_queue(int i) const {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	215 return _task_queues->queue(i);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	216 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	217
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	218 inline bool G1CollectedHeap::isMarkedPrev(oop obj) const {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	219 return _cm->prevMarkBitMap()->isMarked((HeapWord *)obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	220 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	221
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	222 inline bool G1CollectedHeap::isMarkedNext(oop obj) const {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	223 return _cm->nextMarkBitMap()->isMarked((HeapWord *)obj);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	224 }
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	225
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1718 diff changeset	226 #endif // SHARE_VM_GC_IMPLEMENTATION_G1_G1COLLECTEDHEAP_INLINE_HPP

Mercurial > hg > truffle

annotate src/share/vm/gc_implementation/g1/g1CollectedHeap.inline.hpp @ 2152:0fa27f37d4d4