graal-compiler: src/share/vm/gc_implementation/shared/mutableSpace.cpp annotate

annotate src/share/vm/gc_implementation/shared/mutableSpace.cpp @ 1842:6e0aac35bfa9

6980838: G1: guarantee(false) failed: thread has an unexpected active value in its SATB queue Summary: Under certain circumstances a safepoint could happen between a JavaThread object being created and that object being added to the Java threads list. This could cause the active field of that thread's SATB queue to get out-of-sync with respect to the other Java threads. The solution is to activate the SATB queue, when necessary, before adding the thread to the Java threads list, not when the JavaThread object is created. The changeset also includes a small fix to rename the surrogate locker thread from "Surrogate Locker Thread (CMS)" to "Surrogate Locker Thread (Concurrent GC)" since it's also used in G1. Reviewed-by: iveresov, ysr, johnc, jcoomes

author	tonyp
date	Fri, 01 Oct 2010 16:43:05 -0400
parents	c18cbe5936b8
children	f95d63e2154a

rev	line source
0 a61af66fc99e Initial load duke parents: diff changeset	1 /*
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 579 diff changeset	2 * Copyright (c) 2001, 2009, Oracle and/or its affiliates. All rights reserved.
0 a61af66fc99e Initial load duke parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
a61af66fc99e Initial load duke parents: diff changeset	4 *
a61af66fc99e Initial load duke parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
a61af66fc99e Initial load duke parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
a61af66fc99e Initial load duke parents: diff changeset	7 * published by the Free Software Foundation.
a61af66fc99e Initial load duke parents: diff changeset	8 *
a61af66fc99e Initial load duke parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
a61af66fc99e Initial load duke parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
a61af66fc99e Initial load duke parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
a61af66fc99e Initial load duke parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
a61af66fc99e Initial load duke parents: diff changeset	13 * accompanied this code).
a61af66fc99e Initial load duke parents: diff changeset	14 *
a61af66fc99e Initial load duke parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
a61af66fc99e Initial load duke parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
a61af66fc99e Initial load duke parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
a61af66fc99e Initial load duke parents: diff changeset	18 *
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 579 diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 579 diff changeset	20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 579 diff changeset	21 * questions.
0 a61af66fc99e Initial load duke parents: diff changeset	22 *
a61af66fc99e Initial load duke parents: diff changeset	23 */
a61af66fc99e Initial load duke parents: diff changeset	24
a61af66fc99e Initial load duke parents: diff changeset	25 # include "incls/_precompiled.incl"
a61af66fc99e Initial load duke parents: diff changeset	26 # include "incls/_mutableSpace.cpp.incl"
a61af66fc99e Initial load duke parents: diff changeset	27
535 4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	28 MutableSpace::MutableSpace(size_t alignment): ImmutableSpace(), _top(NULL), _alignment(alignment) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	29 assert(MutableSpace::alignment() >= 0 &&
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	30 MutableSpace::alignment() % os::vm_page_size() == 0,
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	31 "Space should be aligned");
263 12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	32 _mangler = new MutableSpaceMangler(this);
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	33 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	34
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	35 MutableSpace::~MutableSpace() {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	36 delete _mangler;
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	37 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	38
535 4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	39 void MutableSpace::numa_setup_pages(MemRegion mr, bool clear_space) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	40 if (!mr.is_empty()) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	41 size_t page_size = UseLargePages ? alignment() : os::vm_page_size();
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	42 HeapWord start = (HeapWord)round_to((intptr_t) mr.start(), page_size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	43 HeapWord end = (HeapWord)round_down((intptr_t) mr.end(), page_size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	44 if (end > start) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	45 size_t size = pointer_delta(end, start, sizeof(char));
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	46 if (clear_space) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	47 // Prefer page reallocation to migration.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	48 os::free_memory((char*)start, size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	49 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	50 os::numa_make_global((char*)start, size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	51 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	52 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	53 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	54
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	55 void MutableSpace::pretouch_pages(MemRegion mr) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	56 for (volatile char p = (char)mr.start(); p < (char*)mr.end(); p += os::vm_page_size()) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	57 char t = p; p = t;
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	58 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	59 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	60
263 12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	61 void MutableSpace::initialize(MemRegion mr,
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	62 bool clear_space,
535 4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	63 bool mangle_space,
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	64 bool setup_pages) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	65
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	66 assert(Universe::on_page_boundary(mr.start()) && Universe::on_page_boundary(mr.end()),
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	67 "invalid space boundaries");
0 a61af66fc99e Initial load duke parents: diff changeset	68
535 4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	69 if (setup_pages && (UseNUMA \|\| AlwaysPreTouch)) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	70 // The space may move left and right or expand/shrink.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	71 // We'd like to enforce the desired page placement.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	72 MemRegion head, tail;
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	73 if (last_setup_region().is_empty()) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	74 // If it's the first initialization don't limit the amount of work.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	75 head = mr;
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	76 tail = MemRegion(mr.end(), mr.end());
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	77 } else {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	78 // Is there an intersection with the address space?
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	79 MemRegion intersection = last_setup_region().intersection(mr);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	80 if (intersection.is_empty()) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	81 intersection = MemRegion(mr.end(), mr.end());
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	82 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	83 // All the sizes below are in words.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	84 size_t head_size = 0, tail_size = 0;
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	85 if (mr.start() <= intersection.start()) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	86 head_size = pointer_delta(intersection.start(), mr.start());
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	87 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	88 if(intersection.end() <= mr.end()) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	89 tail_size = pointer_delta(mr.end(), intersection.end());
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	90 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	91 // Limit the amount of page manipulation if necessary.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	92 if (NUMASpaceResizeRate > 0 && !AlwaysPreTouch) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	93 const size_t change_size = head_size + tail_size;
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	94 const float setup_rate_words = NUMASpaceResizeRate >> LogBytesPerWord;
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	95 head_size = MIN2((size_t)(setup_rate_words * head_size / change_size),
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	96 head_size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	97 tail_size = MIN2((size_t)(setup_rate_words * tail_size / change_size),
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	98 tail_size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	99 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	100 head = MemRegion(intersection.start() - head_size, intersection.start());
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	101 tail = MemRegion(intersection.end(), intersection.end() + tail_size);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	102 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	103 assert(mr.contains(head) && mr.contains(tail), "Sanity");
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	104
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	105 if (UseNUMA) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	106 numa_setup_pages(head, clear_space);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	107 numa_setup_pages(tail, clear_space);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	108 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	109
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	110 if (AlwaysPreTouch) {
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	111 pretouch_pages(head);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	112 pretouch_pages(tail);
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	113 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	114
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	115 // Remember where we stopped so that we can continue later.
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	116 set_last_setup_region(MemRegion(head.start(), tail.end()));
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	117 }
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	118
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	119 set_bottom(mr.start());
4e400c36026f 6783381: NUMA allocator: don't pretouch eden space with UseNUMA iveresov parents: 269 diff changeset	120 set_end(mr.end());
0 a61af66fc99e Initial load duke parents: diff changeset	121
263 12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	122 if (clear_space) {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	123 clear(mangle_space);
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	124 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	125 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	126
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	127 void MutableSpace::clear(bool mangle_space) {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	128 set_top(bottom());
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	129 if (ZapUnusedHeapArea && mangle_space) {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	130 mangle_unused_area();
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	131 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	132 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	133
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	134 #ifndef PRODUCT
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	135 void MutableSpace::check_mangled_unused_area(HeapWord* limit) {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	136 mangler()->check_mangled_unused_area(limit);
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	137 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	138
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	139 void MutableSpace::check_mangled_unused_area_complete() {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	140 mangler()->check_mangled_unused_area_complete();
0 a61af66fc99e Initial load duke parents: diff changeset	141 }
a61af66fc99e Initial load duke parents: diff changeset	142
263 12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	143 // Mangle only the unused space that has not previously
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	144 // been mangled and that has not been allocated since being
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	145 // mangled.
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	146 void MutableSpace::mangle_unused_area() {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	147 mangler()->mangle_unused_area();
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	148 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	149
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	150 void MutableSpace::mangle_unused_area_complete() {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	151 mangler()->mangle_unused_area_complete();
0 a61af66fc99e Initial load duke parents: diff changeset	152 }
a61af66fc99e Initial load duke parents: diff changeset	153
263 12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	154 void MutableSpace::mangle_region(MemRegion mr) {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	155 SpaceMangler::mangle_region(mr);
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	156 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	157
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	158 void MutableSpace::set_top_for_allocations(HeapWord* v) {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	159 mangler()->set_top_for_allocations(v);
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	160 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	161
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	162 void MutableSpace::set_top_for_allocations() {
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	163 mangler()->set_top_for_allocations(top());
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	164 }
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	165 #endif
12eea04c8b06 6672698: mangle_unused_area() should not remangle the entire heap at each collection. jmasa parents: 190 diff changeset	166
0 a61af66fc99e Initial load duke parents: diff changeset	167 // This version requires locking. */
a61af66fc99e Initial load duke parents: diff changeset	168 HeapWord* MutableSpace::allocate(size_t size) {
a61af66fc99e Initial load duke parents: diff changeset	169 assert(Heap_lock->owned_by_self() \|\|
a61af66fc99e Initial load duke parents: diff changeset	170 (SafepointSynchronize::is_at_safepoint() &&
a61af66fc99e Initial load duke parents: diff changeset	171 Thread::current()->is_VM_thread()),
a61af66fc99e Initial load duke parents: diff changeset	172 "not locked");
a61af66fc99e Initial load duke parents: diff changeset	173 HeapWord* obj = top();
a61af66fc99e Initial load duke parents: diff changeset	174 if (pointer_delta(end(), obj) >= size) {
a61af66fc99e Initial load duke parents: diff changeset	175 HeapWord* new_top = obj + size;
a61af66fc99e Initial load duke parents: diff changeset	176 set_top(new_top);
a61af66fc99e Initial load duke parents: diff changeset	177 assert(is_object_aligned((intptr_t)obj) && is_object_aligned((intptr_t)new_top),
a61af66fc99e Initial load duke parents: diff changeset	178 "checking alignment");
a61af66fc99e Initial load duke parents: diff changeset	179 return obj;
a61af66fc99e Initial load duke parents: diff changeset	180 } else {
a61af66fc99e Initial load duke parents: diff changeset	181 return NULL;
a61af66fc99e Initial load duke parents: diff changeset	182 }
a61af66fc99e Initial load duke parents: diff changeset	183 }
a61af66fc99e Initial load duke parents: diff changeset	184
a61af66fc99e Initial load duke parents: diff changeset	185 // This version is lock-free.
a61af66fc99e Initial load duke parents: diff changeset	186 HeapWord* MutableSpace::cas_allocate(size_t size) {
a61af66fc99e Initial load duke parents: diff changeset	187 do {
a61af66fc99e Initial load duke parents: diff changeset	188 HeapWord* obj = top();
a61af66fc99e Initial load duke parents: diff changeset	189 if (pointer_delta(end(), obj) >= size) {
a61af66fc99e Initial load duke parents: diff changeset	190 HeapWord* new_top = obj + size;
a61af66fc99e Initial load duke parents: diff changeset	191 HeapWord* result = (HeapWord*)Atomic::cmpxchg_ptr(new_top, top_addr(), obj);
a61af66fc99e Initial load duke parents: diff changeset	192 // result can be one of two:
a61af66fc99e Initial load duke parents: diff changeset	193 // the old top value: the exchange succeeded
a61af66fc99e Initial load duke parents: diff changeset	194 // otherwise: the new value of the top is returned.
a61af66fc99e Initial load duke parents: diff changeset	195 if (result != obj) {
a61af66fc99e Initial load duke parents: diff changeset	196 continue; // another thread beat us to the allocation, try again
a61af66fc99e Initial load duke parents: diff changeset	197 }
a61af66fc99e Initial load duke parents: diff changeset	198 assert(is_object_aligned((intptr_t)obj) && is_object_aligned((intptr_t)new_top),
a61af66fc99e Initial load duke parents: diff changeset	199 "checking alignment");
a61af66fc99e Initial load duke parents: diff changeset	200 return obj;
a61af66fc99e Initial load duke parents: diff changeset	201 } else {
a61af66fc99e Initial load duke parents: diff changeset	202 return NULL;
a61af66fc99e Initial load duke parents: diff changeset	203 }
a61af66fc99e Initial load duke parents: diff changeset	204 } while (true);
a61af66fc99e Initial load duke parents: diff changeset	205 }
a61af66fc99e Initial load duke parents: diff changeset	206
a61af66fc99e Initial load duke parents: diff changeset	207 // Try to deallocate previous allocation. Returns true upon success.
a61af66fc99e Initial load duke parents: diff changeset	208 bool MutableSpace::cas_deallocate(HeapWord *obj, size_t size) {
a61af66fc99e Initial load duke parents: diff changeset	209 HeapWord* expected_top = obj + size;
a61af66fc99e Initial load duke parents: diff changeset	210 return (HeapWord*)Atomic::cmpxchg_ptr(obj, top_addr(), expected_top) == expected_top;
a61af66fc99e Initial load duke parents: diff changeset	211 }
a61af66fc99e Initial load duke parents: diff changeset	212
a61af66fc99e Initial load duke parents: diff changeset	213 void MutableSpace::oop_iterate(OopClosure* cl) {
a61af66fc99e Initial load duke parents: diff changeset	214 HeapWord* obj_addr = bottom();
a61af66fc99e Initial load duke parents: diff changeset	215 HeapWord* t = top();
a61af66fc99e Initial load duke parents: diff changeset	216 // Could call objects iterate, but this is easier.
a61af66fc99e Initial load duke parents: diff changeset	217 while (obj_addr < t) {
a61af66fc99e Initial load duke parents: diff changeset	218 obj_addr += oop(obj_addr)->oop_iterate(cl);
a61af66fc99e Initial load duke parents: diff changeset	219 }
a61af66fc99e Initial load duke parents: diff changeset	220 }
a61af66fc99e Initial load duke parents: diff changeset	221
a61af66fc99e Initial load duke parents: diff changeset	222 void MutableSpace::object_iterate(ObjectClosure* cl) {
a61af66fc99e Initial load duke parents: diff changeset	223 HeapWord* p = bottom();
a61af66fc99e Initial load duke parents: diff changeset	224 while (p < top()) {
a61af66fc99e Initial load duke parents: diff changeset	225 cl->do_object(oop(p));
a61af66fc99e Initial load duke parents: diff changeset	226 p += oop(p)->size();
a61af66fc99e Initial load duke parents: diff changeset	227 }
a61af66fc99e Initial load duke parents: diff changeset	228 }
a61af66fc99e Initial load duke parents: diff changeset	229
a61af66fc99e Initial load duke parents: diff changeset	230 void MutableSpace::print_short() const { print_short_on(tty); }
a61af66fc99e Initial load duke parents: diff changeset	231 void MutableSpace::print_short_on( outputStream* st) const {
a61af66fc99e Initial load duke parents: diff changeset	232 st->print(" space " SIZE_FORMAT "K, %d%% used", capacity_in_bytes() / K,
a61af66fc99e Initial load duke parents: diff changeset	233 (int) ((double) used_in_bytes() * 100 / capacity_in_bytes()));
a61af66fc99e Initial load duke parents: diff changeset	234 }
a61af66fc99e Initial load duke parents: diff changeset	235
a61af66fc99e Initial load duke parents: diff changeset	236 void MutableSpace::print() const { print_on(tty); }
a61af66fc99e Initial load duke parents: diff changeset	237 void MutableSpace::print_on(outputStream* st) const {
a61af66fc99e Initial load duke parents: diff changeset	238 MutableSpace::print_short_on(st);
a61af66fc99e Initial load duke parents: diff changeset	239 st->print_cr(" [" INTPTR_FORMAT "," INTPTR_FORMAT "," INTPTR_FORMAT ")",
a61af66fc99e Initial load duke parents: diff changeset	240 bottom(), top(), end());
a61af66fc99e Initial load duke parents: diff changeset	241 }
a61af66fc99e Initial load duke parents: diff changeset	242
190 d1635bf93939 6711930: NUMA allocator: ParOld can create a hole less than minimal object size in the lgrp chunk iveresov parents: 0 diff changeset	243 void MutableSpace::verify(bool allow_dirty) {
0 a61af66fc99e Initial load duke parents: diff changeset	244 HeapWord* p = bottom();
a61af66fc99e Initial load duke parents: diff changeset	245 HeapWord* t = top();
a61af66fc99e Initial load duke parents: diff changeset	246 HeapWord* prev_p = NULL;
a61af66fc99e Initial load duke parents: diff changeset	247 while (p < t) {
a61af66fc99e Initial load duke parents: diff changeset	248 oop(p)->verify();
a61af66fc99e Initial load duke parents: diff changeset	249 prev_p = p;
a61af66fc99e Initial load duke parents: diff changeset	250 p += oop(p)->size();
a61af66fc99e Initial load duke parents: diff changeset	251 }
a61af66fc99e Initial load duke parents: diff changeset	252 guarantee(p == top(), "end of last object must match end of space");
a61af66fc99e Initial load duke parents: diff changeset	253 }

Mercurial > hg > graal-compiler

annotate src/share/vm/gc_implementation/shared/mutableSpace.cpp @ 1842:6e0aac35bfa9