graal-jvmci-8: src/share/vm/memory/metaspace.cpp annotate

annotate src/share/vm/memory/metaspace.cpp @ 12231:24e87613ee58

8009561: NPG: Metaspace fragmentation when retiring a Metachunk Summary: Use best-fit block-splitting freelist allocation from the block freelist. Reviewed-by: jmasa, stefank

author	mgerdin
date	Wed, 11 Sep 2013 09:37:14 +0200
parents	7944aba7ba41
children	d6c266999345

rev	line source
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1 /*
8712 3efdfd6ddbf2 8003553: NPG: metaspace objects should be zeroed in constructors coleenp parents: 8040 diff changeset	2 * Copyright (c) 2011, 2013, Oracle and/or its affiliates. All rights reserved.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	4 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	7 * published by the Free Software Foundation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	8 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	13 * accompanied this code).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	14 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	18 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	21 * questions.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	22 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	23 */
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	24 #include "precompiled.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	25 #include "gc_interface/collectedHeap.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	26 #include "memory/binaryTreeDictionary.hpp"
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	27 #include "memory/freeList.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	28 #include "memory/collectorPolicy.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	29 #include "memory/filemap.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	30 #include "memory/freeList.hpp"
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	31 #include "memory/metablock.hpp"
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	32 #include "memory/metachunk.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	33 #include "memory/metaspace.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	34 #include "memory/metaspaceShared.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	35 #include "memory/resourceArea.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	36 #include "memory/universe.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	37 #include "runtime/globals.hpp"
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	38 #include "runtime/java.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	39 #include "runtime/mutex.hpp"
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	40 #include "runtime/orderAccess.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	41 #include "services/memTracker.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	42 #include "utilities/copy.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	43 #include "utilities/debug.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	44
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	45 typedef BinaryTreeDictionary<Metablock, FreeList> BlockTreeDictionary;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	46 typedef BinaryTreeDictionary<Metachunk, FreeList> ChunkTreeDictionary;
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	47 // Define this macro to enable slow integrity checking of
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	48 // the free chunk lists
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	49 const bool metaspace_slow_verify = false;
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	50
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	51 // Parameters for stress mode testing
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	52 const uint metadata_deallocate_a_lot_block = 10;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	53 const uint metadata_deallocate_a_lock_chunk = 3;
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	54 size_t const allocation_from_dictionary_limit = 4 * K;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	55
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	56 MetaWord* last_allocated = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	57
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	58 size_t Metaspace::_class_metaspace_size;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	59
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	60 // Used in declarations in SpaceManager and ChunkManager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	61 enum ChunkIndex {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	62 ZeroIndex = 0,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	63 SpecializedIndex = ZeroIndex,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	64 SmallIndex = SpecializedIndex + 1,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	65 MediumIndex = SmallIndex + 1,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	66 HumongousIndex = MediumIndex + 1,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	67 NumberOfFreeLists = 3,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	68 NumberOfInUseLists = 4
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	69 };
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	70
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	71 enum ChunkSizes { // in words.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	72 ClassSpecializedChunk = 128,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	73 SpecializedChunk = 128,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	74 ClassSmallChunk = 256,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	75 SmallChunk = 512,
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	76 ClassMediumChunk = 4 * K,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	77 MediumChunk = 8 * K,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	78 HumongousChunkGranularity = 8
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	79 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	80
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	81 static ChunkIndex next_chunk_index(ChunkIndex i) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	82 assert(i < NumberOfInUseLists, "Out of bound");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	83 return (ChunkIndex) (i+1);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	84 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	85
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	86 // Originally _capacity_until_GC was set to MetaspaceSize here but
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	87 // the default MetaspaceSize before argument processing was being
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	88 // used which was not the desired value. See the code
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	89 // in should_expand() to see how the initialization is handled
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	90 // now.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	91 size_t MetaspaceGC::_capacity_until_GC = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	92 bool MetaspaceGC::_expand_after_GC = false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	93 uint MetaspaceGC::_shrink_factor = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	94 bool MetaspaceGC::_should_concurrent_collect = false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	95
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	96 // Blocks of space for metadata are allocated out of Metachunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	97 //
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	98 // Metachunk are allocated out of MetadataVirtualspaces and once
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	99 // allocated there is no explicit link between a Metachunk and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	100 // the MetadataVirtualspaces from which it was allocated.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	101 //
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	102 // Each SpaceManager maintains a
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	103 // list of the chunks it is using and the current chunk. The current
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	104 // chunk is the chunk from which allocations are done. Space freed in
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	105 // a chunk is placed on the free list of blocks (BlockFreelist) and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	106 // reused from there.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	107
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	108 typedef class FreeList<Metachunk> ChunkList;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	109
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	110 // Manages the global free lists of chunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	111 // Has three lists of free chunks, and a total size and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	112 // count that includes all three
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	113
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	114 class ChunkManager VALUE_OBJ_CLASS_SPEC {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	115
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	116 // Free list of chunks of different sizes.
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	117 // SpecializedChunk
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	118 // SmallChunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	119 // MediumChunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	120 // HumongousChunk
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	121 ChunkList _free_chunks[NumberOfFreeLists];
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	122
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	123
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	124 // HumongousChunk
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	125 ChunkTreeDictionary _humongous_dictionary;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	126
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	127 // ChunkManager in all lists of this type
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	128 size_t _free_chunks_total;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	129 size_t _free_chunks_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	130
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	131 void dec_free_chunks_total(size_t v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	132 assert(_free_chunks_count > 0 &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	133 _free_chunks_total > 0,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	134 "About to go negative");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	135 Atomic::add_ptr(-1, &_free_chunks_count);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	136 jlong minus_v = (jlong) - (jlong) v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	137 Atomic::add_ptr(minus_v, &_free_chunks_total);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	138 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	139
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	140 // Debug support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	141
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	142 size_t sum_free_chunks();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	143 size_t sum_free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	144
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	145 void locked_verify_free_chunks_total();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	146 void slow_locked_verify_free_chunks_total() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	147 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	148 locked_verify_free_chunks_total();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	149 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	150 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	151 void locked_verify_free_chunks_count();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	152 void slow_locked_verify_free_chunks_count() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	153 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	154 locked_verify_free_chunks_count();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	155 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	156 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	157 void verify_free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	158
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	159 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	160
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	161 ChunkManager() : _free_chunks_total(0), _free_chunks_count(0) {}
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	162
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	163 // add or delete (return) a chunk to the global freelist.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	164 Metachunk* chunk_freelist_allocate(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	165 void chunk_freelist_deallocate(Metachunk* chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	166
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	167 // Map a size to a list index assuming that there are lists
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	168 // for special, small, medium, and humongous chunks.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	169 static ChunkIndex list_index(size_t size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	170
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	171 // Remove the chunk from its freelist. It is
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	172 // expected to be on one of the _free_chunks[] lists.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	173 void remove_chunk(Metachunk* chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	174
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	175 // Add the simple linked list of chunks to the freelist of chunks
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	176 // of type index.
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	177 void return_chunks(ChunkIndex index, Metachunk* chunks);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	178
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	179 // Total of the space in the free chunks list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	180 size_t free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	181 size_t free_chunks_total_in_bytes();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	182
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	183 // Number of chunks in the free chunks list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	184 size_t free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	185
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	186 void inc_free_chunks_total(size_t v, size_t count = 1) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	187 Atomic::add_ptr(count, &_free_chunks_count);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	188 Atomic::add_ptr(v, &_free_chunks_total);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	189 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	190 ChunkTreeDictionary* humongous_dictionary() {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	191 return &_humongous_dictionary;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	192 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	193
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	194 ChunkList* free_chunks(ChunkIndex index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	195
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	196 // Returns the list for the given chunk word size.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	197 ChunkList* find_free_chunks_list(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	198
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	199 // Add and remove from a list by size. Selects
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	200 // list based on size of chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	201 void free_chunks_put(Metachunk* chuck);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	202 Metachunk* free_chunks_get(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	203
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	204 // Debug support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	205 void verify();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	206 void slow_verify() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	207 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	208 verify();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	209 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	210 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	211 void locked_verify();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	212 void slow_locked_verify() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	213 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	214 locked_verify();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	215 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	216 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	217 void verify_free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	218
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	219 void locked_print_free_chunks(outputStream* st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	220 void locked_print_sum_free_chunks(outputStream* st);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	221
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	222 void print_on(outputStream* st);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	223 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	224
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	225 // Used to manage the free list of Metablocks (a block corresponds
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	226 // to the allocation of a quantum of metadata).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	227 class BlockFreelist VALUE_OBJ_CLASS_SPEC {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	228 BlockTreeDictionary* _dictionary;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	229 static Metablock* initialize_free_chunk(MetaWord* p, size_t word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	230
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	231 // Only allocate and split from freelist if the size of the allocation
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	232 // is at least 1/4th the size of the available block.
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	233 const static int WasteMultiplier = 4;
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	234
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	235 // Accessors
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	236 BlockTreeDictionary* dictionary() const { return _dictionary; }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	237
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	238 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	239 BlockFreelist();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	240 ~BlockFreelist();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	241
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	242 // Get and return a block to the free list
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	243 MetaWord* get_block(size_t word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	244 void return_block(MetaWord* p, size_t word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	245
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	246 size_t total_size() {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	247 if (dictionary() == NULL) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	248 return 0;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	249 } else {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	250 return dictionary()->total_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	251 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	252 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	253
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	254 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	255 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	256
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	257 class VirtualSpaceNode : public CHeapObj<mtClass> {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	258 friend class VirtualSpaceList;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	259
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	260 // Link to next VirtualSpaceNode
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	261 VirtualSpaceNode* _next;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	262
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	263 // total in the VirtualSpace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	264 MemRegion _reserved;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	265 ReservedSpace _rs;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	266 VirtualSpace _virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	267 MetaWord* _top;
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	268 // count of chunks contained in this VirtualSpace
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	269 uintx _container_count;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	270
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	271 // Convenience functions to access the _virtual_space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	272 char* low() const { return virtual_space()->low(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	273 char* high() const { return virtual_space()->high(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	274
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	275 // The first Metachunk will be allocated at the bottom of the
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	276 // VirtualSpace
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	277 Metachunk* first_chunk() { return (Metachunk*) bottom(); }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	278
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	279 void inc_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	280 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	281 uint container_count_slow();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	282 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	283
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	284 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	285
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	286 VirtualSpaceNode(size_t byte_size);
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	287 VirtualSpaceNode(ReservedSpace rs) : _top(NULL), _next(NULL), _rs(rs), _container_count(0) {}
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	288 ~VirtualSpaceNode();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	289
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	290 // Convenience functions for logical bottom and end
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	291 MetaWord* bottom() const { return (MetaWord*) _virtual_space.low(); }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	292 MetaWord* end() const { return (MetaWord*) _virtual_space.high(); }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	293
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	294 // address of next available space in _virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	295 // Accessors
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	296 VirtualSpaceNode* next() { return _next; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	297 void set_next(VirtualSpaceNode* v) { _next = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	298
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	299 void set_reserved(MemRegion const v) { _reserved = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	300 void set_top(MetaWord* v) { _top = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	301
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	302 // Accessors
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	303 MemRegion* reserved() { return &_reserved; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	304 VirtualSpace* virtual_space() const { return (VirtualSpace*) &_virtual_space; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	305
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	306 // Returns true if "word_size" is available in the VirtualSpace
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	307 bool is_available(size_t word_size) { return _top + word_size <= end(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	308
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	309 MetaWord* top() const { return _top; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	310 void inc_top(size_t word_size) { _top += word_size; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	311
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	312 uintx container_count() { return _container_count; }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	313 void dec_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	314 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	315 void verify_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	316 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	317
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	318 // used and capacity in this single entry in the list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	319 size_t used_words_in_vs() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	320 size_t capacity_words_in_vs() const;
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	321 size_t free_words_in_vs() const;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	322
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	323 bool initialize();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	324
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	325 // get space from the virtual space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	326 Metachunk* take_from_committed(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	327
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	328 // Allocate a chunk from the virtual space and return it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	329 Metachunk* get_chunk_vs(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	330 Metachunk* get_chunk_vs_with_expand(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	331
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	332 // Expands/shrinks the committed space in a virtual space. Delegates
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	333 // to Virtualspace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	334 bool expand_by(size_t words, bool pre_touch = false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	335 bool shrink_by(size_t words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	336
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	337 // In preparation for deleting this node, remove all the chunks
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	338 // in the node from any freelist.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	339 void purge(ChunkManager* chunk_manager);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	340
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	341 #ifdef ASSERT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	342 // Debug support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	343 static void verify_virtual_space_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	344 static void verify_virtual_space_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	345 void mangle();
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	346 #endif
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	347
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	348 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	349 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	350
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	351 // byte_size is the size of the associated virtualspace.
12110 4c84d351cca9 8007074: SIGSEGV at ParMarkBitMap::verify_clear() stefank parents: 12063 diff changeset	352 VirtualSpaceNode::VirtualSpaceNode(size_t byte_size) : _top(NULL), _next(NULL), _rs(), _container_count(0) {
8752 82f49e8e2c28 8009614: nsk/split_verifier/stress/ifelse/ifelse002_30 fails with 'assert((size & (granularity - 1)) == 0) failed: size not aligned to os::vm_allocation_granularity() zgu parents: 8712 diff changeset	353 // align up to vm allocation granularity
82f49e8e2c28 8009614: nsk/split_verifier/stress/ifelse/ifelse002_30 fails with 'assert((size & (granularity - 1)) == 0) failed: size not aligned to os::vm_allocation_granularity() zgu parents: 8712 diff changeset	354 byte_size = align_size_up(byte_size, os::vm_allocation_granularity());
82f49e8e2c28 8009614: nsk/split_verifier/stress/ifelse/ifelse002_30 fails with 'assert((size & (granularity - 1)) == 0) failed: size not aligned to os::vm_allocation_granularity() zgu parents: 8712 diff changeset	355
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	356 // This allocates memory with mmap. For DumpSharedspaces, try to reserve
91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	357 // configurable address, generally at the top of the Java heap so other
91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	358 // memory addresses don't conflict.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	359 if (DumpSharedSpaces) {
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	360 char* shared_base = (char*)SharedBaseAddress;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	361 _rs = ReservedSpace(byte_size, 0, false, shared_base, 0);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	362 if (_rs.is_reserved()) {
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	363 assert(shared_base == 0 \|\| _rs.base() == shared_base, "should match");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	364 } else {
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	365 // Get a mmap region anywhere if the SharedBaseAddress fails.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	366 _rs = ReservedSpace(byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	367 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	368 MetaspaceShared::set_shared_rs(&_rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	369 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	370 _rs = ReservedSpace(byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	371 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	372
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	373 MemTracker::record_virtual_memory_type((address)_rs.base(), mtClass);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	374 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	375
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	376 void VirtualSpaceNode::purge(ChunkManager* chunk_manager) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	377 Metachunk* chunk = first_chunk();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	378 Metachunk* invalid_chunk = (Metachunk*) top();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	379 while (chunk < invalid_chunk ) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	380 assert(chunk->is_free(), "Should be marked free");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	381 MetaWord* next = ((MetaWord*)chunk) + chunk->word_size();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	382 chunk_manager->remove_chunk(chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	383 assert(chunk->next() == NULL &&
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	384 chunk->prev() == NULL,
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	385 "Was not removed from its list");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	386 chunk = (Metachunk*) next;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	387 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	388 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	389
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	390 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	391 uint VirtualSpaceNode::container_count_slow() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	392 uint count = 0;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	393 Metachunk* chunk = first_chunk();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	394 Metachunk* invalid_chunk = (Metachunk*) top();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	395 while (chunk < invalid_chunk ) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	396 MetaWord* next = ((MetaWord*)chunk) + chunk->word_size();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	397 // Don't count the chunks on the free lists. Those are
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	398 // still part of the VirtualSpaceNode but not currently
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	399 // counted.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	400 if (!chunk->is_free()) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	401 count++;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	402 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	403 chunk = (Metachunk*) next;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	404 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	405 return count;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	406 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	407 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	408
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	409 // List of VirtualSpaces for metadata allocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	410 // It has a _next link for singly linked list and a MemRegion
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	411 // for total space in the VirtualSpace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	412 class VirtualSpaceList : public CHeapObj<mtClass> {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	413 friend class VirtualSpaceNode;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	414
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	415 enum VirtualSpaceSizes {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	416 VirtualSpaceSize = 256 * K
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	417 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	418
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	419 // Global list of virtual spaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	420 // Head of the list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	421 VirtualSpaceNode* _virtual_space_list;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	422 // virtual space currently being used for allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	423 VirtualSpaceNode* _current_virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	424 // Free chunk list for all other metadata
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	425 ChunkManager _chunk_manager;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	426
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	427 // Can this virtual list allocate >1 spaces? Also, used to determine
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	428 // whether to allocate unlimited small chunks in this virtual space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	429 bool _is_class;
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	430 bool can_grow() const { return !is_class() \|\| !UseCompressedClassPointers; }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	431
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	432 // Sum of space in all virtual spaces and number of virtual spaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	433 size_t _virtual_space_total;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	434 size_t _virtual_space_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	435
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	436 ~VirtualSpaceList();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	437
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	438 VirtualSpaceNode* virtual_space_list() const { return _virtual_space_list; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	439
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	440 void set_virtual_space_list(VirtualSpaceNode* v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	441 _virtual_space_list = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	442 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	443 void set_current_virtual_space(VirtualSpaceNode* v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	444 _current_virtual_space = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	445 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	446
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	447 void link_vs(VirtualSpaceNode* new_entry, size_t vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	448
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	449 // Get another virtual space and add it to the list. This
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	450 // is typically prompted by a failed attempt to allocate a chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	451 // and is typically followed by the allocation of a chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	452 bool grow_vs(size_t vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	453
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	454 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	455 VirtualSpaceList(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	456 VirtualSpaceList(ReservedSpace rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	457
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	458 size_t free_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	459
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	460 Metachunk* get_new_chunk(size_t word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	461 size_t grow_chunks_by_words,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	462 size_t medium_chunk_bunch);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	463
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	464 // Get the first chunk for a Metaspace. Used for
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	465 // special cases such as the boot class loader, reflection
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	466 // class loader and anonymous class loader.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	467 Metachunk* get_initialization_chunk(size_t word_size, size_t chunk_bunch);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	468
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	469 VirtualSpaceNode* current_virtual_space() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	470 return _current_virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	471 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	472
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	473 ChunkManager* chunk_manager() { return &_chunk_manager; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	474 bool is_class() const { return _is_class; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	475
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	476 // Allocate the first virtualspace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	477 void initialize(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	478
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	479 size_t virtual_space_total() { return _virtual_space_total; }
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	480
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	481 void inc_virtual_space_total(size_t v);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	482 void dec_virtual_space_total(size_t v);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	483 void inc_virtual_space_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	484 void dec_virtual_space_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	485
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	486 // Unlink empty VirtualSpaceNodes and free it.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	487 void purge();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	488
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	489 // Used and capacity in the entire list of virtual spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	490 // These are global values shared by all Metaspaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	491 size_t capacity_words_sum();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	492 size_t capacity_bytes_sum() { return capacity_words_sum() * BytesPerWord; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	493 size_t used_words_sum();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	494 size_t used_bytes_sum() { return used_words_sum() * BytesPerWord; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	495
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	496 bool contains(const void *ptr);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	497
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	498 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	499
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	500 class VirtualSpaceListIterator : public StackObj {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	501 VirtualSpaceNode* _virtual_spaces;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	502 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	503 VirtualSpaceListIterator(VirtualSpaceNode* virtual_spaces) :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	504 _virtual_spaces(virtual_spaces) {}
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	505
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	506 bool repeat() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	507 return _virtual_spaces != NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	508 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	509
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	510 VirtualSpaceNode* get_next() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	511 VirtualSpaceNode* result = _virtual_spaces;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	512 if (_virtual_spaces != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	513 _virtual_spaces = _virtual_spaces->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	514 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	515 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	516 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	517 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	518 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	519
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	520 class Metadebug : AllStatic {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	521 // Debugging support for Metaspaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	522 static int _deallocate_block_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	523 static int _deallocate_chunk_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	524 static int _allocation_fail_alot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	525
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	526 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	527 static int deallocate_block_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	528 return _deallocate_block_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	529 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	530 static void set_deallocate_block_a_lot_count(int v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	531 _deallocate_block_a_lot_count = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	532 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	533 static void inc_deallocate_block_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	534 _deallocate_block_a_lot_count++;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	535 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	536 static int deallocate_chunk_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	537 return _deallocate_chunk_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	538 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	539 static void reset_deallocate_chunk_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	540 _deallocate_chunk_a_lot_count = 1;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	541 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	542 static void inc_deallocate_chunk_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	543 _deallocate_chunk_a_lot_count++;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	544 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	545
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	546 static void init_allocation_fail_alot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	547 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	548 static bool test_metadata_failure();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	549 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	550
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	551 static void deallocate_chunk_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	552 size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	553 static void deallocate_block_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	554 size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	555
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	556 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	557
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	558 int Metadebug::_deallocate_block_a_lot_count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	559 int Metadebug::_deallocate_chunk_a_lot_count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	560 int Metadebug::_allocation_fail_alot_count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	561
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	562 // SpaceManager - used by Metaspace to handle allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	563 class SpaceManager : public CHeapObj<mtClass> {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	564 friend class Metaspace;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	565 friend class Metadebug;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	566
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	567 private:
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	568
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	569 // protects allocations and contains.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	570 Mutex* const _lock;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	571
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	572 // Type of metadata allocated.
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	573 Metaspace::MetadataType _mdtype;
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	574
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	575 // Chunk related size
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	576 size_t _medium_chunk_bunch;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	577
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	578 // List of chunks in use by this SpaceManager. Allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	579 // are done from the current chunk. The list is used for deallocating
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	580 // chunks when the SpaceManager is freed.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	581 Metachunk* _chunks_in_use[NumberOfInUseLists];
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	582 Metachunk* _current_chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	583
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	584 // Virtual space where allocation comes from.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	585 VirtualSpaceList* _vs_list;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	586
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	587 // Number of small chunks to allocate to a manager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	588 // If class space manager, small chunks are unlimited
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	589 static uint const _small_chunk_limit;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	590
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	591 // Sum of all space in allocated chunks
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	592 size_t _allocated_blocks_words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	593
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	594 // Sum of all allocated chunks
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	595 size_t _allocated_chunks_words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	596 size_t _allocated_chunks_count;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	597
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	598 // Free lists of blocks are per SpaceManager since they
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	599 // are assumed to be in chunks in use by the SpaceManager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	600 // and all chunks in use by a SpaceManager are freed when
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	601 // the class loader using the SpaceManager is collected.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	602 BlockFreelist _block_freelists;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	603
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	604 // protects virtualspace and chunk expansions
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	605 static const char* _expand_lock_name;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	606 static const int _expand_lock_rank;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	607 static Mutex* const _expand_lock;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	608
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	609 private:
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	610 // Accessors
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	611 Metachunk* chunks_in_use(ChunkIndex index) const { return _chunks_in_use[index]; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	612 void set_chunks_in_use(ChunkIndex index, Metachunk* v) { _chunks_in_use[index] = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	613
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	614 BlockFreelist* block_freelists() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	615 return (BlockFreelist*) &_block_freelists;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	616 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	617
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	618 Metaspace::MetadataType mdtype() { return _mdtype; }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	619 VirtualSpaceList* vs_list() const { return _vs_list; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	620
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	621 Metachunk* current_chunk() const { return _current_chunk; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	622 void set_current_chunk(Metachunk* v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	623 _current_chunk = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	624 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	625
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	626 Metachunk* find_current_chunk(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	627
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	628 // Add chunk to the list of chunks in use
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	629 void add_chunk(Metachunk* v, bool make_current);
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	630 void retire_current_chunk();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	631
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	632 Mutex* lock() const { return _lock; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	633
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	634 const char* chunk_size_name(ChunkIndex index) const;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	635
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	636 protected:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	637 void initialize();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	638
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	639 public:
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	640 SpaceManager(Metaspace::MetadataType mdtype,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	641 Mutex* lock,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	642 VirtualSpaceList* vs_list);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	643 ~SpaceManager();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	644
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	645 enum ChunkMultiples {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	646 MediumChunkMultiple = 4
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	647 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	648
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	649 // Accessors
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	650 size_t specialized_chunk_size() { return SpecializedChunk; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	651 size_t small_chunk_size() { return (size_t) vs_list()->is_class() ? ClassSmallChunk : SmallChunk; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	652 size_t medium_chunk_size() { return (size_t) vs_list()->is_class() ? ClassMediumChunk : MediumChunk; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	653 size_t medium_chunk_bunch() { return medium_chunk_size() * MediumChunkMultiple; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	654
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	655 size_t allocated_blocks_words() const { return _allocated_blocks_words; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	656 size_t allocated_blocks_bytes() const { return _allocated_blocks_words * BytesPerWord; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	657 size_t allocated_chunks_words() const { return _allocated_chunks_words; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	658 size_t allocated_chunks_count() const { return _allocated_chunks_count; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	659
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	660 bool is_humongous(size_t word_size) { return word_size > medium_chunk_size(); }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	661
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	662 static Mutex* expand_lock() { return _expand_lock; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	663
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	664 // Increment the per Metaspace and global running sums for Metachunks
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	665 // by the given size. This is used when a Metachunk to added to
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	666 // the in-use list.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	667 void inc_size_metrics(size_t words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	668 // Increment the per Metaspace and global running sums Metablocks by the given
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	669 // size. This is used when a Metablock is allocated.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	670 void inc_used_metrics(size_t words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	671 // Delete the portion of the running sums for this SpaceManager. That is,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	672 // the globals running sums for the Metachunks and Metablocks are
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	673 // decremented for all the Metachunks in-use by this SpaceManager.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	674 void dec_total_from_size_metrics();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	675
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	676 // Set the sizes for the initial chunks.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	677 void get_initial_chunk_sizes(Metaspace::MetaspaceType type,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	678 size_t* chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	679 size_t* class_chunk_word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	680
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	681 size_t sum_capacity_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	682 size_t sum_used_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	683 size_t sum_free_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	684 size_t sum_waste_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	685 size_t sum_waste_in_chunks_in_use(ChunkIndex index ) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	686
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	687 size_t sum_count_in_chunks_in_use();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	688 size_t sum_count_in_chunks_in_use(ChunkIndex i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	689
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	690 Metachunk* get_new_chunk(size_t word_size, size_t grow_chunks_by_words);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	691
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	692 // Block allocation and deallocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	693 // Allocates a block from the current chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	694 MetaWord* allocate(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	695
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	696 // Helper for allocations
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	697 MetaWord* allocate_work(size_t word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	698
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	699 // Returns a block to the per manager freelist
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	700 void deallocate(MetaWord* p, size_t word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	701
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	702 // Based on the allocation size and a minimum chunk size,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	703 // returned chunk size (for expanding space for chunk allocation).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	704 size_t calc_chunk_size(size_t allocation_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	705
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	706 // Called when an allocation from the current chunk fails.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	707 // Gets a new chunk (may require getting a new virtual space),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	708 // and allocates from that chunk.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	709 MetaWord* grow_and_allocate(size_t word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	710
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	711 // debugging support.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	712
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	713 void dump(outputStream* const out) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	714 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	715 void locked_print_chunks_in_use_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	716
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	717 void verify();
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	718 void verify_chunk_size(Metachunk* chunk);
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	719 NOT_PRODUCT(void mangle_freed_chunks();)
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	720 #ifdef ASSERT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	721 void verify_allocated_blocks_words();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	722 #endif
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	723
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	724 size_t get_raw_word_size(size_t word_size) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	725 // If only the dictionary is going to be used (i.e., no
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	726 // indexed free list), then there is a minimum size requirement.
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	727 // MinChunkSize is a placeholder for the real minimum size JJJ
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	728 size_t byte_size = word_size * BytesPerWord;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	729
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	730 size_t byte_size_with_overhead = byte_size + Metablock::overhead();
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	731
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	732 size_t raw_bytes_size = MAX2(byte_size_with_overhead,
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	733 Metablock::min_block_byte_size());
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	734 raw_bytes_size = ARENA_ALIGN(raw_bytes_size);
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	735 size_t raw_word_size = raw_bytes_size / BytesPerWord;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	736 assert(raw_word_size * BytesPerWord == raw_bytes_size, "Size problem");
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	737
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	738 return raw_word_size;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	739 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	740 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	741
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	742 uint const SpaceManager::_small_chunk_limit = 4;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	743
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	744 const char* SpaceManager::_expand_lock_name =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	745 "SpaceManager chunk allocation lock";
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	746 const int SpaceManager::_expand_lock_rank = Monitor::leaf - 1;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	747 Mutex* const SpaceManager::_expand_lock =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	748 new Mutex(SpaceManager::_expand_lock_rank,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	749 SpaceManager::_expand_lock_name,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	750 Mutex::_allow_vm_block_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	751
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	752 void VirtualSpaceNode::inc_container_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	753 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	754 _container_count++;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	755 assert(_container_count == container_count_slow(),
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	756 err_msg("Inconsistency in countainer_count _container_count " SIZE_FORMAT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	757 "container_count_slow() " SIZE_FORMAT,
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	758 _container_count, container_count_slow()));
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	759 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	760
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	761 void VirtualSpaceNode::dec_container_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	762 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	763 _container_count--;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	764 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	765
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	766 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	767 void VirtualSpaceNode::verify_container_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	768 assert(_container_count == container_count_slow(),
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	769 err_msg("Inconsistency in countainer_count _container_count " SIZE_FORMAT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	770 "container_count_slow() " SIZE_FORMAT, _container_count, container_count_slow()));
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	771 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	772 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	773
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	774 // BlockFreelist methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	775
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	776 BlockFreelist::BlockFreelist() : _dictionary(NULL) {}
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	777
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	778 BlockFreelist::~BlockFreelist() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	779 if (_dictionary != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	780 if (Verbose && TraceMetadataChunkAllocation) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	781 _dictionary->print_free_lists(gclog_or_tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	782 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	783 delete _dictionary;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	784 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	785 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	786
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	787 Metablock* BlockFreelist::initialize_free_chunk(MetaWord* p, size_t word_size) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	788 Metablock* block = (Metablock*) p;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	789 block->set_word_size(word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	790 block->set_prev(NULL);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	791 block->set_next(NULL);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	792
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	793 return block;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	794 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	795
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	796 void BlockFreelist::return_block(MetaWord* p, size_t word_size) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	797 Metablock* free_chunk = initialize_free_chunk(p, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	798 if (dictionary() == NULL) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	799 _dictionary = new BlockTreeDictionary();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	800 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	801 dictionary()->return_chunk(free_chunk);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	802 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	803
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	804 MetaWord* BlockFreelist::get_block(size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	805 if (dictionary() == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	806 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	807 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	808
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	809 if (word_size < TreeChunk<Metablock, FreeList>::min_size()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	810 // Dark matter. Too small for dictionary.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	811 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	812 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	813
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	814 Metablock* free_block =
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	815 dictionary()->get_chunk(word_size, FreeBlockDictionary<Metablock>::atLeast);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	816 if (free_block == NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	817 return NULL;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	818 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	819
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	820 const size_t block_size = free_block->size();
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	821 if (block_size > WasteMultiplier * word_size) {
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	822 return_block((MetaWord*)free_block, block_size);
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	823 return NULL;
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	824 }
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	825
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	826 MetaWord* new_block = (MetaWord*)free_block;
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	827 assert(block_size >= word_size, "Incorrect size of block from freelist");
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	828 const size_t unused = block_size - word_size;
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	829 if (unused >= TreeChunk<Metablock, FreeList>::min_size()) {
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	830 return_block(new_block + word_size, unused);
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	831 }
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	832
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	833 return new_block;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	834 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	835
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	836 void BlockFreelist::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	837 if (dictionary() == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	838 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	839 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	840 dictionary()->print_free_lists(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	841 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	842
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	843 // VirtualSpaceNode methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	844
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	845 VirtualSpaceNode::~VirtualSpaceNode() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	846 _rs.release();
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	847 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	848 size_t word_size = sizeof(*this) / BytesPerWord;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	849 Copy::fill_to_words((HeapWord*) this, word_size, 0xf1f1f1f1);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	850 #endif
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	851 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	852
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	853 size_t VirtualSpaceNode::used_words_in_vs() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	854 return pointer_delta(top(), bottom(), sizeof(MetaWord));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	855 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	856
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	857 // Space committed in the VirtualSpace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	858 size_t VirtualSpaceNode::capacity_words_in_vs() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	859 return pointer_delta(end(), bottom(), sizeof(MetaWord));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	860 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	861
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	862 size_t VirtualSpaceNode::free_words_in_vs() const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	863 return pointer_delta(end(), top(), sizeof(MetaWord));
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	864 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	865
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	866 // Allocates the chunk from the virtual space only.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	867 // This interface is also used internally for debugging. Not all
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	868 // chunks removed here are necessarily used for allocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	869 Metachunk* VirtualSpaceNode::take_from_committed(size_t chunk_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	870 // Bottom of the new chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	871 MetaWord* chunk_limit = top();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	872 assert(chunk_limit != NULL, "Not safe to call this method");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	873
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	874 if (!is_available(chunk_word_size)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	875 if (TraceMetadataChunkAllocation) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	876 tty->print("VirtualSpaceNode::take_from_committed() not available %d words ", chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	877 // Dump some information about the virtual space that is nearly full
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	878 print_on(tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	879 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	880 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	881 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	882
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	883 // Take the space (bump top on the current virtual space).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	884 inc_top(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	885
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	886 // Initialize the chunk
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	887 Metachunk* result = ::new (chunk_limit) Metachunk(chunk_word_size, this);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	888 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	889 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	890
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	891
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	892 // Expand the virtual space (commit more of the reserved space)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	893 bool VirtualSpaceNode::expand_by(size_t words, bool pre_touch) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	894 size_t bytes = words * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	895 bool result = virtual_space()->expand_by(bytes, pre_touch);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	896 if (TraceMetavirtualspaceAllocation && !result) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	897 gclog_or_tty->print_cr("VirtualSpaceNode::expand_by() failed "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	898 "for byte size " SIZE_FORMAT, bytes);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	899 virtual_space()->print();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	900 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	901 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	902 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	903
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	904 // Shrink the virtual space (commit more of the reserved space)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	905 bool VirtualSpaceNode::shrink_by(size_t words) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	906 size_t bytes = words * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	907 virtual_space()->shrink_by(bytes);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	908 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	909 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	910
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	911 // Add another chunk to the chunk list.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	912
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	913 Metachunk* VirtualSpaceNode::get_chunk_vs(size_t chunk_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	914 assert_lock_strong(SpaceManager::expand_lock());
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	915 Metachunk* result = take_from_committed(chunk_word_size);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	916 if (result != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	917 inc_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	918 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	919 return result;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	920 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	921
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	922 Metachunk* VirtualSpaceNode::get_chunk_vs_with_expand(size_t chunk_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	923 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	924
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	925 Metachunk* new_chunk = get_chunk_vs(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	926
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	927 if (new_chunk == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	928 // Only a small part of the virtualspace is committed when first
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	929 // allocated so committing more here can be expected.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	930 size_t page_size_words = os::vm_page_size() / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	931 size_t aligned_expand_vs_by_words = align_size_up(chunk_word_size,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	932 page_size_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	933 expand_by(aligned_expand_vs_by_words, false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	934 new_chunk = get_chunk_vs(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	935 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	936 return new_chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	937 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	938
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	939 bool VirtualSpaceNode::initialize() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	940
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	941 if (!_rs.is_reserved()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	942 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	943 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	944
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	945 // An allocation out of this Virtualspace that is larger
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	946 // than an initial commit size can waste that initial committed
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	947 // space.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	948 size_t committed_byte_size = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	949 bool result = virtual_space()->initialize(_rs, committed_byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	950 if (result) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	951 set_top((MetaWord*)virtual_space()->low());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	952 set_reserved(MemRegion((HeapWord*)_rs.base(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	953 (HeapWord*)(_rs.base() + _rs.size())));
6726 03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	954
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	955 assert(reserved()->start() == (HeapWord*) _rs.base(),
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	956 err_msg("Reserved start was not set properly " PTR_FORMAT
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	957 " != " PTR_FORMAT, reserved()->start(), _rs.base()));
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	958 assert(reserved()->word_size() == _rs.size() / BytesPerWord,
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	959 err_msg("Reserved size was not set properly " SIZE_FORMAT
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	960 " != " SIZE_FORMAT, reserved()->word_size(),
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	961 _rs.size() / BytesPerWord));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	962 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	963
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	964 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	965 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	966
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	967 void VirtualSpaceNode::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	968 size_t used = used_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	969 size_t capacity = capacity_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	970 VirtualSpace* vs = virtual_space();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	971 st->print_cr(" space @ " PTR_FORMAT " " SIZE_FORMAT "K, %3d%% used "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	972 "[" PTR_FORMAT ", " PTR_FORMAT ", "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	973 PTR_FORMAT ", " PTR_FORMAT ")",
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	974 vs, capacity / K,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	975 capacity == 0 ? 0 : used * 100 / capacity,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	976 bottom(), top(), end(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	977 vs->high_boundary());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	978 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	979
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	980 #ifdef ASSERT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	981 void VirtualSpaceNode::mangle() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	982 size_t word_size = capacity_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	983 Copy::fill_to_words((HeapWord*) low(), word_size, 0xf1f1f1f1);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	984 }
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	985 #endif // ASSERT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	986
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	987 // VirtualSpaceList methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	988 // Space allocated from the VirtualSpace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	989
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	990 VirtualSpaceList::~VirtualSpaceList() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	991 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	992 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	993 VirtualSpaceNode* vsl = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	994 delete vsl;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	995 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	996 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	997
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	998 void VirtualSpaceList::inc_virtual_space_total(size_t v) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	999 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1000 _virtual_space_total = _virtual_space_total + v;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1001 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1002 void VirtualSpaceList::dec_virtual_space_total(size_t v) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1003 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1004 _virtual_space_total = _virtual_space_total - v;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1005 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1006
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1007 void VirtualSpaceList::inc_virtual_space_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1008 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1009 _virtual_space_count++;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1010 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1011 void VirtualSpaceList::dec_virtual_space_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1012 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1013 _virtual_space_count--;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1014 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1015
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1016 void ChunkManager::remove_chunk(Metachunk* chunk) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1017 size_t word_size = chunk->word_size();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1018 ChunkIndex index = list_index(word_size);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1019 if (index != HumongousIndex) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1020 free_chunks(index)->remove_chunk(chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1021 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1022 humongous_dictionary()->remove_chunk(chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1023 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1024
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1025 // Chunk is being removed from the chunks free list.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1026 dec_free_chunks_total(chunk->capacity_word_size());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1027 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1028
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1029 // Walk the list of VirtualSpaceNodes and delete
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1030 // nodes with a 0 container_count. Remove Metachunks in
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1031 // the node from their respective freelists.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1032 void VirtualSpaceList::purge() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1033 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1034 // Don't use a VirtualSpaceListIterator because this
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1035 // list is being changed and a straightforward use of an iterator is not safe.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1036 VirtualSpaceNode* purged_vsl = NULL;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1037 VirtualSpaceNode* prev_vsl = virtual_space_list();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1038 VirtualSpaceNode* next_vsl = prev_vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1039 while (next_vsl != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1040 VirtualSpaceNode* vsl = next_vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1041 next_vsl = vsl->next();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1042 // Don't free the current virtual space since it will likely
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1043 // be needed soon.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1044 if (vsl->container_count() == 0 && vsl != current_virtual_space()) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1045 // Unlink it from the list
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1046 if (prev_vsl == vsl) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1047 // This is the case of the current note being the first note.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1048 assert(vsl == virtual_space_list(), "Expected to be the first note");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1049 set_virtual_space_list(vsl->next());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1050 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1051 prev_vsl->set_next(vsl->next());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1052 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1053
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1054 vsl->purge(chunk_manager());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1055 dec_virtual_space_total(vsl->reserved()->word_size());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1056 dec_virtual_space_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1057 purged_vsl = vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1058 delete vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1059 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1060 prev_vsl = vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1061 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1062 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1063 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1064 if (purged_vsl != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1065 // List should be stable enough to use an iterator here.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1066 VirtualSpaceListIterator iter(virtual_space_list());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1067 while (iter.repeat()) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1068 VirtualSpaceNode* vsl = iter.get_next();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1069 assert(vsl != purged_vsl, "Purge of vsl failed");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1070 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1071 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1072 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1073 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1074
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1075 size_t VirtualSpaceList::used_words_sum() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1076 size_t allocated_by_vs = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1077 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1078 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1079 VirtualSpaceNode* vsl = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1080 // Sum used region [bottom, top) in each virtualspace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1081 allocated_by_vs += vsl->used_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1082 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1083 assert(allocated_by_vs >= chunk_manager()->free_chunks_total(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1084 err_msg("Total in free chunks " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1085 " greater than total from virtual_spaces " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1086 allocated_by_vs, chunk_manager()->free_chunks_total()));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1087 size_t used =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1088 allocated_by_vs - chunk_manager()->free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1089 return used;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1090 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1091
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1092 // Space available in all MetadataVirtualspaces allocated
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1093 // for metadata. This is the upper limit on the capacity
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1094 // of chunks allocated out of all the MetadataVirtualspaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1095 size_t VirtualSpaceList::capacity_words_sum() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1096 size_t capacity = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1097 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1098 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1099 VirtualSpaceNode* vsl = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1100 capacity += vsl->capacity_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1101 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1102 return capacity;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1103 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1104
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1105 VirtualSpaceList::VirtualSpaceList(size_t word_size ) :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1106 _is_class(false),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1107 _virtual_space_list(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1108 _current_virtual_space(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1109 _virtual_space_total(0),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1110 _virtual_space_count(0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1111 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1112 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1113 bool initialization_succeeded = grow_vs(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1114
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1115 _chunk_manager.free_chunks(SpecializedIndex)->set_size(SpecializedChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1116 _chunk_manager.free_chunks(SmallIndex)->set_size(SmallChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1117 _chunk_manager.free_chunks(MediumIndex)->set_size(MediumChunk);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1118 assert(initialization_succeeded,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1119 " VirtualSpaceList initialization should not fail");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1120 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1121
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1122 VirtualSpaceList::VirtualSpaceList(ReservedSpace rs) :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1123 _is_class(true),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1124 _virtual_space_list(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1125 _current_virtual_space(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1126 _virtual_space_total(0),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1127 _virtual_space_count(0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1128 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1129 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1130 VirtualSpaceNode* class_entry = new VirtualSpaceNode(rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1131 bool succeeded = class_entry->initialize();
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1132 _chunk_manager.free_chunks(SpecializedIndex)->set_size(SpecializedChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1133 _chunk_manager.free_chunks(SmallIndex)->set_size(ClassSmallChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1134 _chunk_manager.free_chunks(MediumIndex)->set_size(ClassMediumChunk);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1135 assert(succeeded, " VirtualSpaceList initialization should not fail");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1136 link_vs(class_entry, rs.size()/BytesPerWord);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1137 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1138
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1139 size_t VirtualSpaceList::free_bytes() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1140 return virtual_space_list()->free_words_in_vs() * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1141 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1142
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1143 // Allocate another meta virtual space and add it to the list.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1144 bool VirtualSpaceList::grow_vs(size_t vs_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1145 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1146 if (vs_word_size == 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1147 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1148 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1149 // Reserve the space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1150 size_t vs_byte_size = vs_word_size * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1151 assert(vs_byte_size % os::vm_page_size() == 0, "Not aligned");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1152
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1153 // Allocate the meta virtual space and initialize it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1154 VirtualSpaceNode* new_entry = new VirtualSpaceNode(vs_byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1155 if (!new_entry->initialize()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1156 delete new_entry;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1157 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1158 } else {
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	1159 // ensure lock-free iteration sees fully initialized node
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	1160 OrderAccess::storestore();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1161 link_vs(new_entry, vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1162 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1163 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1164 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1165
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1166 void VirtualSpaceList::link_vs(VirtualSpaceNode* new_entry, size_t vs_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1167 if (virtual_space_list() == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1168 set_virtual_space_list(new_entry);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1169 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1170 current_virtual_space()->set_next(new_entry);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1171 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1172 set_current_virtual_space(new_entry);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1173 inc_virtual_space_total(vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1174 inc_virtual_space_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1175 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1176 new_entry->mangle();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1177 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1178 if (TraceMetavirtualspaceAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1179 VirtualSpaceNode* vsl = current_virtual_space();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1180 vsl->print_on(tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1181 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1182 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1183
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1184 Metachunk* VirtualSpaceList::get_new_chunk(size_t word_size,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1185 size_t grow_chunks_by_words,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1186 size_t medium_chunk_bunch) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1187
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1188 // Get a chunk from the chunk freelist
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1189 Metachunk* next = chunk_manager()->chunk_freelist_allocate(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1190
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1191 if (next != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1192 next->container()->inc_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1193 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1194 // Allocate a chunk out of the current virtual space.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1195 next = current_virtual_space()->get_chunk_vs(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1196 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1197
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1198 if (next == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1199 // Not enough room in current virtual space. Try to commit
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1200 // more space.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1201 size_t expand_vs_by_words = MAX2(medium_chunk_bunch,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1202 grow_chunks_by_words);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1203 size_t page_size_words = os::vm_page_size() / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1204 size_t aligned_expand_vs_by_words = align_size_up(expand_vs_by_words,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1205 page_size_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1206 bool vs_expanded =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1207 current_virtual_space()->expand_by(aligned_expand_vs_by_words, false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1208 if (!vs_expanded) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1209 // Should the capacity of the metaspaces be expanded for
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1210 // this allocation? If it's the virtual space for classes and is
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1211 // being used for CompressedHeaders, don't allocate a new virtualspace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1212 if (can_grow() && MetaspaceGC::should_expand(this, word_size)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1213 // Get another virtual space.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1214 size_t grow_vs_words =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1215 MAX2((size_t)VirtualSpaceSize, aligned_expand_vs_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1216 if (grow_vs(grow_vs_words)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1217 // Got it. It's on the list now. Get a chunk from it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1218 next = current_virtual_space()->get_chunk_vs_with_expand(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1219 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1220 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1221 // Allocation will fail and induce a GC
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1222 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1223 gclog_or_tty->print_cr("VirtualSpaceList::get_new_chunk():"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1224 " Fail instead of expand the metaspace");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1225 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1226 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1227 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1228 // The virtual space expanded, get a new chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1229 next = current_virtual_space()->get_chunk_vs(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1230 assert(next != NULL, "Just expanded, should succeed");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1231 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1232 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1233
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1234 assert(next == NULL \|\| (next->next() == NULL && next->prev() == NULL),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1235 "New chunk is still on some list");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1236 return next;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1237 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1238
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1239 Metachunk* VirtualSpaceList::get_initialization_chunk(size_t chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1240 size_t chunk_bunch) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1241 // Get a chunk from the chunk freelist
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1242 Metachunk* new_chunk = get_new_chunk(chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1243 chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1244 chunk_bunch);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1245 return new_chunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1246 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1247
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1248 void VirtualSpaceList::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1249 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1250 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1251 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1252 VirtualSpaceNode* node = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1253 node->print_on(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1254 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1255 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1256 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1257
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1258 bool VirtualSpaceList::contains(const void *ptr) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1259 VirtualSpaceNode* list = virtual_space_list();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1260 VirtualSpaceListIterator iter(list);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1261 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1262 VirtualSpaceNode* node = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1263 if (node->reserved()->contains(ptr)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1264 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1265 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1266 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1267 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1268 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1269
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1270
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1271 // MetaspaceGC methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1272
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1273 // VM_CollectForMetadataAllocation is the vm operation used to GC.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1274 // Within the VM operation after the GC the attempt to allocate the metadata
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1275 // should succeed. If the GC did not free enough space for the metaspace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1276 // allocation, the HWM is increased so that another virtualspace will be
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1277 // allocated for the metadata. With perm gen the increase in the perm
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1278 // gen had bounds, MinMetaspaceExpansion and MaxMetaspaceExpansion. The
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1279 // metaspace policy uses those as the small and large steps for the HWM.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1280 //
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1281 // After the GC the compute_new_size() for MetaspaceGC is called to
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1282 // resize the capacity of the metaspaces. The current implementation
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1283 // is based on the flags MinMetaspaceFreeRatio and MaxMetaspaceFreeRatio used
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1284 // to resize the Java heap by some GC's. New flags can be implemented
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1285 // if really needed. MinMetaspaceFreeRatio is used to calculate how much
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1286 // free space is desirable in the metaspace capacity to decide how much
8040 a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1287 // to increase the HWM. MaxMetaspaceFreeRatio is used to decide how much
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1288 // free space is desirable in the metaspace capacity before decreasing
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1289 // the HWM.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1290
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1291 // Calculate the amount to increase the high water mark (HWM).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1292 // Increase by a minimum amount (MinMetaspaceExpansion) so that
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1293 // another expansion is not requested too soon. If that is not
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1294 // enough to satisfy the allocation (i.e. big enough for a word_size
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1295 // allocation), increase by MaxMetaspaceExpansion. If that is still
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1296 // not enough, expand by the size of the allocation (word_size) plus
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1297 // some.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1298 size_t MetaspaceGC::delta_capacity_until_GC(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1299 size_t before_inc = MetaspaceGC::capacity_until_GC();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1300 size_t min_delta_words = MinMetaspaceExpansion / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1301 size_t max_delta_words = MaxMetaspaceExpansion / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1302 size_t page_size_words = os::vm_page_size() / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1303 size_t size_delta_words = align_size_up(word_size, page_size_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1304 size_t delta_words = MAX2(size_delta_words, min_delta_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1305 if (delta_words > min_delta_words) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1306 // Don't want to hit the high water mark on the next
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1307 // allocation so make the delta greater than just enough
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1308 // for this allocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1309 delta_words = MAX2(delta_words, max_delta_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1310 if (delta_words > max_delta_words) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1311 // This allocation is large but the next ones are probably not
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1312 // so increase by the minimum.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1313 delta_words = delta_words + min_delta_words;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1314 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1315 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1316 return delta_words;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1317 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1318
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1319 bool MetaspaceGC::should_expand(VirtualSpaceList* vsl, size_t word_size) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1320
8790 7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1321 // If the user wants a limit, impose one.
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1322 // The reason for someone using this flag is to limit reserved space. So
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1323 // for non-class virtual space, compare against virtual spaces that are reserved.
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1324 // For class virtual space, we only compare against the committed space, not
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1325 // reserved space, because this is a larger space prereserved for compressed
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1326 // class pointers.
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1327 if (!FLAG_IS_DEFAULT(MaxMetaspaceSize)) {
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1328 size_t real_allocated = Metaspace::space_list()->virtual_space_total() +
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1329 MetaspaceAux::allocated_capacity_bytes(Metaspace::ClassType);
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1330 if (real_allocated >= MaxMetaspaceSize) {
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1331 return false;
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1332 }
8790 7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1333 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1334
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1335 // Class virtual space should always be expanded. Call GC for the other
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1336 // metadata virtual space.
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	1337 if (Metaspace::using_class_space() &&
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	1338 (vsl == Metaspace::class_space_list())) return true;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1339
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1340 // If this is part of an allocation after a GC, expand
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1341 // unconditionally.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1342 if (MetaspaceGC::expand_after_GC()) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1343 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1344 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1345
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1346
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1347 // If the capacity is below the minimum capacity, allow the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1348 // expansion. Also set the high-water-mark (capacity_until_GC)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1349 // to that minimum capacity so that a GC will not be induced
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1350 // until that minimum capacity is exceeded.
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1351 size_t committed_capacity_bytes = MetaspaceAux::allocated_capacity_bytes();
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1352 size_t metaspace_size_bytes = MetaspaceSize;
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1353 if (committed_capacity_bytes < metaspace_size_bytes \|\|
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1354 capacity_until_GC() == 0) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1355 set_capacity_until_GC(metaspace_size_bytes);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1356 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1357 } else {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1358 if (committed_capacity_bytes < capacity_until_GC()) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1359 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1360 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1361 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1362 gclog_or_tty->print_cr(" allocation request size " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1363 " capacity_until_GC " SIZE_FORMAT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1364 " allocated_capacity_bytes " SIZE_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1365 word_size,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1366 capacity_until_GC(),
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1367 MetaspaceAux::allocated_capacity_bytes());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1368 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1369 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1370 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1371 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1372 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1373
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1374
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1375
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1376 void MetaspaceGC::compute_new_size() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1377 assert(_shrink_factor <= 100, "invalid shrink factor");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1378 uint current_shrink_factor = _shrink_factor;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1379 _shrink_factor = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1380
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1381 // Until a faster way of calculating the "used" quantity is implemented,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1382 // use "capacity".
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1383 const size_t used_after_gc = MetaspaceAux::allocated_capacity_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1384 const size_t capacity_until_GC = MetaspaceGC::capacity_until_GC();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1385
8040 a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1386 const double minimum_free_percentage = MinMetaspaceFreeRatio / 100.0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1387 const double maximum_used_percentage = 1.0 - minimum_free_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1388
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1389 const double min_tmp = used_after_gc / maximum_used_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1390 size_t minimum_desired_capacity =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1391 (size_t)MIN2(min_tmp, double(max_uintx));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1392 // Don't shrink less than the initial generation size
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1393 minimum_desired_capacity = MAX2(minimum_desired_capacity,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1394 MetaspaceSize);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1395
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1396 if (PrintGCDetails && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1397 gclog_or_tty->print_cr("\nMetaspaceGC::compute_new_size: ");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1398 gclog_or_tty->print_cr(" "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1399 " minimum_free_percentage: %6.2f"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1400 " maximum_used_percentage: %6.2f",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1401 minimum_free_percentage,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1402 maximum_used_percentage);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1403 gclog_or_tty->print_cr(" "
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1404 " used_after_gc : %6.1fKB",
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1405 used_after_gc / (double) K);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1406 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1407
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1408
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1409 size_t shrink_bytes = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1410 if (capacity_until_GC < minimum_desired_capacity) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1411 // If we have less capacity below the metaspace HWM, then
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1412 // increment the HWM.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1413 size_t expand_bytes = minimum_desired_capacity - capacity_until_GC;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1414 // Don't expand unless it's significant
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1415 if (expand_bytes >= MinMetaspaceExpansion) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1416 MetaspaceGC::set_capacity_until_GC(capacity_until_GC + expand_bytes);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1417 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1418 if (PrintGCDetails && Verbose) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1419 size_t new_capacity_until_GC = capacity_until_GC;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1420 gclog_or_tty->print_cr(" expanding:"
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1421 " minimum_desired_capacity: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1422 " expand_bytes: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1423 " MinMetaspaceExpansion: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1424 " new metaspace HWM: %6.1fKB",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1425 minimum_desired_capacity / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1426 expand_bytes / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1427 MinMetaspaceExpansion / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1428 new_capacity_until_GC / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1429 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1430 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1431 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1432
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1433 // No expansion, now see if we want to shrink
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1434 // We would never want to shrink more than this
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1435 size_t max_shrink_bytes = capacity_until_GC - minimum_desired_capacity;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1436 assert(max_shrink_bytes >= 0, err_msg("max_shrink_bytes " SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1437 max_shrink_bytes));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1438
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1439 // Should shrinking be considered?
8040 a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1440 if (MaxMetaspaceFreeRatio < 100) {
a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1441 const double maximum_free_percentage = MaxMetaspaceFreeRatio / 100.0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1442 const double minimum_used_percentage = 1.0 - maximum_free_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1443 const double max_tmp = used_after_gc / minimum_used_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1444 size_t maximum_desired_capacity = (size_t)MIN2(max_tmp, double(max_uintx));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1445 maximum_desired_capacity = MAX2(maximum_desired_capacity,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1446 MetaspaceSize);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1447 if (PrintGCDetails && Verbose) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1448 gclog_or_tty->print_cr(" "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1449 " maximum_free_percentage: %6.2f"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1450 " minimum_used_percentage: %6.2f",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1451 maximum_free_percentage,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1452 minimum_used_percentage);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1453 gclog_or_tty->print_cr(" "
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1454 " minimum_desired_capacity: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1455 " maximum_desired_capacity: %6.1fKB",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1456 minimum_desired_capacity / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1457 maximum_desired_capacity / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1458 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1459
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1460 assert(minimum_desired_capacity <= maximum_desired_capacity,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1461 "sanity check");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1462
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1463 if (capacity_until_GC > maximum_desired_capacity) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1464 // Capacity too large, compute shrinking size
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1465 shrink_bytes = capacity_until_GC - maximum_desired_capacity;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1466 // We don't want shrink all the way back to initSize if people call
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1467 // System.gc(), because some programs do that between "phases" and then
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1468 // we'd just have to grow the heap up again for the next phase. So we
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1469 // damp the shrinking: 0% on the first call, 10% on the second call, 40%
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1470 // on the third call, and 100% by the fourth call. But if we recompute
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1471 // size without shrinking, it goes back to 0%.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1472 shrink_bytes = shrink_bytes / 100 * current_shrink_factor;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1473 assert(shrink_bytes <= max_shrink_bytes,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1474 err_msg("invalid shrink size " SIZE_FORMAT " not <= " SIZE_FORMAT,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1475 shrink_bytes, max_shrink_bytes));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1476 if (current_shrink_factor == 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1477 _shrink_factor = 10;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1478 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1479 _shrink_factor = MIN2(current_shrink_factor * 4, (uint) 100);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1480 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1481 if (PrintGCDetails && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1482 gclog_or_tty->print_cr(" "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1483 " shrinking:"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1484 " initSize: %.1fK"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1485 " maximum_desired_capacity: %.1fK",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1486 MetaspaceSize / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1487 maximum_desired_capacity / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1488 gclog_or_tty->print_cr(" "
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1489 " shrink_bytes: %.1fK"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1490 " current_shrink_factor: %d"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1491 " new shrink factor: %d"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1492 " MinMetaspaceExpansion: %.1fK",
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1493 shrink_bytes / (double) K,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1494 current_shrink_factor,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1495 _shrink_factor,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1496 MinMetaspaceExpansion / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1497 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1498 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1499 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1500
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1501 // Don't shrink unless it's significant
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1502 if (shrink_bytes >= MinMetaspaceExpansion &&
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1503 ((capacity_until_GC - shrink_bytes) >= MetaspaceSize)) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1504 MetaspaceGC::set_capacity_until_GC(capacity_until_GC - shrink_bytes);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1505 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1506 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1507
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1508 // Metadebug methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1509
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1510 void Metadebug::deallocate_chunk_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1511 size_t chunk_word_size){
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1512 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1513 VirtualSpaceList* vsl = sm->vs_list();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1514 if (MetaDataDeallocateALot &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1515 Metadebug::deallocate_chunk_a_lot_count() % MetaDataDeallocateALotInterval == 0 ) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1516 Metadebug::reset_deallocate_chunk_a_lot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1517 for (uint i = 0; i < metadata_deallocate_a_lock_chunk; i++) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1518 Metachunk* dummy_chunk = vsl->current_virtual_space()->take_from_committed(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1519 if (dummy_chunk == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1520 break;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1521 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1522 vsl->chunk_manager()->chunk_freelist_deallocate(dummy_chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1523
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1524 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1525 gclog_or_tty->print("Metadebug::deallocate_chunk_a_lot: %d) ",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1526 sm->sum_count_in_chunks_in_use());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1527 dummy_chunk->print_on(gclog_or_tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1528 gclog_or_tty->print_cr(" Free chunks total %d count %d",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1529 vsl->chunk_manager()->free_chunks_total(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1530 vsl->chunk_manager()->free_chunks_count());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1531 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1532 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1533 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1534 Metadebug::inc_deallocate_chunk_a_lot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1535 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1536 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1537 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1538
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1539 void Metadebug::deallocate_block_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1540 size_t raw_word_size){
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1541 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1542 if (MetaDataDeallocateALot &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1543 Metadebug::deallocate_block_a_lot_count() % MetaDataDeallocateALotInterval == 0 ) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1544 Metadebug::set_deallocate_block_a_lot_count(0);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1545 for (uint i = 0; i < metadata_deallocate_a_lot_block; i++) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1546 MetaWord* dummy_block = sm->allocate_work(raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1547 if (dummy_block == 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1548 break;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1549 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1550 sm->deallocate(dummy_block, raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1551 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1552 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1553 Metadebug::inc_deallocate_block_a_lot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1554 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1555 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1556 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1557
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1558 void Metadebug::init_allocation_fail_alot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1559 if (MetadataAllocationFailALot) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1560 _allocation_fail_alot_count =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1561 1+(long)((double)MetadataAllocationFailALotInterval*os::random()/(max_jint+1.0));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1562 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1563 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1564
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1565 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1566 bool Metadebug::test_metadata_failure() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1567 if (MetadataAllocationFailALot &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1568 Threads::is_vm_complete()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1569 if (_allocation_fail_alot_count > 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1570 _allocation_fail_alot_count--;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1571 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1572 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1573 gclog_or_tty->print_cr("Metadata allocation failing for "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1574 "MetadataAllocationFailALot");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1575 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1576 init_allocation_fail_alot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1577 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1578 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1579 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1580 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1581 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1582 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1583
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1584 // ChunkManager methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1585
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1586 size_t ChunkManager::free_chunks_total() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1587 return _free_chunks_total;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1588 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1589
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1590 size_t ChunkManager::free_chunks_total_in_bytes() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1591 return free_chunks_total() * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1592 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1593
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1594 size_t ChunkManager::free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1595 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1596 if (!UseConcMarkSweepGC && !SpaceManager::expand_lock()->is_locked()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1597 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1598 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1599 // This lock is only needed in debug because the verification
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1600 // of the _free_chunks_totals walks the list of free chunks
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1601 slow_locked_verify_free_chunks_count();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1602 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1603 #endif
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1604 return _free_chunks_count;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1605 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1606
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1607 void ChunkManager::locked_verify_free_chunks_total() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1608 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1609 assert(sum_free_chunks() == _free_chunks_total,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1610 err_msg("_free_chunks_total " SIZE_FORMAT " is not the"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1611 " same as sum " SIZE_FORMAT, _free_chunks_total,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1612 sum_free_chunks()));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1613 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1614
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1615 void ChunkManager::verify_free_chunks_total() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1616 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1617 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1618 locked_verify_free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1619 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1620
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1621 void ChunkManager::locked_verify_free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1622 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1623 assert(sum_free_chunks_count() == _free_chunks_count,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1624 err_msg("_free_chunks_count " SIZE_FORMAT " is not the"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1625 " same as sum " SIZE_FORMAT, _free_chunks_count,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1626 sum_free_chunks_count()));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1627 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1628
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1629 void ChunkManager::verify_free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1630 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1631 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1632 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1633 locked_verify_free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1634 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1635 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1636
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1637 void ChunkManager::verify() {
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1638 MutexLockerEx cl(SpaceManager::expand_lock(),
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1639 Mutex::_no_safepoint_check_flag);
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1640 locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1641 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1642
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1643 void ChunkManager::locked_verify() {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1644 locked_verify_free_chunks_count();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1645 locked_verify_free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1646 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1647
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1648 void ChunkManager::locked_print_free_chunks(outputStream* st) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1649 assert_lock_strong(SpaceManager::expand_lock());
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1650 st->print_cr("Free chunk total " SIZE_FORMAT " count " SIZE_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1651 _free_chunks_total, _free_chunks_count);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1652 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1653
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1654 void ChunkManager::locked_print_sum_free_chunks(outputStream* st) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1655 assert_lock_strong(SpaceManager::expand_lock());
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1656 st->print_cr("Sum free chunk total " SIZE_FORMAT " count " SIZE_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1657 sum_free_chunks(), sum_free_chunks_count());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1658 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1659 ChunkList* ChunkManager::free_chunks(ChunkIndex index) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1660 return &_free_chunks[index];
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1661 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1662
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1663 // These methods that sum the free chunk lists are used in printing
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1664 // methods that are used in product builds.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1665 size_t ChunkManager::sum_free_chunks() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1666 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1667 size_t result = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1668 for (ChunkIndex i = ZeroIndex; i < NumberOfFreeLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1669 ChunkList* list = free_chunks(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1670
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1671 if (list == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1672 continue;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1673 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1674
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1675 result = result + list->count() * list->size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1676 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1677 result = result + humongous_dictionary()->total_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1678 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1679 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1680
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1681 size_t ChunkManager::sum_free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1682 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1683 size_t count = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1684 for (ChunkIndex i = ZeroIndex; i < NumberOfFreeLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1685 ChunkList* list = free_chunks(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1686 if (list == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1687 continue;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1688 }
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1689 count = count + list->count();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1690 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1691 count = count + humongous_dictionary()->total_free_blocks();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1692 return count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1693 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1694
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1695 ChunkList* ChunkManager::find_free_chunks_list(size_t word_size) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1696 ChunkIndex index = list_index(word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1697 assert(index < HumongousIndex, "No humongous list");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1698 return free_chunks(index);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1699 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1700
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1701 void ChunkManager::free_chunks_put(Metachunk* chunk) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1702 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1703 ChunkList* free_list = find_free_chunks_list(chunk->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1704 chunk->set_next(free_list->head());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1705 free_list->set_head(chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1706 // chunk is being returned to the chunk free list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1707 inc_free_chunks_total(chunk->capacity_word_size());
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1708 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1709 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1710
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1711 void ChunkManager::chunk_freelist_deallocate(Metachunk* chunk) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1712 // The deallocation of a chunk originates in the freelist
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1713 // manangement code for a Metaspace and does not hold the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1714 // lock.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1715 assert(chunk != NULL, "Deallocating NULL");
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1716 assert_lock_strong(SpaceManager::expand_lock());
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1717 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1718 if (TraceMetadataChunkAllocation) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1719 tty->print_cr("ChunkManager::chunk_freelist_deallocate: chunk "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1720 PTR_FORMAT " size " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1721 chunk, chunk->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1722 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1723 free_chunks_put(chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1724 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1725
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1726 Metachunk* ChunkManager::free_chunks_get(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1727 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1728
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1729 slow_locked_verify();
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1730
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1731 Metachunk* chunk = NULL;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1732 if (list_index(word_size) != HumongousIndex) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1733 ChunkList* free_list = find_free_chunks_list(word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1734 assert(free_list != NULL, "Sanity check");
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1735
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1736 chunk = free_list->head();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1737 debug_only(Metachunk* debug_head = chunk;)
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1738
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1739 if (chunk == NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1740 return NULL;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1741 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1742
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1743 // Remove the chunk as the head of the list.
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1744 free_list->remove_chunk(chunk);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1745
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1746 // Chunk is being removed from the chunks free list.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1747 dec_free_chunks_total(chunk->capacity_word_size());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1748
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1749 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1750 tty->print_cr("ChunkManager::free_chunks_get: free_list "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1751 PTR_FORMAT " head " PTR_FORMAT " size " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1752 free_list, chunk, chunk->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1753 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1754 } else {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1755 chunk = humongous_dictionary()->get_chunk(
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1756 word_size,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1757 FreeBlockDictionary<Metachunk>::atLeast);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1758
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1759 if (chunk != NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1760 if (TraceMetadataHumongousAllocation) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1761 size_t waste = chunk->word_size() - word_size;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1762 tty->print_cr("Free list allocate humongous chunk size " SIZE_FORMAT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1763 " for requested size " SIZE_FORMAT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1764 " waste " SIZE_FORMAT,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1765 chunk->word_size(), word_size, waste);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1766 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1767 // Chunk is being removed from the chunks free list.
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1768 dec_free_chunks_total(chunk->capacity_word_size());
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1769 } else {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1770 return NULL;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1771 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1772 }
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1773
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1774 // Remove it from the links to this freelist
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1775 chunk->set_next(NULL);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1776 chunk->set_prev(NULL);
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1777 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1778 // Chunk is no longer on any freelist. Setting to false make container_count_slow()
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1779 // work.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1780 chunk->set_is_free(false);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1781 #endif
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1782 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1783 return chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1784 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1785
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1786 Metachunk* ChunkManager::chunk_freelist_allocate(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1787 assert_lock_strong(SpaceManager::expand_lock());
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1788 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1789
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1790 // Take from the beginning of the list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1791 Metachunk* chunk = free_chunks_get(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1792 if (chunk == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1793 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1794 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1795
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1796 assert((word_size <= chunk->word_size()) \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1797 list_index(chunk->word_size() == HumongousIndex),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1798 "Non-humongous variable sized chunk");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1799 if (TraceMetadataChunkAllocation) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1800 size_t list_count;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1801 if (list_index(word_size) < HumongousIndex) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1802 ChunkList* list = find_free_chunks_list(word_size);
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1803 list_count = list->count();
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1804 } else {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1805 list_count = humongous_dictionary()->total_count();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1806 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1807 tty->print("ChunkManager::chunk_freelist_allocate: " PTR_FORMAT " chunk "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1808 PTR_FORMAT " size " SIZE_FORMAT " count " SIZE_FORMAT " ",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1809 this, chunk, chunk->word_size(), list_count);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1810 locked_print_free_chunks(tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1811 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1812
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1813 return chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1814 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1815
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1816 void ChunkManager::print_on(outputStream* out) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1817 if (PrintFLSStatistics != 0) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1818 humongous_dictionary()->report_statistics();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1819 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1820 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1821
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1822 // SpaceManager methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1823
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1824 void SpaceManager::get_initial_chunk_sizes(Metaspace::MetaspaceType type,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1825 size_t* chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1826 size_t* class_chunk_word_size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1827 switch (type) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1828 case Metaspace::BootMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1829 *chunk_word_size = Metaspace::first_chunk_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1830 *class_chunk_word_size = Metaspace::first_class_chunk_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1831 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1832 case Metaspace::ROMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1833 *chunk_word_size = SharedReadOnlySize / wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1834 *class_chunk_word_size = ClassSpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1835 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1836 case Metaspace::ReadWriteMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1837 *chunk_word_size = SharedReadWriteSize / wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1838 *class_chunk_word_size = ClassSpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1839 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1840 case Metaspace::AnonymousMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1841 case Metaspace::ReflectionMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1842 *chunk_word_size = SpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1843 *class_chunk_word_size = ClassSpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1844 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1845 default:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1846 *chunk_word_size = SmallChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1847 *class_chunk_word_size = ClassSmallChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1848 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1849 }
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	1850 assert(chunk_word_size != 0 && class_chunk_word_size != 0,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1851 err_msg("Initial chunks sizes bad: data " SIZE_FORMAT
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1852 " class " SIZE_FORMAT,
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	1853 chunk_word_size, class_chunk_word_size));
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1854 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1855
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1856 size_t SpaceManager::sum_free_in_chunks_in_use() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1857 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1858 size_t free = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1859 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1860 Metachunk* chunk = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1861 while (chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1862 free += chunk->free_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1863 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1864 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1865 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1866 return free;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1867 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1868
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1869 size_t SpaceManager::sum_waste_in_chunks_in_use() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1870 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1871 size_t result = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1872 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1873 result += sum_waste_in_chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1874 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1875
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1876 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1877 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1878
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1879 size_t SpaceManager::sum_waste_in_chunks_in_use(ChunkIndex index) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1880 size_t result = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1881 Metachunk* chunk = chunks_in_use(index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1882 // Count the free space in all the chunk but not the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1883 // current chunk from which allocations are still being done.
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1884 while (chunk != NULL) {
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1885 if (chunk != current_chunk()) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1886 result += chunk->free_word_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1887 }
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1888 chunk = chunk->next();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1889 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1890 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1891 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1892
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1893 size_t SpaceManager::sum_capacity_in_chunks_in_use() const {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1894 // For CMS use "allocated_chunks_words()" which does not need the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1895 // Metaspace lock. For the other collectors sum over the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1896 // lists. Use both methods as a check that "allocated_chunks_words()"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1897 // is correct. That is, sum_capacity_in_chunks() is too expensive
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1898 // to use in the product and allocated_chunks_words() should be used
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1899 // but allow for checking that allocated_chunks_words() returns the same
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1900 // value as sum_capacity_in_chunks_in_use() which is the definitive
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1901 // answer.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1902 if (UseConcMarkSweepGC) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1903 return allocated_chunks_words();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1904 } else {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1905 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1906 size_t sum = 0;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1907 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1908 Metachunk* chunk = chunks_in_use(i);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1909 while (chunk != NULL) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1910 sum += chunk->capacity_word_size();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1911 chunk = chunk->next();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1912 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1913 }
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1914 return sum;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1915 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1916 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1917
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1918 size_t SpaceManager::sum_count_in_chunks_in_use() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1919 size_t count = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1920 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1921 count = count + sum_count_in_chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1922 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1923
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1924 return count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1925 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1926
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1927 size_t SpaceManager::sum_count_in_chunks_in_use(ChunkIndex i) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1928 size_t count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1929 Metachunk* chunk = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1930 while (chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1931 count++;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1932 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1933 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1934 return count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1935 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1936
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1937
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1938 size_t SpaceManager::sum_used_in_chunks_in_use() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1939 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1940 size_t used = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1941 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1942 Metachunk* chunk = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1943 while (chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1944 used += chunk->used_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1945 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1946 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1947 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1948 return used;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1949 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1950
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1951 void SpaceManager::locked_print_chunks_in_use_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1952
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1953 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1954 Metachunk* chunk = chunks_in_use(i);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1955 st->print("SpaceManager: %s " PTR_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1956 chunk_size_name(i), chunk);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1957 if (chunk != NULL) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1958 st->print_cr(" free " SIZE_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1959 chunk->free_word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1960 } else {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1961 st->print_cr("");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1962 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1963 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1964
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1965 vs_list()->chunk_manager()->locked_print_free_chunks(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1966 vs_list()->chunk_manager()->locked_print_sum_free_chunks(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1967 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1968
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1969 size_t SpaceManager::calc_chunk_size(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1970
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1971 // Decide between a small chunk and a medium chunk. Up to
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1972 // _small_chunk_limit small chunks can be allocated but
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1973 // once a medium chunk has been allocated, no more small
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1974 // chunks will be allocated.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1975 size_t chunk_word_size;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1976 if (chunks_in_use(MediumIndex) == NULL &&
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	1977 sum_count_in_chunks_in_use(SmallIndex) < _small_chunk_limit) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1978 chunk_word_size = (size_t) small_chunk_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1979 if (word_size + Metachunk::overhead() > small_chunk_size()) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1980 chunk_word_size = medium_chunk_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1981 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1982 } else {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1983 chunk_word_size = medium_chunk_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1984 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1985
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1986 // Might still need a humongous chunk. Enforce an
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1987 // eight word granularity to facilitate reuse (some
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1988 // wastage but better chance of reuse).
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1989 size_t if_humongous_sized_chunk =
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1990 align_size_up(word_size + Metachunk::overhead(),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1991 HumongousChunkGranularity);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1992 chunk_word_size =
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1993 MAX2((size_t) chunk_word_size, if_humongous_sized_chunk);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1994
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1995 assert(!SpaceManager::is_humongous(word_size) \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1996 chunk_word_size == if_humongous_sized_chunk,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1997 err_msg("Size calculation is wrong, word_size " SIZE_FORMAT
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1998 " chunk_word_size " SIZE_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1999 word_size, chunk_word_size));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2000 if (TraceMetadataHumongousAllocation &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2001 SpaceManager::is_humongous(word_size)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2002 gclog_or_tty->print_cr("Metadata humongous allocation:");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2003 gclog_or_tty->print_cr(" word_size " PTR_FORMAT, word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2004 gclog_or_tty->print_cr(" chunk_word_size " PTR_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2005 chunk_word_size);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2006 gclog_or_tty->print_cr(" chunk overhead " PTR_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2007 Metachunk::overhead());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2008 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2009 return chunk_word_size;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2010 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2011
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2012 MetaWord* SpaceManager::grow_and_allocate(size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2013 assert(vs_list()->current_virtual_space() != NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2014 "Should have been set");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2015 assert(current_chunk() == NULL \|\|
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2016 current_chunk()->allocate(word_size) == NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2017 "Don't need to expand");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2018 MutexLockerEx cl(SpaceManager::expand_lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2019
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2020 if (TraceMetadataChunkAllocation && Verbose) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2021 size_t words_left = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2022 size_t words_used = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2023 if (current_chunk() != NULL) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2024 words_left = current_chunk()->free_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2025 words_used = current_chunk()->used_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2026 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2027 gclog_or_tty->print_cr("SpaceManager::grow_and_allocate for " SIZE_FORMAT
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2028 " words " SIZE_FORMAT " words used " SIZE_FORMAT
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2029 " words left",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2030 word_size, words_used, words_left);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2031 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2032
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2033 // Get another chunk out of the virtual space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2034 size_t grow_chunks_by_words = calc_chunk_size(word_size);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2035 Metachunk* next = get_new_chunk(word_size, grow_chunks_by_words);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2036
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2037 // If a chunk was available, add it to the in-use chunk list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2038 // and do an allocation from it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2039 if (next != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2040 Metadebug::deallocate_chunk_a_lot(this, grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2041 // Add to this manager's list of chunks in use.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2042 add_chunk(next, false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2043 return next->allocate(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2044 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2045 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2046 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2047
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2048 void SpaceManager::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2049
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2050 for (ChunkIndex i = ZeroIndex;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2051 i < NumberOfInUseLists ;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2052 i = next_chunk_index(i) ) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2053 st->print_cr(" chunks_in_use " PTR_FORMAT " chunk size " PTR_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2054 chunks_in_use(i),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2055 chunks_in_use(i) == NULL ? 0 : chunks_in_use(i)->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2056 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2057 st->print_cr(" waste: Small " SIZE_FORMAT " Medium " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2058 " Humongous " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2059 sum_waste_in_chunks_in_use(SmallIndex),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2060 sum_waste_in_chunks_in_use(MediumIndex),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2061 sum_waste_in_chunks_in_use(HumongousIndex));
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2062 // block free lists
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2063 if (block_freelists() != NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2064 st->print_cr("total in block free lists " SIZE_FORMAT,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2065 block_freelists()->total_size());
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2066 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2067 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2068
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2069 SpaceManager::SpaceManager(Metaspace::MetadataType mdtype,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2070 Mutex* lock,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2071 VirtualSpaceList* vs_list) :
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2072 _vs_list(vs_list),
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2073 _mdtype(mdtype),
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2074 _allocated_blocks_words(0),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2075 _allocated_chunks_words(0),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2076 _allocated_chunks_count(0),
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2077 _lock(lock)
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2078 {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2079 initialize();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2080 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2081
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2082 void SpaceManager::inc_size_metrics(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2083 assert_lock_strong(SpaceManager::expand_lock());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2084 // Total of allocated Metachunks and allocated Metachunks count
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2085 // for each SpaceManager
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2086 _allocated_chunks_words = _allocated_chunks_words + words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2087 _allocated_chunks_count++;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2088 // Global total of capacity in allocated Metachunks
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2089 MetaspaceAux::inc_capacity(mdtype(), words);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2090 // Global total of allocated Metablocks.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2091 // used_words_slow() includes the overhead in each
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2092 // Metachunk so include it in the used when the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2093 // Metachunk is first added (so only added once per
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2094 // Metachunk).
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2095 MetaspaceAux::inc_used(mdtype(), Metachunk::overhead());
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2096 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2097
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2098 void SpaceManager::inc_used_metrics(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2099 // Add to the per SpaceManager total
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2100 Atomic::add_ptr(words, &_allocated_blocks_words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2101 // Add to the global total
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2102 MetaspaceAux::inc_used(mdtype(), words);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2103 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2104
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2105 void SpaceManager::dec_total_from_size_metrics() {
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2106 MetaspaceAux::dec_capacity(mdtype(), allocated_chunks_words());
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2107 MetaspaceAux::dec_used(mdtype(), allocated_blocks_words());
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2108 // Also deduct the overhead per Metachunk
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2109 MetaspaceAux::dec_used(mdtype(), allocated_chunks_count() * Metachunk::overhead());
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2110 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2111
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2112 void SpaceManager::initialize() {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2113 Metadebug::init_allocation_fail_alot_count();
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2114 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2115 _chunks_in_use[i] = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2116 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2117 _current_chunk = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2118 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2119 gclog_or_tty->print_cr("SpaceManager(): " PTR_FORMAT, this);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2120 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2121 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2122
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2123 void ChunkManager::return_chunks(ChunkIndex index, Metachunk* chunks) {
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2124 if (chunks == NULL) {
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2125 return;
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2126 }
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2127 ChunkList* list = free_chunks(index);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2128 assert(list->size() == chunks->word_size(), "Mismatch in chunk sizes");
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2129 assert_lock_strong(SpaceManager::expand_lock());
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2130 Metachunk* cur = chunks;
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2131
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2132 // This returns chunks one at a time. If a new
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2133 // class List can be created that is a base class
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2134 // of FreeList then something like FreeList::prepend()
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2135 // can be used in place of this loop
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2136 while (cur != NULL) {
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2137 assert(cur->container() != NULL, "Container should have been set");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2138 cur->container()->dec_container_count();
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2139 // Capture the next link before it is changed
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2140 // by the call to return_chunk_at_head();
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2141 Metachunk* next = cur->next();
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2142 cur->set_is_free(true);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2143 list->return_chunk_at_head(cur);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2144 cur = next;
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2145 }
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2146 }
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2147
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2148 SpaceManager::~SpaceManager() {
8784 79af1312fc2c 8005602: NPG: classunloading does not happen while CMS GC with -XX:+CMSClassUnloadingEnabled is used mgerdin parents: 8738 diff changeset	2149 // This call this->_lock which can't be done while holding expand_lock()
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2150 assert(sum_capacity_in_chunks_in_use() == allocated_chunks_words(),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2151 err_msg("sum_capacity_in_chunks_in_use() " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2152 " allocated_chunks_words() " SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2153 sum_capacity_in_chunks_in_use(), allocated_chunks_words()));
8784 79af1312fc2c 8005602: NPG: classunloading does not happen while CMS GC with -XX:+CMSClassUnloadingEnabled is used mgerdin parents: 8738 diff changeset	2154
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2155 MutexLockerEx fcl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2156 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2157
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2158 ChunkManager* chunk_manager = vs_list()->chunk_manager();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2159
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2160 chunk_manager->slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2161
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2162 dec_total_from_size_metrics();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2163
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2164 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2165 gclog_or_tty->print_cr("~SpaceManager(): " PTR_FORMAT, this);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2166 locked_print_chunks_in_use_on(gclog_or_tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2167 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2168
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2169 // Do not mangle freed Metachunks. The chunk size inside Metachunks
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2170 // is during the freeing of a VirtualSpaceNodes.
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	2171
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2172 // Have to update before the chunks_in_use lists are emptied
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2173 // below.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2174 chunk_manager->inc_free_chunks_total(allocated_chunks_words(),
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2175 sum_count_in_chunks_in_use());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2176
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2177 // Add all the chunks in use by this space manager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2178 // to the global list of free chunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2179
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2180 // Follow each list of chunks-in-use and add them to the
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2181 // free lists. Each list is NULL terminated.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2182
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2183 for (ChunkIndex i = ZeroIndex; i < HumongousIndex; i = next_chunk_index(i)) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2184 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2185 gclog_or_tty->print_cr("returned %d %s chunks to freelist",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2186 sum_count_in_chunks_in_use(i),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2187 chunk_size_name(i));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2188 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2189 Metachunk* chunks = chunks_in_use(i);
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2190 chunk_manager->return_chunks(i, chunks);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2191 set_chunks_in_use(i, NULL);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2192 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2193 gclog_or_tty->print_cr("updated freelist count %d %s",
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2194 chunk_manager->free_chunks(i)->count(),
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2195 chunk_size_name(i));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2196 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2197 assert(i != HumongousIndex, "Humongous chunks are handled explicitly later");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2198 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2199
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2200 // The medium chunk case may be optimized by passing the head and
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2201 // tail of the medium chunk list to add_at_head(). The tail is often
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2202 // the current chunk but there are probably exceptions.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2203
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2204 // Humongous chunks
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2205 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2206 gclog_or_tty->print_cr("returned %d %s humongous chunks to dictionary",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2207 sum_count_in_chunks_in_use(HumongousIndex),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2208 chunk_size_name(HumongousIndex));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2209 gclog_or_tty->print("Humongous chunk dictionary: ");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2210 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2211 // Humongous chunks are never the current chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2212 Metachunk* humongous_chunks = chunks_in_use(HumongousIndex);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2213
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2214 while (humongous_chunks != NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2215 #ifdef ASSERT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2216 humongous_chunks->set_is_free(true);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2217 #endif
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2218 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2219 gclog_or_tty->print(PTR_FORMAT " (" SIZE_FORMAT ") ",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2220 humongous_chunks,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2221 humongous_chunks->word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2222 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2223 assert(humongous_chunks->word_size() == (size_t)
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2224 align_size_up(humongous_chunks->word_size(),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2225 HumongousChunkGranularity),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2226 err_msg("Humongous chunk size is wrong: word size " SIZE_FORMAT
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2227 " granularity %d",
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2228 humongous_chunks->word_size(), HumongousChunkGranularity));
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2229 Metachunk* next_humongous_chunks = humongous_chunks->next();
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2230 humongous_chunks->container()->dec_container_count();
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2231 chunk_manager->humongous_dictionary()->return_chunk(humongous_chunks);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2232 humongous_chunks = next_humongous_chunks;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2233 }
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2234 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2235 gclog_or_tty->print_cr("");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2236 gclog_or_tty->print_cr("updated dictionary count %d %s",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2237 chunk_manager->humongous_dictionary()->total_count(),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2238 chunk_size_name(HumongousIndex));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2239 }
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2240 chunk_manager->slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2241 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2242
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2243 const char* SpaceManager::chunk_size_name(ChunkIndex index) const {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2244 switch (index) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2245 case SpecializedIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2246 return "Specialized";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2247 case SmallIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2248 return "Small";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2249 case MediumIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2250 return "Medium";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2251 case HumongousIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2252 return "Humongous";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2253 default:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2254 return NULL;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2255 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2256 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2257
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2258 ChunkIndex ChunkManager::list_index(size_t size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2259 switch (size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2260 case SpecializedChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2261 assert(SpecializedChunk == ClassSpecializedChunk,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2262 "Need branch for ClassSpecializedChunk");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2263 return SpecializedIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2264 case SmallChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2265 case ClassSmallChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2266 return SmallIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2267 case MediumChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2268 case ClassMediumChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2269 return MediumIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2270 default:
7447 1de1b145f6bc 8005486: NPG: Incorrect assertion in ChunkManager::list_index() jmasa parents: 7446 diff changeset	2271 assert(size > MediumChunk \|\| size > ClassMediumChunk,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2272 "Not a humongous chunk");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2273 return HumongousIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2274 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2275 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2276
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2277 void SpaceManager::deallocate(MetaWord* p, size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2278 assert_lock_strong(_lock);
11966 83ca9dc4564d 8019845: Memory leak during class redefinition fparain parents: 11065 diff changeset	2279 size_t raw_word_size = get_raw_word_size(word_size);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2280 size_t min_size = TreeChunk<Metablock, FreeList>::min_size();
11966 83ca9dc4564d 8019845: Memory leak during class redefinition fparain parents: 11065 diff changeset	2281 assert(raw_word_size >= min_size,
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2282 err_msg("Should not deallocate dark matter " SIZE_FORMAT "<" SIZE_FORMAT, word_size, min_size));
11966 83ca9dc4564d 8019845: Memory leak during class redefinition fparain parents: 11065 diff changeset	2283 block_freelists()->return_block(p, raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2284 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2285
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2286 // Adds a chunk to the list of chunks in use.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2287 void SpaceManager::add_chunk(Metachunk* new_chunk, bool make_current) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2288
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2289 assert(new_chunk != NULL, "Should not be NULL");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2290 assert(new_chunk->next() == NULL, "Should not be on a list");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2291
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2292 new_chunk->reset_empty();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2293
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2294 // Find the correct list and and set the current
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2295 // chunk for that list.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2296 ChunkIndex index = ChunkManager::list_index(new_chunk->word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2297
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2298 if (index != HumongousIndex) {
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2299 retire_current_chunk();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2300 set_current_chunk(new_chunk);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2301 new_chunk->set_next(chunks_in_use(index));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2302 set_chunks_in_use(index, new_chunk);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2303 } else {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2304 // For null class loader data and DumpSharedSpaces, the first chunk isn't
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2305 // small, so small will be null. Link this first chunk as the current
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2306 // chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2307 if (make_current) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2308 // Set as the current chunk but otherwise treat as a humongous chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2309 set_current_chunk(new_chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2310 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2311 // Link at head. The _current_chunk only points to a humongous chunk for
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2312 // the null class loader metaspace (class and data virtual space managers)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2313 // any humongous chunks so will not point to the tail
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2314 // of the humongous chunks list.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2315 new_chunk->set_next(chunks_in_use(HumongousIndex));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2316 set_chunks_in_use(HumongousIndex, new_chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2317
7447 1de1b145f6bc 8005486: NPG: Incorrect assertion in ChunkManager::list_index() jmasa parents: 7446 diff changeset	2318 assert(new_chunk->word_size() > medium_chunk_size(), "List inconsistency");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2319 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2320
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2321 // Add to the running sum of capacity
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2322 inc_size_metrics(new_chunk->word_size());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2323
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2324 assert(new_chunk->is_empty(), "Not ready for reuse");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2325 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2326 gclog_or_tty->print("SpaceManager::add_chunk: %d) ",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2327 sum_count_in_chunks_in_use());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2328 new_chunk->print_on(gclog_or_tty);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2329 if (vs_list() != NULL) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2330 vs_list()->chunk_manager()->locked_print_free_chunks(tty);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2331 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2332 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2333 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2334
12231 24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2335 void SpaceManager::retire_current_chunk() {
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2336 if (current_chunk() != NULL) {
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2337 size_t remaining_words = current_chunk()->free_word_size();
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2338 if (remaining_words >= TreeChunk<Metablock, FreeList>::min_size()) {
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2339 block_freelists()->return_block(current_chunk()->allocate(remaining_words), remaining_words);
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2340 inc_used_metrics(remaining_words);
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2341 }
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2342 }
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2343 }
24e87613ee58 8009561: NPG: Metaspace fragmentation when retiring a Metachunk mgerdin parents: 12226 diff changeset	2344
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2345 Metachunk* SpaceManager::get_new_chunk(size_t word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2346 size_t grow_chunks_by_words) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2347
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2348 Metachunk* next = vs_list()->get_new_chunk(word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2349 grow_chunks_by_words,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2350 medium_chunk_bunch());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2351
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2352 if (TraceMetadataHumongousAllocation &&
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2353 SpaceManager::is_humongous(next->word_size())) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2354 gclog_or_tty->print_cr(" new humongous chunk word size " PTR_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2355 next->word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2356 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2357
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2358 return next;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2359 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2360
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2361 MetaWord* SpaceManager::allocate(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2362 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2363
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	2364 size_t raw_word_size = get_raw_word_size(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2365 BlockFreelist* fl = block_freelists();
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2366 MetaWord* p = NULL;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2367 // Allocation from the dictionary is expensive in the sense that
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2368 // the dictionary has to be searched for a size. Don't allocate
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2369 // from the dictionary until it starts to get fat. Is this
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2370 // a reasonable policy? Maybe an skinny dictionary is fast enough
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2371 // for allocations. Do some profiling. JJJ
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2372 if (fl->total_size() > allocation_from_dictionary_limit) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2373 p = fl->get_block(raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2374 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2375 if (p == NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2376 p = allocate_work(raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2377 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2378 Metadebug::deallocate_block_a_lot(this, raw_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2379
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2380 return p;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2381 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2382
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2383 // Returns the address of spaced allocated for "word_size".
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2384 // This methods does not know about blocks (Metablocks)
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2385 MetaWord* SpaceManager::allocate_work(size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2386 assert_lock_strong(_lock);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2387 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2388 if (Metadebug::test_metadata_failure()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2389 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2390 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2391 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2392 // Is there space in the current chunk?
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2393 MetaWord* result = NULL;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2394
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2395 // For DumpSharedSpaces, only allocate out of the current chunk which is
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2396 // never null because we gave it the size we wanted. Caller reports out
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2397 // of memory if this returns null.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2398 if (DumpSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2399 assert(current_chunk() != NULL, "should never happen");
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2400 inc_used_metrics(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2401 return current_chunk()->allocate(word_size); // caller handles null result
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2402 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2403 if (current_chunk() != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2404 result = current_chunk()->allocate(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2405 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2406
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2407 if (result == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2408 result = grow_and_allocate(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2409 }
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2410 if (result != 0) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2411 inc_used_metrics(word_size);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2412 assert(result != (MetaWord*) chunks_in_use(MediumIndex),
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2413 "Head of the list is being allocated");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2414 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2415
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2416 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2417 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2418
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2419 void SpaceManager::verify() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2420 // If there are blocks in the dictionary, then
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2421 // verfication of chunks does not work since
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2422 // being in the dictionary alters a chunk.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2423 if (block_freelists()->total_size() == 0) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2424 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2425 Metachunk* curr = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2426 while (curr != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2427 curr->verify();
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2428 verify_chunk_size(curr);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2429 curr = curr->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2430 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2431 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2432 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2433 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2434
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2435 void SpaceManager::verify_chunk_size(Metachunk* chunk) {
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2436 assert(is_humongous(chunk->word_size()) \|\|
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2437 chunk->word_size() == medium_chunk_size() \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2438 chunk->word_size() == small_chunk_size() \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2439 chunk->word_size() == specialized_chunk_size(),
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2440 "Chunk size is wrong");
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2441 return;
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2442 }
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2443
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2444 #ifdef ASSERT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2445 void SpaceManager::verify_allocated_blocks_words() {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2446 // Verification is only guaranteed at a safepoint.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2447 assert(SafepointSynchronize::is_at_safepoint() \|\| !Universe::is_fully_initialized(),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2448 "Verification can fail if the applications is running");
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2449 assert(allocated_blocks_words() == sum_used_in_chunks_in_use(),
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2450 err_msg("allocation total is not consistent " SIZE_FORMAT
d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2451 " vs " SIZE_FORMAT,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2452 allocated_blocks_words(), sum_used_in_chunks_in_use()));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2453 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2454
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2455 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2456
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2457 void SpaceManager::dump(outputStream* const out) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2458 size_t curr_total = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2459 size_t waste = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2460 uint i = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2461 size_t used = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2462 size_t capacity = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2463
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2464 // Add up statistics for all chunks in this SpaceManager.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2465 for (ChunkIndex index = ZeroIndex;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2466 index < NumberOfInUseLists;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2467 index = next_chunk_index(index)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2468 for (Metachunk* curr = chunks_in_use(index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2469 curr != NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2470 curr = curr->next()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2471 out->print("%d) ", i++);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2472 curr->print_on(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2473 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2474 block_freelists()->print_on(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2475 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2476 curr_total += curr->word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2477 used += curr->used_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2478 capacity += curr->capacity_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2479 waste += curr->free_word_size() + curr->overhead();;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2480 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2481 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2482
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2483 size_t free = current_chunk() == NULL ? 0 : current_chunk()->free_word_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2484 // Free space isn't wasted.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2485 waste -= free;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2486
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2487 out->print_cr("total of all chunks " SIZE_FORMAT " used " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2488 " free " SIZE_FORMAT " capacity " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2489 " waste " SIZE_FORMAT, curr_total, used, free, capacity, waste);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2490 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2491
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	2492 #ifndef PRODUCT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2493 void SpaceManager::mangle_freed_chunks() {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2494 for (ChunkIndex index = ZeroIndex;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2495 index < NumberOfInUseLists;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2496 index = next_chunk_index(index)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2497 for (Metachunk* curr = chunks_in_use(index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2498 curr != NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2499 curr = curr->next()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2500 curr->mangle();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2501 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2502 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2503 }
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	2504 #endif // PRODUCT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2505
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2506 // MetaspaceAux
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2507
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2508
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2509 size_t MetaspaceAux::_allocated_capacity_words[] = {0, 0};
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2510 size_t MetaspaceAux::_allocated_used_words[] = {0, 0};
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2511
12063 1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2512 size_t MetaspaceAux::free_bytes(Metaspace::MetadataType mdtype) {
1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2513 VirtualSpaceList* list = Metaspace::get_space_list(mdtype);
1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2514 return list == NULL ? 0 : list->free_bytes();
1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2515 }
1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2516
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2517 size_t MetaspaceAux::free_bytes() {
12063 1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2518 return free_bytes(Metaspace::ClassType) + free_bytes(Metaspace::NonClassType);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2519 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2520
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2521 void MetaspaceAux::dec_capacity(Metaspace::MetadataType mdtype, size_t words) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2522 assert_lock_strong(SpaceManager::expand_lock());
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2523 assert(words <= allocated_capacity_words(mdtype),
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2524 err_msg("About to decrement below 0: words " SIZE_FORMAT
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2525 " is greater than _allocated_capacity_words[%u] " SIZE_FORMAT,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2526 words, mdtype, allocated_capacity_words(mdtype)));
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2527 _allocated_capacity_words[mdtype] -= words;
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2528 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2529
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2530 void MetaspaceAux::inc_capacity(Metaspace::MetadataType mdtype, size_t words) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2531 assert_lock_strong(SpaceManager::expand_lock());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2532 // Needs to be atomic
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2533 _allocated_capacity_words[mdtype] += words;
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2534 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2535
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2536 void MetaspaceAux::dec_used(Metaspace::MetadataType mdtype, size_t words) {
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2537 assert(words <= allocated_used_words(mdtype),
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2538 err_msg("About to decrement below 0: words " SIZE_FORMAT
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2539 " is greater than _allocated_used_words[%u] " SIZE_FORMAT,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2540 words, mdtype, allocated_used_words(mdtype)));
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2541 // For CMS deallocation of the Metaspaces occurs during the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2542 // sweep which is a concurrent phase. Protection by the expand_lock()
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2543 // is not enough since allocation is on a per Metaspace basis
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2544 // and protected by the Metaspace lock.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2545 jlong minus_words = (jlong) - (jlong) words;
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2546 Atomic::add_ptr(minus_words, &_allocated_used_words[mdtype]);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2547 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2548
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2549 void MetaspaceAux::inc_used(Metaspace::MetadataType mdtype, size_t words) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2550 // _allocated_used_words tracks allocations for
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2551 // each piece of metadata. Those allocations are
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2552 // generally done concurrently by different application
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2553 // threads so must be done atomically.
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2554 Atomic::add_ptr(words, &_allocated_used_words[mdtype]);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2555 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2556
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2557 size_t MetaspaceAux::used_bytes_slow(Metaspace::MetadataType mdtype) {
6730 5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2558 size_t used = 0;
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2559 ClassLoaderDataGraphMetaspaceIterator iter;
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2560 while (iter.repeat()) {
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2561 Metaspace* msp = iter.get_next();
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2562 // Sum allocated_blocks_words for each metaspace
6730 5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2563 if (msp != NULL) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2564 used += msp->used_words_slow(mdtype);
6730 5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2565 }
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2566 }
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2567 return used * BytesPerWord;
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2568 }
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2569
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2570 size_t MetaspaceAux::free_in_bytes(Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2571 size_t free = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2572 ClassLoaderDataGraphMetaspaceIterator iter;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2573 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2574 Metaspace* msp = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2575 if (msp != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2576 free += msp->free_words(mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2577 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2578 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2579 return free * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2580 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2581
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2582 size_t MetaspaceAux::capacity_bytes_slow(Metaspace::MetadataType mdtype) {
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2583 if ((mdtype == Metaspace::ClassType) && !Metaspace::using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2584 return 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2585 }
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2586 // Don't count the space in the freelists. That space will be
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2587 // added to the capacity calculation as needed.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2588 size_t capacity = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2589 ClassLoaderDataGraphMetaspaceIterator iter;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2590 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2591 Metaspace* msp = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2592 if (msp != NULL) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2593 capacity += msp->capacity_words_slow(mdtype);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2594 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2595 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2596 return capacity * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2597 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2598
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2599 size_t MetaspaceAux::reserved_in_bytes(Metaspace::MetadataType mdtype) {
12063 1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2600 VirtualSpaceList* list = Metaspace::get_space_list(mdtype);
1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2601 return list == NULL ? 0 : list->virtual_space_total();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2602 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2603
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2604 size_t MetaspaceAux::min_chunk_size() { return Metaspace::first_chunk_word_size(); }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2605
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2606 size_t MetaspaceAux::free_chunks_total(Metaspace::MetadataType mdtype) {
12063 1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2607 VirtualSpaceList* list = Metaspace::get_space_list(mdtype);
1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2608 if (list == NULL) {
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2609 return 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2610 }
12063 1a8fb39bdbc4 8014659: NPG: performance counters for compressed klass space ehelin parents: 12056 diff changeset	2611 ChunkManager* chunk = list->chunk_manager();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2612 chunk->slow_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2613 return chunk->free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2614 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2615
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2616 size_t MetaspaceAux::free_chunks_total_in_bytes(Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2617 return free_chunks_total(mdtype) * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2618 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2619
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2620 size_t MetaspaceAux::free_chunks_total() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2621 return free_chunks_total(Metaspace::ClassType) +
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2622 free_chunks_total(Metaspace::NonClassType);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2623 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2624
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2625 size_t MetaspaceAux::free_chunks_total_in_bytes() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2626 return free_chunks_total() * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2627 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2628
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2629 void MetaspaceAux::print_metaspace_change(size_t prev_metadata_used) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2630 gclog_or_tty->print(", [Metaspace:");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2631 if (PrintGCDetails && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2632 gclog_or_tty->print(" " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2633 "->" SIZE_FORMAT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2634 "(" SIZE_FORMAT ")",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2635 prev_metadata_used,
11037 df7e1c0e3dc1 8014546: MetaspaceAux print_metaspace_change() should print "used" after GC not capacity jmasa parents: 10376 diff changeset	2636 allocated_used_bytes(),
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2637 reserved_in_bytes());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2638 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2639 gclog_or_tty->print(" " SIZE_FORMAT "K"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2640 "->" SIZE_FORMAT "K"
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2641 "(" SIZE_FORMAT "K)",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2642 prev_metadata_used / K,
11037 df7e1c0e3dc1 8014546: MetaspaceAux print_metaspace_change() should print "used" after GC not capacity jmasa parents: 10376 diff changeset	2643 allocated_used_bytes() / K,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2644 reserved_in_bytes()/ K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2645 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2646
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2647 gclog_or_tty->print("]");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2648 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2649
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2650 // This is printed when PrintGCDetails
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2651 void MetaspaceAux::print_on(outputStream* out) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2652 Metaspace::MetadataType nct = Metaspace::NonClassType;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2653
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2654 out->print_cr(" Metaspace total "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2655 SIZE_FORMAT "K, used " SIZE_FORMAT "K,"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2656 " reserved " SIZE_FORMAT "K",
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2657 allocated_capacity_bytes()/K, allocated_used_bytes()/K, reserved_in_bytes()/K);
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2658
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2659 out->print_cr(" data space "
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2660 SIZE_FORMAT "K, used " SIZE_FORMAT "K,"
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2661 " reserved " SIZE_FORMAT "K",
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2662 allocated_capacity_bytes(nct)/K,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2663 allocated_used_bytes(nct)/K,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2664 reserved_in_bytes(nct)/K);
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2665 if (Metaspace::using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2666 Metaspace::MetadataType ct = Metaspace::ClassType;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2667 out->print_cr(" class space "
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2668 SIZE_FORMAT "K, used " SIZE_FORMAT "K,"
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2669 " reserved " SIZE_FORMAT "K",
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2670 allocated_capacity_bytes(ct)/K,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2671 allocated_used_bytes(ct)/K,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2672 reserved_in_bytes(ct)/K);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2673 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2674 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2675
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2676 // Print information for class space and data space separately.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2677 // This is almost the same as above.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2678 void MetaspaceAux::print_on(outputStream* out, Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2679 size_t free_chunks_capacity_bytes = free_chunks_total_in_bytes(mdtype);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2680 size_t capacity_bytes = capacity_bytes_slow(mdtype);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2681 size_t used_bytes = used_bytes_slow(mdtype);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2682 size_t free_bytes = free_in_bytes(mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2683 size_t used_and_free = used_bytes + free_bytes +
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2684 free_chunks_capacity_bytes;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2685 out->print_cr(" Chunk accounting: used in chunks " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2686 "K + unused in chunks " SIZE_FORMAT "K + "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2687 " capacity in free chunks " SIZE_FORMAT "K = " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2688 "K capacity in allocated chunks " SIZE_FORMAT "K",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2689 used_bytes / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2690 free_bytes / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2691 free_chunks_capacity_bytes / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2692 used_and_free / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2693 capacity_bytes / K);
8738 1c88b99a2b01 8009282: Assertion "assert(used_and_free == capacity_bytes) failed: Accounting is wrong" failed with -XX:+Verbose -XX:+TraceMetadataChunkAllocation mgerdin parents: 8040 diff changeset	2694 // Accounting can only be correct if we got the values during a safepoint
1c88b99a2b01 8009282: Assertion "assert(used_and_free == capacity_bytes) failed: Accounting is wrong" failed with -XX:+Verbose -XX:+TraceMetadataChunkAllocation mgerdin parents: 8040 diff changeset	2695 assert(!SafepointSynchronize::is_at_safepoint() \|\| used_and_free == capacity_bytes, "Accounting is wrong");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2696 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2697
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2698 // Print total fragmentation for class metaspaces
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2699 void MetaspaceAux::print_class_waste(outputStream* out) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2700 assert(Metaspace::using_class_space(), "class metaspace not used");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2701 size_t cls_specialized_waste = 0, cls_small_waste = 0, cls_medium_waste = 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2702 size_t cls_specialized_count = 0, cls_small_count = 0, cls_medium_count = 0, cls_humongous_count = 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2703 ClassLoaderDataGraphMetaspaceIterator iter;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2704 while (iter.repeat()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2705 Metaspace* msp = iter.get_next();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2706 if (msp != NULL) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2707 cls_specialized_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(SpecializedIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2708 cls_specialized_count += msp->class_vsm()->sum_count_in_chunks_in_use(SpecializedIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2709 cls_small_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(SmallIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2710 cls_small_count += msp->class_vsm()->sum_count_in_chunks_in_use(SmallIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2711 cls_medium_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(MediumIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2712 cls_medium_count += msp->class_vsm()->sum_count_in_chunks_in_use(MediumIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2713 cls_humongous_count += msp->class_vsm()->sum_count_in_chunks_in_use(HumongousIndex);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2714 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2715 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2716 out->print_cr(" class: " SIZE_FORMAT " specialized(s) " SIZE_FORMAT ", "
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2717 SIZE_FORMAT " small(s) " SIZE_FORMAT ", "
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2718 SIZE_FORMAT " medium(s) " SIZE_FORMAT ", "
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2719 "large count " SIZE_FORMAT,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2720 cls_specialized_count, cls_specialized_waste,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2721 cls_small_count, cls_small_waste,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2722 cls_medium_count, cls_medium_waste, cls_humongous_count);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2723 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2724
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2725 // Print total fragmentation for data and class metaspaces separately
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2726 void MetaspaceAux::print_waste(outputStream* out) {
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	2727 size_t specialized_waste = 0, small_waste = 0, medium_waste = 0;
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	2728 size_t specialized_count = 0, small_count = 0, medium_count = 0, humongous_count = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2729
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2730 ClassLoaderDataGraphMetaspaceIterator iter;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2731 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2732 Metaspace* msp = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2733 if (msp != NULL) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2734 specialized_waste += msp->vsm()->sum_waste_in_chunks_in_use(SpecializedIndex);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2735 specialized_count += msp->vsm()->sum_count_in_chunks_in_use(SpecializedIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2736 small_waste += msp->vsm()->sum_waste_in_chunks_in_use(SmallIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2737 small_count += msp->vsm()->sum_count_in_chunks_in_use(SmallIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2738 medium_waste += msp->vsm()->sum_waste_in_chunks_in_use(MediumIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2739 medium_count += msp->vsm()->sum_count_in_chunks_in_use(MediumIndex);
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	2740 humongous_count += msp->vsm()->sum_count_in_chunks_in_use(HumongousIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2741 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2742 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2743 out->print_cr("Total fragmentation waste (words) doesn't count free space");
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2744 out->print_cr(" data: " SIZE_FORMAT " specialized(s) " SIZE_FORMAT ", "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2745 SIZE_FORMAT " small(s) " SIZE_FORMAT ", "
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	2746 SIZE_FORMAT " medium(s) " SIZE_FORMAT ", "
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	2747 "large count " SIZE_FORMAT,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2748 specialized_count, specialized_waste, small_count,
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	2749 small_waste, medium_count, medium_waste, humongous_count);
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2750 if (Metaspace::using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2751 print_class_waste(out);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2752 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2753 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2754
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2755 // Dump global metaspace things from the end of ClassLoaderDataGraph
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2756 void MetaspaceAux::dump(outputStream* out) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2757 out->print_cr("All Metaspace:");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2758 out->print("data space: "); print_on(out, Metaspace::NonClassType);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2759 out->print("class space: "); print_on(out, Metaspace::ClassType);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2760 print_waste(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2761 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2762
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2763 void MetaspaceAux::verify_free_chunks() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2764 Metaspace::space_list()->chunk_manager()->verify();
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2765 if (Metaspace::using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2766 Metaspace::class_space_list()->chunk_manager()->verify();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2767 }
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2768 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2769
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2770 void MetaspaceAux::verify_capacity() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2771 #ifdef ASSERT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2772 size_t running_sum_capacity_bytes = allocated_capacity_bytes();
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2773 // For purposes of the running sum of capacity, verify against capacity
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2774 size_t capacity_in_use_bytes = capacity_bytes_slow();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2775 assert(running_sum_capacity_bytes == capacity_in_use_bytes,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2776 err_msg("allocated_capacity_words() * BytesPerWord " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2777 " capacity_bytes_slow()" SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2778 running_sum_capacity_bytes, capacity_in_use_bytes));
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2779 for (Metaspace::MetadataType i = Metaspace::ClassType;
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2780 i < Metaspace:: MetadataTypeCount;
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2781 i = (Metaspace::MetadataType)(i + 1)) {
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2782 size_t capacity_in_use_bytes = capacity_bytes_slow(i);
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2783 assert(allocated_capacity_bytes(i) == capacity_in_use_bytes,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2784 err_msg("allocated_capacity_bytes(%u) " SIZE_FORMAT
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2785 " capacity_bytes_slow(%u)" SIZE_FORMAT,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2786 i, allocated_capacity_bytes(i), i, capacity_in_use_bytes));
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2787 }
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2788 #endif
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2789 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2790
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2791 void MetaspaceAux::verify_used() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2792 #ifdef ASSERT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2793 size_t running_sum_used_bytes = allocated_used_bytes();
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2794 // For purposes of the running sum of used, verify against used
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2795 size_t used_in_use_bytes = used_bytes_slow();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2796 assert(allocated_used_bytes() == used_in_use_bytes,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2797 err_msg("allocated_used_bytes() " SIZE_FORMAT
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2798 " used_bytes_slow()" SIZE_FORMAT,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2799 allocated_used_bytes(), used_in_use_bytes));
10330 2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2800 for (Metaspace::MetadataType i = Metaspace::ClassType;
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2801 i < Metaspace:: MetadataTypeCount;
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2802 i = (Metaspace::MetadataType)(i + 1)) {
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2803 size_t used_in_use_bytes = used_bytes_slow(i);
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2804 assert(allocated_used_bytes(i) == used_in_use_bytes,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2805 err_msg("allocated_used_bytes(%u) " SIZE_FORMAT
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2806 " used_bytes_slow(%u)" SIZE_FORMAT,
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2807 i, allocated_used_bytes(i), i, used_in_use_bytes));
2b1a9d972fc2 8014862: Add fast Metasapce capacity and used per MetadataType jmasa parents: 10191 diff changeset	2808 }
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2809 #endif
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2810 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2811
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2812 void MetaspaceAux::verify_metrics() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2813 verify_capacity();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2814 verify_used();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2815 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2816
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2817
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2818 // Metaspace methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2819
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2820 size_t Metaspace::_first_chunk_word_size = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2821 size_t Metaspace::_first_class_chunk_word_size = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2822
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2823 Metaspace::Metaspace(Mutex* lock, MetaspaceType type) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2824 initialize(lock, type);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2825 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2826
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2827 Metaspace::~Metaspace() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2828 delete _vsm;
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2829 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2830 delete _class_vsm;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2831 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2832 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2833
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2834 VirtualSpaceList* Metaspace::_space_list = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2835 VirtualSpaceList* Metaspace::_class_space_list = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2836
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2837 #define VIRTUALSPACEMULTIPLIER 2
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2838
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2839 #ifdef _LP64
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2840 void Metaspace::set_narrow_klass_base_and_shift(address metaspace_base, address cds_base) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2841 // Figure out the narrow_klass_base and the narrow_klass_shift. The
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2842 // narrow_klass_base is the lower of the metaspace base and the cds base
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2843 // (if cds is enabled). The narrow_klass_shift depends on the distance
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2844 // between the lower base and higher address.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2845 address lower_base;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2846 address higher_address;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2847 if (UseSharedSpaces) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2848 higher_address = MAX2((address)(cds_base + FileMapInfo::shared_spaces_size()),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2849 (address)(metaspace_base + class_metaspace_size()));
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2850 lower_base = MIN2(metaspace_base, cds_base);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2851 } else {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2852 higher_address = metaspace_base + class_metaspace_size();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2853 lower_base = metaspace_base;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2854 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2855 Universe::set_narrow_klass_base(lower_base);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2856 if ((uint64_t)(higher_address - lower_base) < (uint64_t)max_juint) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2857 Universe::set_narrow_klass_shift(0);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2858 } else {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2859 assert(!UseSharedSpaces, "Cannot shift with UseSharedSpaces");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2860 Universe::set_narrow_klass_shift(LogKlassAlignmentInBytes);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2861 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2862 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2863
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2864 // Return TRUE if the specified metaspace_base and cds_base are close enough
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2865 // to work with compressed klass pointers.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2866 bool Metaspace::can_use_cds_with_metaspace_addr(char* metaspace_base, address cds_base) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2867 assert(cds_base != 0 && UseSharedSpaces, "Only use with CDS");
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2868 assert(UseCompressedClassPointers, "Only use with CompressedKlassPtrs");
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2869 address lower_base = MIN2((address)metaspace_base, cds_base);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2870 address higher_address = MAX2((address)(cds_base + FileMapInfo::shared_spaces_size()),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2871 (address)(metaspace_base + class_metaspace_size()));
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2872 return ((uint64_t)(higher_address - lower_base) < (uint64_t)max_juint);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2873 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2874
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2875 // Try to allocate the metaspace at the requested addr.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2876 void Metaspace::allocate_metaspace_compressed_klass_ptrs(char* requested_addr, address cds_base) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2877 assert(using_class_space(), "called improperly");
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2878 assert(UseCompressedClassPointers, "Only use with CompressedKlassPtrs");
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2879 assert(class_metaspace_size() < KlassEncodingMetaspaceMax,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2880 "Metaspace size is too big");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2881
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2882 ReservedSpace metaspace_rs = ReservedSpace(class_metaspace_size(),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2883 os::vm_allocation_granularity(),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2884 false, requested_addr, 0);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2885 if (!metaspace_rs.is_reserved()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2886 if (UseSharedSpaces) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2887 // Keep trying to allocate the metaspace, increasing the requested_addr
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2888 // by 1GB each time, until we reach an address that will no longer allow
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2889 // use of CDS with compressed klass pointers.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2890 char *addr = requested_addr;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2891 while (!metaspace_rs.is_reserved() && (addr + 1*G > addr) &&
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2892 can_use_cds_with_metaspace_addr(addr + 1*G, cds_base)) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2893 addr = addr + 1*G;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2894 metaspace_rs = ReservedSpace(class_metaspace_size(),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2895 os::vm_allocation_granularity(), false, addr, 0);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2896 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2897 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2898
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2899 // If no successful allocation then try to allocate the space anywhere. If
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2900 // that fails then OOM doom. At this point we cannot try allocating the
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2901 // metaspace as if UseCompressedClassPointers is off because too much
7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2902 // initialization has happened that depends on UseCompressedClassPointers.
7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2903 // So, UseCompressedClassPointers cannot be turned off at this point.
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2904 if (!metaspace_rs.is_reserved()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2905 metaspace_rs = ReservedSpace(class_metaspace_size(),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2906 os::vm_allocation_granularity(), false);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2907 if (!metaspace_rs.is_reserved()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2908 vm_exit_during_initialization(err_msg("Could not allocate metaspace: %d bytes",
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2909 class_metaspace_size()));
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2910 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2911 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2912 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2913
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2914 // If we got here then the metaspace got allocated.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2915 MemTracker::record_virtual_memory_type((address)metaspace_rs.base(), mtClass);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2916
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2917 // Verify that we can use shared spaces. Otherwise, turn off CDS.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2918 if (UseSharedSpaces && !can_use_cds_with_metaspace_addr(metaspace_rs.base(), cds_base)) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2919 FileMapInfo::stop_sharing_and_unmap(
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2920 "Could not allocate metaspace at a compatible address");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2921 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2922
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2923 set_narrow_klass_base_and_shift((address)metaspace_rs.base(),
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2924 UseSharedSpaces ? (address)cds_base : 0);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2925
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2926 initialize_class_space(metaspace_rs);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2927
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2928 if (PrintCompressedOopsMode \|\| (PrintMiscellaneous && Verbose)) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2929 gclog_or_tty->print_cr("Narrow klass base: " PTR_FORMAT ", Narrow klass shift: " SIZE_FORMAT,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2930 Universe::narrow_klass_base(), Universe::narrow_klass_shift());
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2931 gclog_or_tty->print_cr("Metaspace Size: " SIZE_FORMAT " Address: " PTR_FORMAT " Req Addr: " PTR_FORMAT,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2932 class_metaspace_size(), metaspace_rs.base(), requested_addr);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2933 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2934 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2935
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2936 // For UseCompressedClassPointers the class space is reserved above the top of
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2937 // the Java heap. The argument passed in is at the base of the compressed space.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2938 void Metaspace::initialize_class_space(ReservedSpace rs) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2939 // The reserved space size may be bigger because of alignment, esp with UseLargePages
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2940 assert(rs.size() >= CompressedClassSpaceSize,
7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2941 err_msg(SIZE_FORMAT " != " UINTX_FORMAT, rs.size(), CompressedClassSpaceSize));
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2942 assert(using_class_space(), "Must be using class space");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2943 _class_space_list = new VirtualSpaceList(rs);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2944 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2945
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2946 #endif
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2947
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2948 void Metaspace::global_initialize() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2949 // Initialize the alignment for shared spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2950 int max_alignment = os::vm_page_size();
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2951 size_t cds_total = 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2952
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2953 set_class_metaspace_size(align_size_up(CompressedClassSpaceSize,
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2954 os::vm_allocation_granularity()));
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2955
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2956 MetaspaceShared::set_max_alignment(max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2957
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2958 if (DumpSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2959 SharedReadOnlySize = align_size_up(SharedReadOnlySize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2960 SharedReadWriteSize = align_size_up(SharedReadWriteSize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2961 SharedMiscDataSize = align_size_up(SharedMiscDataSize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2962 SharedMiscCodeSize = align_size_up(SharedMiscCodeSize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2963
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2964 // Initialize with the sum of the shared space sizes. The read-only
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2965 // and read write metaspace chunks will be allocated out of this and the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2966 // remainder is the misc code and data chunks.
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2967 cds_total = FileMapInfo::shared_spaces_size();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2968 _space_list = new VirtualSpaceList(cds_total/wordSize);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2969
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2970 #ifdef _LP64
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2971 // Set the compressed klass pointer base so that decoding of these pointers works
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2972 // properly when creating the shared archive.
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2973 assert(UseCompressedOops && UseCompressedClassPointers,
7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	2974 "UseCompressedOops and UseCompressedClassPointers must be set");
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2975 Universe::set_narrow_klass_base((address)_space_list->current_virtual_space()->bottom());
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2976 if (TraceMetavirtualspaceAllocation && Verbose) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2977 gclog_or_tty->print_cr("Setting_narrow_klass_base to Address: " PTR_FORMAT,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2978 _space_list->current_virtual_space()->bottom());
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2979 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2980
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2981 // Set the shift to zero.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2982 assert(class_metaspace_size() < (uint64_t)(max_juint) - cds_total,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2983 "CDS region is too large");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2984 Universe::set_narrow_klass_shift(0);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2985 #endif
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2986
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2987 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2988 // If using shared space, open the file that contains the shared space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2989 // and map in the memory before initializing the rest of metaspace (so
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2990 // the addresses don't conflict)
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	2991 address cds_address = NULL;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2992 if (UseSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2993 FileMapInfo* mapinfo = new FileMapInfo();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2994 memset(mapinfo, 0, sizeof(FileMapInfo));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2995
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2996 // Open the shared archive file, read and validate the header. If
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2997 // initialization fails, shared spaces [UseSharedSpaces] are
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2998 // disabled and the file is closed.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2999 // Map in spaces now also
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3000 if (mapinfo->initialize() && MetaspaceShared::map_shared_spaces(mapinfo)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3001 FileMapInfo::set_current_info(mapinfo);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3002 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3003 assert(!mapinfo->is_open() && !UseSharedSpaces,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3004 "archive file not closed or shared spaces not disabled.");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3005 }
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3006 cds_total = FileMapInfo::shared_spaces_size();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3007 cds_address = (address)mapinfo->region_base(0);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3008 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3009
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3010 #ifdef _LP64
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	3011 // If UseCompressedClassPointers is set then allocate the metaspace area
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3012 // above the heap and above the CDS area (if it exists).
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3013 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3014 if (UseSharedSpaces) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3015 allocate_metaspace_compressed_klass_ptrs((char *)(cds_address + cds_total), cds_address);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3016 } else {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3017 allocate_metaspace_compressed_klass_ptrs((char *)CompressedKlassPointersBase, 0);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3018 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3019 }
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3020 #endif
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3021
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3022 // Initialize these before initializing the VirtualSpaceList
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3023 _first_chunk_word_size = InitialBootClassLoaderMetaspaceSize / BytesPerWord;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3024 _first_chunk_word_size = align_word_size_up(_first_chunk_word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3025 // Make the first class chunk bigger than a medium chunk so it's not put
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3026 // on the medium chunk list. The next chunk will be small and progress
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3027 // from there. This size calculated by -version.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3028 _first_class_chunk_word_size = MIN2((size_t)MediumChunk*6,
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	3029 (CompressedClassSpaceSize/BytesPerWord)*2);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3030 _first_class_chunk_word_size = align_word_size_up(_first_class_chunk_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3031 // Arbitrarily set the initial virtual space to a multiple
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3032 // of the boot class loader size.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3033 size_t word_size = VIRTUALSPACEMULTIPLIER * first_chunk_word_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3034 // Initialize the list of virtual spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3035 _space_list = new VirtualSpaceList(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3036 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3037 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3038
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3039 void Metaspace::initialize(Mutex* lock, MetaspaceType type) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3040
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3041 assert(space_list() != NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3042 "Metadata VirtualSpaceList has not been initialized");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3043
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3044 _vsm = new SpaceManager(NonClassType, lock, space_list());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3045 if (_vsm == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3046 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3047 }
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3048 size_t word_size;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3049 size_t class_word_size;
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3050 vsm()->get_initial_chunk_sizes(type, &word_size, &class_word_size);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3051
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3052 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3053 assert(class_space_list() != NULL,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3054 "Class VirtualSpaceList has not been initialized");
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3055
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3056 // Allocate SpaceManager for classes.
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3057 _class_vsm = new SpaceManager(ClassType, lock, class_space_list());
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3058 if (_class_vsm == NULL) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3059 return;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3060 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3061 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3062
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3063 MutexLockerEx cl(SpaceManager::expand_lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3064
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3065 // Allocate chunk for metadata objects
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3066 Metachunk* new_chunk =
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3067 space_list()->get_initialization_chunk(word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3068 vsm()->medium_chunk_bunch());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3069 assert(!DumpSharedSpaces \|\| new_chunk != NULL, "should have enough space for both chunks");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3070 if (new_chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3071 // Add to this manager's list of chunks in use and current_chunk().
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3072 vsm()->add_chunk(new_chunk, true);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3073 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3074
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3075 // Allocate chunk for class metadata objects
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3076 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3077 Metachunk* class_chunk =
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3078 class_space_list()->get_initialization_chunk(class_word_size,
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3079 class_vsm()->medium_chunk_bunch());
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3080 if (class_chunk != NULL) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3081 class_vsm()->add_chunk(class_chunk, true);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3082 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3083 }
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3084
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3085 _alloc_record_head = NULL;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3086 _alloc_record_tail = NULL;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3087 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3088
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3089 size_t Metaspace::align_word_size_up(size_t word_size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3090 size_t byte_size = word_size * wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3091 return ReservedSpace::allocation_align_size_up(byte_size) / wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3092 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3093
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3094 MetaWord* Metaspace::allocate(size_t word_size, MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3095 // DumpSharedSpaces doesn't use class metadata area (yet)
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	3096 // Also, don't use class_vsm() unless UseCompressedClassPointers is true.
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3097 if (mdtype == ClassType && using_class_space()) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3098 return class_vsm()->allocate(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3099 } else {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3100 return vsm()->allocate(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3101 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3102 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3103
6753 8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3104 MetaWord* Metaspace::expand_and_allocate(size_t word_size, MetadataType mdtype) {
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3105 MetaWord* result;
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3106 MetaspaceGC::set_expand_after_GC(true);
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3107 size_t before_inc = MetaspaceGC::capacity_until_GC();
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3108 size_t delta_bytes = MetaspaceGC::delta_capacity_until_GC(word_size) * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3109 MetaspaceGC::inc_capacity_until_GC(delta_bytes);
6753 8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3110 if (PrintGCDetails && Verbose) {
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3111 gclog_or_tty->print_cr("Increase capacity to GC from " SIZE_FORMAT
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3112 " to " SIZE_FORMAT, before_inc, MetaspaceGC::capacity_until_GC());
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3113 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3114
6753 8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3115 result = allocate(word_size, mdtype);
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3116
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3117 return result;
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3118 }
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	3119
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3120 // Space allocated in the Metaspace. This may
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3121 // be across several metadata virtual spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3122 char* Metaspace::bottom() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3123 assert(DumpSharedSpaces, "only useful and valid for dumping shared spaces");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3124 return (char*)vsm()->current_chunk()->bottom();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3125 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3126
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3127 size_t Metaspace::used_words_slow(MetadataType mdtype) const {
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3128 if (mdtype == ClassType) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3129 return using_class_space() ? class_vsm()->sum_used_in_chunks_in_use() : 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3130 } else {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3131 return vsm()->sum_used_in_chunks_in_use(); // includes overhead!
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3132 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3133 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3134
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3135 size_t Metaspace::free_words(MetadataType mdtype) const {
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3136 if (mdtype == ClassType) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3137 return using_class_space() ? class_vsm()->sum_free_in_chunks_in_use() : 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3138 } else {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3139 return vsm()->sum_free_in_chunks_in_use();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3140 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3141 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3142
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3143 // Space capacity in the Metaspace. It includes
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3144 // space in the list of chunks from which allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3145 // have been made. Don't include space in the global freelist and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3146 // in the space available in the dictionary which
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3147 // is already counted in some chunk.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3148 size_t Metaspace::capacity_words_slow(MetadataType mdtype) const {
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3149 if (mdtype == ClassType) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3150 return using_class_space() ? class_vsm()->sum_capacity_in_chunks_in_use() : 0;
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3151 } else {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3152 return vsm()->sum_capacity_in_chunks_in_use();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3153 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3154 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3155
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3156 size_t Metaspace::used_bytes_slow(MetadataType mdtype) const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3157 return used_words_slow(mdtype) * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3158 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3159
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3160 size_t Metaspace::capacity_bytes_slow(MetadataType mdtype) const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3161 return capacity_words_slow(mdtype) * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3162 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	3163
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3164 void Metaspace::deallocate(MetaWord* ptr, size_t word_size, bool is_class) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3165 if (SafepointSynchronize::is_at_safepoint()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3166 assert(Thread::current()->is_VM_thread(), "should be the VM thread");
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3167 // Don't take Heap_lock
10191 601183f604b2 8013129: Possible deadlock with Metaspace locks due to mixed usage of safepoint aware and non-safepoint aware locking mgerdin parents: 10183 diff changeset	3168 MutexLockerEx ml(vsm()->lock(), Mutex::_no_safepoint_check_flag);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3169 if (word_size < TreeChunk<Metablock, FreeList>::min_size()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3170 // Dark matter. Too small for dictionary.
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3171 #ifdef ASSERT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3172 Copy::fill_to_words((HeapWord*)ptr, word_size, 0xf5f5f5f5);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3173 #endif
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3174 return;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3175 }
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3176 if (is_class && using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3177 class_vsm()->deallocate(ptr, word_size);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3178 } else {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3179 vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3180 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3181 } else {
10191 601183f604b2 8013129: Possible deadlock with Metaspace locks due to mixed usage of safepoint aware and non-safepoint aware locking mgerdin parents: 10183 diff changeset	3182 MutexLockerEx ml(vsm()->lock(), Mutex::_no_safepoint_check_flag);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3183
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3184 if (word_size < TreeChunk<Metablock, FreeList>::min_size()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3185 // Dark matter. Too small for dictionary.
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3186 #ifdef ASSERT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3187 Copy::fill_to_words((HeapWord*)ptr, word_size, 0xf5f5f5f5);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3188 #endif
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3189 return;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3190 }
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3191 if (is_class && using_class_space()) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3192 class_vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3193 } else {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3194 vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3195 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3196 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3197 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3198
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3199 Metablock* Metaspace::allocate(ClassLoaderData* loader_data, size_t word_size,
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3200 bool read_only, MetaspaceObj::Type type, TRAPS) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3201 if (HAS_PENDING_EXCEPTION) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3202 assert(false, "Should not allocate with exception pending");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3203 return NULL; // caller does a CHECK_NULL too
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3204 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3205
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3206 MetadataType mdtype = (type == MetaspaceObj::ClassType) ? ClassType : NonClassType;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3207
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3208 // SSS: Should we align the allocations and make sure the sizes are aligned.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3209 MetaWord* result = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3210
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3211 assert(loader_data != NULL, "Should never pass around a NULL loader_data. "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3212 "ClassLoaderData::the_null_class_loader_data() should have been used.");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3213 // Allocate in metaspaces without taking out a lock, because it deadlocks
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3214 // with the SymbolTable_lock. Dumping is single threaded for now. We'll have
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3215 // to revisit this for application class data sharing.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3216 if (DumpSharedSpaces) {
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3217 assert(type > MetaspaceObj::UnknownType && type < MetaspaceObj::_number_of_types, "sanity");
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3218 Metaspace* space = read_only ? loader_data->ro_metaspace() : loader_data->rw_metaspace();
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3219 result = space->allocate(word_size, NonClassType);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3220 if (result == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3221 report_out_of_shared_space(read_only ? SharedReadOnly : SharedReadWrite);
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3222 } else {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3223 space->record_allocation(result, type, space->vsm()->get_raw_word_size(word_size));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3224 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3225 return Metablock::initialize(result, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3226 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3227
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3228 result = loader_data->metaspace_non_null()->allocate(word_size, mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3229
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3230 if (result == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3231 // Try to clean out some memory and retry.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3232 result =
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3233 Universe::heap()->collector_policy()->satisfy_failed_metadata_allocation(
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3234 loader_data, word_size, mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3235
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3236 // If result is still null, we are out of memory.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3237 if (result == NULL) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3238 if (Verbose && TraceMetadataChunkAllocation) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3239 gclog_or_tty->print_cr("Metaspace allocation failed for size "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3240 SIZE_FORMAT, word_size);
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3241 if (loader_data->metaspace_or_null() != NULL) loader_data->dump(gclog_or_tty);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3242 MetaspaceAux::dump(gclog_or_tty);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3243 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3244 // -XX:+HeapDumpOnOutOfMemoryError and -XX:OnOutOfMemoryError support
12226 7944aba7ba41 8015107: NPG: Use consistent naming for metaspace concepts ehelin parents: 12110 diff changeset	3245 const char* space_string = (mdtype == ClassType) ? "Compressed class space" :
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3246 "Metadata space";
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3247 report_java_out_of_memory(space_string);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3248
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3249 if (JvmtiExport::should_post_resource_exhausted()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3250 JvmtiExport::post_resource_exhausted(
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3251 JVMTI_RESOURCE_EXHAUSTED_OOM_ERROR,
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3252 space_string);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3253 }
11064 de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3254 if (mdtype == ClassType) {
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3255 THROW_OOP_0(Universe::out_of_memory_error_class_metaspace());
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3256 } else {
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3257 THROW_OOP_0(Universe::out_of_memory_error_metaspace());
de2d15ce3d4a 8015391: NPG: With -XX:+UseCompressedKlassPointers OOME due to exhausted metadata space could occur when metaspace is almost empty coleenp parents: 10376 diff changeset	3258 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3259 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3260 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3261 return Metablock::initialize(result, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3262 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3263
10376 a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3264 void Metaspace::record_allocation(void* ptr, MetaspaceObj::Type type, size_t word_size) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3265 assert(DumpSharedSpaces, "sanity");
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3266
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3267 AllocRecord rec = new AllocRecord((address)ptr, type, (int)word_size HeapWordSize);
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3268 if (_alloc_record_head == NULL) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3269 _alloc_record_head = _alloc_record_tail = rec;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3270 } else {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3271 _alloc_record_tail->_next = rec;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3272 _alloc_record_tail = rec;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3273 }
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3274 }
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3275
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3276 void Metaspace::iterate(Metaspace::AllocRecordClosure *closure) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3277 assert(DumpSharedSpaces, "unimplemented for !DumpSharedSpaces");
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3278
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3279 address last_addr = (address)bottom();
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3280
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3281 for (AllocRecord *rec = _alloc_record_head; rec; rec = rec->_next) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3282 address ptr = rec->_ptr;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3283 if (last_addr < ptr) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3284 closure->doit(last_addr, MetaspaceObj::UnknownType, ptr - last_addr);
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3285 }
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3286 closure->doit(ptr, rec->_type, rec->_byte_size);
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3287 last_addr = ptr + rec->_byte_size;
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3288 }
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3289
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3290 address top = ((address)bottom()) + used_bytes_slow(Metaspace::NonClassType);
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3291 if (last_addr < top) {
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3292 closure->doit(last_addr, MetaspaceObj::UnknownType, top - last_addr);
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3293 }
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3294 }
a1ebd310d5c1 8014912: Restore PrintSharedSpaces functionality after NPG iklam parents: 10330 diff changeset	3295
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3296 void Metaspace::purge() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3297 MutexLockerEx cl(SpaceManager::expand_lock(),
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3298 Mutex::_no_safepoint_check_flag);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3299 space_list()->purge();
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3300 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3301 class_space_list()->purge();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3302 }
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3303 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3304
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3305 void Metaspace::print_on(outputStream* out) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3306 // Print both class virtual space counts and metaspace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3307 if (Verbose) {
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3308 vsm()->print_on(out);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3309 if (using_class_space()) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3310 class_vsm()->print_on(out);
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3311 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3312 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3313 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3314
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3315 bool Metaspace::contains(const void * ptr) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3316 if (MetaspaceShared::is_in_shared_space(ptr)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3317 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3318 }
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3319 // This is checked while unlocked. As long as the virtualspaces are added
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3320 // at the end, the pointer will be in one of them. The virtual spaces
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3321 // aren't deleted presently. When they are, some sort of locking might
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3322 // be needed. Note, locking this can cause inversion problems with the
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3323 // caller in MetaspaceObj::is_metadata() function.
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3324 return space_list()->contains(ptr) \|\|
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3325 (using_class_space() && class_space_list()->contains(ptr));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3326 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3327
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3328 void Metaspace::verify() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3329 vsm()->verify();
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3330 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3331 class_vsm()->verify();
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3332 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3333 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3334
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3335 void Metaspace::dump(outputStream* const out) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3336 out->print_cr("\nVirtual space manager: " INTPTR_FORMAT, vsm());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3337 vsm()->dump(out);
12056 740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3338 if (using_class_space()) {
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3339 out->print_cr("\nClass space manager: " INTPTR_FORMAT, class_vsm());
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3340 class_vsm()->dump(out);
740e263c80c6 8003424: Enable Class Data Sharing for CompressedOops hseigel parents: 11966 diff changeset	3341 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3342 }

Mercurial > hg > graal-jvmci-8

annotate src/share/vm/memory/metaspace.cpp @ 12231:24e87613ee58