graal-compiler: src/share/vm/memory/metaspace.cpp annotate

annotate src/share/vm/memory/metaspace.cpp @ 10191:601183f604b2

8013129: Possible deadlock with Metaspace locks due to mixed usage of safepoint aware and non-safepoint aware locking Summary: Change Metaspace::deallocate to take lock with _no_safepoint_check_flag Reviewed-by: coleenp, jmasa, dholmes

author	mgerdin
date	Mon, 29 Apr 2013 13:07:27 +0200
parents	868d87ed63c8
children	2b1a9d972fc2

rev	line source
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1 /*
8712 3efdfd6ddbf2 8003553: NPG: metaspace objects should be zeroed in constructors coleenp parents: 8040 diff changeset	2 * Copyright (c) 2011, 2013, Oracle and/or its affiliates. All rights reserved.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	4 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	7 * published by the Free Software Foundation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	8 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	13 * accompanied this code).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	14 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	18 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	21 * questions.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	22 *
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	23 */
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	24 #include "precompiled.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	25 #include "gc_interface/collectedHeap.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	26 #include "memory/binaryTreeDictionary.hpp"
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	27 #include "memory/freeList.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	28 #include "memory/collectorPolicy.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	29 #include "memory/filemap.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	30 #include "memory/freeList.hpp"
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	31 #include "memory/metablock.hpp"
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	32 #include "memory/metachunk.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	33 #include "memory/metaspace.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	34 #include "memory/metaspaceShared.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	35 #include "memory/resourceArea.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	36 #include "memory/universe.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	37 #include "runtime/globals.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	38 #include "runtime/mutex.hpp"
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	39 #include "runtime/orderAccess.hpp"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	40 #include "services/memTracker.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	41 #include "utilities/copy.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	42 #include "utilities/debug.hpp"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	43
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	44 typedef BinaryTreeDictionary<Metablock, FreeList> BlockTreeDictionary;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	45 typedef BinaryTreeDictionary<Metachunk, FreeList> ChunkTreeDictionary;
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	46 // Define this macro to enable slow integrity checking of
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	47 // the free chunk lists
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	48 const bool metaspace_slow_verify = false;
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	49
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	50 // Parameters for stress mode testing
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	51 const uint metadata_deallocate_a_lot_block = 10;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	52 const uint metadata_deallocate_a_lock_chunk = 3;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	53 size_t const allocation_from_dictionary_limit = 64 * K;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	54
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	55 MetaWord* last_allocated = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	56
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	57 // Used in declarations in SpaceManager and ChunkManager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	58 enum ChunkIndex {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	59 ZeroIndex = 0,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	60 SpecializedIndex = ZeroIndex,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	61 SmallIndex = SpecializedIndex + 1,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	62 MediumIndex = SmallIndex + 1,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	63 HumongousIndex = MediumIndex + 1,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	64 NumberOfFreeLists = 3,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	65 NumberOfInUseLists = 4
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	66 };
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	67
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	68 enum ChunkSizes { // in words.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	69 ClassSpecializedChunk = 128,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	70 SpecializedChunk = 128,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	71 ClassSmallChunk = 256,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	72 SmallChunk = 512,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	73 ClassMediumChunk = 1 * K,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	74 MediumChunk = 8 * K,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	75 HumongousChunkGranularity = 8
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	76 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	77
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	78 static ChunkIndex next_chunk_index(ChunkIndex i) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	79 assert(i < NumberOfInUseLists, "Out of bound");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	80 return (ChunkIndex) (i+1);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	81 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	82
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	83 // Originally _capacity_until_GC was set to MetaspaceSize here but
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	84 // the default MetaspaceSize before argument processing was being
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	85 // used which was not the desired value. See the code
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	86 // in should_expand() to see how the initialization is handled
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	87 // now.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	88 size_t MetaspaceGC::_capacity_until_GC = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	89 bool MetaspaceGC::_expand_after_GC = false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	90 uint MetaspaceGC::_shrink_factor = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	91 bool MetaspaceGC::_should_concurrent_collect = false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	92
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	93 // Blocks of space for metadata are allocated out of Metachunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	94 //
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	95 // Metachunk are allocated out of MetadataVirtualspaces and once
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	96 // allocated there is no explicit link between a Metachunk and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	97 // the MetadataVirtualspaces from which it was allocated.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	98 //
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	99 // Each SpaceManager maintains a
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	100 // list of the chunks it is using and the current chunk. The current
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	101 // chunk is the chunk from which allocations are done. Space freed in
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	102 // a chunk is placed on the free list of blocks (BlockFreelist) and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	103 // reused from there.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	104
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	105 typedef class FreeList<Metachunk> ChunkList;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	106
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	107 // Manages the global free lists of chunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	108 // Has three lists of free chunks, and a total size and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	109 // count that includes all three
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	110
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	111 class ChunkManager VALUE_OBJ_CLASS_SPEC {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	112
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	113 // Free list of chunks of different sizes.
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	114 // SpecializedChunk
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	115 // SmallChunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	116 // MediumChunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	117 // HumongousChunk
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	118 ChunkList _free_chunks[NumberOfFreeLists];
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	119
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	120
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	121 // HumongousChunk
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	122 ChunkTreeDictionary _humongous_dictionary;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	123
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	124 // ChunkManager in all lists of this type
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	125 size_t _free_chunks_total;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	126 size_t _free_chunks_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	127
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	128 void dec_free_chunks_total(size_t v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	129 assert(_free_chunks_count > 0 &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	130 _free_chunks_total > 0,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	131 "About to go negative");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	132 Atomic::add_ptr(-1, &_free_chunks_count);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	133 jlong minus_v = (jlong) - (jlong) v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	134 Atomic::add_ptr(minus_v, &_free_chunks_total);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	135 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	136
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	137 // Debug support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	138
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	139 size_t sum_free_chunks();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	140 size_t sum_free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	141
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	142 void locked_verify_free_chunks_total();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	143 void slow_locked_verify_free_chunks_total() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	144 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	145 locked_verify_free_chunks_total();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	146 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	147 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	148 void locked_verify_free_chunks_count();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	149 void slow_locked_verify_free_chunks_count() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	150 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	151 locked_verify_free_chunks_count();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	152 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	153 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	154 void verify_free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	155
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	156 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	157
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	158 ChunkManager() : _free_chunks_total(0), _free_chunks_count(0) {}
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	159
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	160 // add or delete (return) a chunk to the global freelist.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	161 Metachunk* chunk_freelist_allocate(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	162 void chunk_freelist_deallocate(Metachunk* chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	163
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	164 // Map a size to a list index assuming that there are lists
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	165 // for special, small, medium, and humongous chunks.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	166 static ChunkIndex list_index(size_t size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	167
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	168 // Remove the chunk from its freelist. It is
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	169 // expected to be on one of the _free_chunks[] lists.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	170 void remove_chunk(Metachunk* chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	171
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	172 // Add the simple linked list of chunks to the freelist of chunks
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	173 // of type index.
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	174 void return_chunks(ChunkIndex index, Metachunk* chunks);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	175
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	176 // Total of the space in the free chunks list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	177 size_t free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	178 size_t free_chunks_total_in_bytes();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	179
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	180 // Number of chunks in the free chunks list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	181 size_t free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	182
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	183 void inc_free_chunks_total(size_t v, size_t count = 1) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	184 Atomic::add_ptr(count, &_free_chunks_count);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	185 Atomic::add_ptr(v, &_free_chunks_total);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	186 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	187 ChunkTreeDictionary* humongous_dictionary() {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	188 return &_humongous_dictionary;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	189 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	190
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	191 ChunkList* free_chunks(ChunkIndex index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	192
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	193 // Returns the list for the given chunk word size.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	194 ChunkList* find_free_chunks_list(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	195
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	196 // Add and remove from a list by size. Selects
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	197 // list based on size of chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	198 void free_chunks_put(Metachunk* chuck);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	199 Metachunk* free_chunks_get(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	200
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	201 // Debug support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	202 void verify();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	203 void slow_verify() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	204 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	205 verify();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	206 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	207 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	208 void locked_verify();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	209 void slow_locked_verify() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	210 if (metaspace_slow_verify) {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	211 locked_verify();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	212 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	213 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	214 void verify_free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	215
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	216 void locked_print_free_chunks(outputStream* st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	217 void locked_print_sum_free_chunks(outputStream* st);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	218
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	219 void print_on(outputStream* st);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	220 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	221
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	222 // Used to manage the free list of Metablocks (a block corresponds
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	223 // to the allocation of a quantum of metadata).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	224 class BlockFreelist VALUE_OBJ_CLASS_SPEC {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	225 BlockTreeDictionary* _dictionary;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	226 static Metablock* initialize_free_chunk(MetaWord* p, size_t word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	227
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	228 // Accessors
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	229 BlockTreeDictionary* dictionary() const { return _dictionary; }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	230
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	231 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	232 BlockFreelist();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	233 ~BlockFreelist();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	234
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	235 // Get and return a block to the free list
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	236 MetaWord* get_block(size_t word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	237 void return_block(MetaWord* p, size_t word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	238
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	239 size_t total_size() {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	240 if (dictionary() == NULL) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	241 return 0;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	242 } else {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	243 return dictionary()->total_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	244 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	245 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	246
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	247 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	248 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	249
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	250 class VirtualSpaceNode : public CHeapObj<mtClass> {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	251 friend class VirtualSpaceList;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	252
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	253 // Link to next VirtualSpaceNode
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	254 VirtualSpaceNode* _next;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	255
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	256 // total in the VirtualSpace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	257 MemRegion _reserved;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	258 ReservedSpace _rs;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	259 VirtualSpace _virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	260 MetaWord* _top;
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	261 // count of chunks contained in this VirtualSpace
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	262 uintx _container_count;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	263
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	264 // Convenience functions for logical bottom and end
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	265 MetaWord* bottom() const { return (MetaWord*) _virtual_space.low(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	266 MetaWord* end() const { return (MetaWord*) _virtual_space.high(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	267
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	268 // Convenience functions to access the _virtual_space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	269 char* low() const { return virtual_space()->low(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	270 char* high() const { return virtual_space()->high(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	271
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	272 // The first Metachunk will be allocated at the bottom of the
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	273 // VirtualSpace
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	274 Metachunk* first_chunk() { return (Metachunk*) bottom(); }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	275
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	276 void inc_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	277 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	278 uint container_count_slow();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	279 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	280
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	281 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	282
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	283 VirtualSpaceNode(size_t byte_size);
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	284 VirtualSpaceNode(ReservedSpace rs) : _top(NULL), _next(NULL), _rs(rs), _container_count(0) {}
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	285 ~VirtualSpaceNode();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	286
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	287 // address of next available space in _virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	288 // Accessors
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	289 VirtualSpaceNode* next() { return _next; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	290 void set_next(VirtualSpaceNode* v) { _next = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	291
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	292 void set_reserved(MemRegion const v) { _reserved = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	293 void set_top(MetaWord* v) { _top = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	294
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	295 // Accessors
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	296 MemRegion* reserved() { return &_reserved; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	297 VirtualSpace* virtual_space() const { return (VirtualSpace*) &_virtual_space; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	298
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	299 // Returns true if "word_size" is available in the VirtualSpace
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	300 bool is_available(size_t word_size) { return _top + word_size <= end(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	301
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	302 MetaWord* top() const { return _top; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	303 void inc_top(size_t word_size) { _top += word_size; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	304
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	305 uintx container_count() { return _container_count; }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	306 void dec_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	307 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	308 void verify_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	309 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	310
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	311 // used and capacity in this single entry in the list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	312 size_t used_words_in_vs() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	313 size_t capacity_words_in_vs() const;
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	314 size_t free_words_in_vs() const;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	315
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	316 bool initialize();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	317
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	318 // get space from the virtual space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	319 Metachunk* take_from_committed(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	320
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	321 // Allocate a chunk from the virtual space and return it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	322 Metachunk* get_chunk_vs(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	323 Metachunk* get_chunk_vs_with_expand(size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	324
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	325 // Expands/shrinks the committed space in a virtual space. Delegates
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	326 // to Virtualspace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	327 bool expand_by(size_t words, bool pre_touch = false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	328 bool shrink_by(size_t words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	329
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	330 // In preparation for deleting this node, remove all the chunks
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	331 // in the node from any freelist.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	332 void purge(ChunkManager* chunk_manager);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	333
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	334 #ifdef ASSERT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	335 // Debug support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	336 static void verify_virtual_space_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	337 static void verify_virtual_space_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	338 void mangle();
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	339 #endif
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	340
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	341 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	342 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	343
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	344 // byte_size is the size of the associated virtualspace.
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	345 VirtualSpaceNode::VirtualSpaceNode(size_t byte_size) : _top(NULL), _next(NULL), _rs(0), _container_count(0) {
8752 82f49e8e2c28 8009614: nsk/split_verifier/stress/ifelse/ifelse002_30 fails with 'assert((size & (granularity - 1)) == 0) failed: size not aligned to os::vm_allocation_granularity() zgu parents: 8712 diff changeset	346 // align up to vm allocation granularity
82f49e8e2c28 8009614: nsk/split_verifier/stress/ifelse/ifelse002_30 fails with 'assert((size & (granularity - 1)) == 0) failed: size not aligned to os::vm_allocation_granularity() zgu parents: 8712 diff changeset	347 byte_size = align_size_up(byte_size, os::vm_allocation_granularity());
82f49e8e2c28 8009614: nsk/split_verifier/stress/ifelse/ifelse002_30 fails with 'assert((size & (granularity - 1)) == 0) failed: size not aligned to os::vm_allocation_granularity() zgu parents: 8712 diff changeset	348
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	349 // This allocates memory with mmap. For DumpSharedspaces, try to reserve
91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	350 // configurable address, generally at the top of the Java heap so other
91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	351 // memory addresses don't conflict.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	352 if (DumpSharedSpaces) {
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	353 char* shared_base = (char*)SharedBaseAddress;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	354 _rs = ReservedSpace(byte_size, 0, false, shared_base, 0);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	355 if (_rs.is_reserved()) {
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	356 assert(shared_base == 0 \|\| _rs.base() == shared_base, "should match");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	357 } else {
8804 91bf0bdae37b 8008217: CDS: Class data sharing limits the malloc heap on Solaris coleenp parents: 8754 diff changeset	358 // Get a mmap region anywhere if the SharedBaseAddress fails.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	359 _rs = ReservedSpace(byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	360 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	361 MetaspaceShared::set_shared_rs(&_rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	362 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	363 _rs = ReservedSpace(byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	364 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	365
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	366 MemTracker::record_virtual_memory_type((address)_rs.base(), mtClass);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	367 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	368
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	369 void VirtualSpaceNode::purge(ChunkManager* chunk_manager) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	370 Metachunk* chunk = first_chunk();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	371 Metachunk* invalid_chunk = (Metachunk*) top();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	372 while (chunk < invalid_chunk ) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	373 assert(chunk->is_free(), "Should be marked free");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	374 MetaWord* next = ((MetaWord*)chunk) + chunk->word_size();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	375 chunk_manager->remove_chunk(chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	376 assert(chunk->next() == NULL &&
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	377 chunk->prev() == NULL,
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	378 "Was not removed from its list");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	379 chunk = (Metachunk*) next;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	380 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	381 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	382
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	383 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	384 uint VirtualSpaceNode::container_count_slow() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	385 uint count = 0;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	386 Metachunk* chunk = first_chunk();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	387 Metachunk* invalid_chunk = (Metachunk*) top();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	388 while (chunk < invalid_chunk ) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	389 MetaWord* next = ((MetaWord*)chunk) + chunk->word_size();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	390 // Don't count the chunks on the free lists. Those are
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	391 // still part of the VirtualSpaceNode but not currently
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	392 // counted.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	393 if (!chunk->is_free()) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	394 count++;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	395 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	396 chunk = (Metachunk*) next;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	397 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	398 return count;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	399 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	400 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	401
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	402 // List of VirtualSpaces for metadata allocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	403 // It has a _next link for singly linked list and a MemRegion
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	404 // for total space in the VirtualSpace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	405 class VirtualSpaceList : public CHeapObj<mtClass> {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	406 friend class VirtualSpaceNode;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	407
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	408 enum VirtualSpaceSizes {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	409 VirtualSpaceSize = 256 * K
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	410 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	411
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	412 // Global list of virtual spaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	413 // Head of the list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	414 VirtualSpaceNode* _virtual_space_list;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	415 // virtual space currently being used for allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	416 VirtualSpaceNode* _current_virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	417 // Free chunk list for all other metadata
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	418 ChunkManager _chunk_manager;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	419
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	420 // Can this virtual list allocate >1 spaces? Also, used to determine
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	421 // whether to allocate unlimited small chunks in this virtual space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	422 bool _is_class;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	423 bool can_grow() const { return !is_class() \|\| !UseCompressedKlassPointers; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	424
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	425 // Sum of space in all virtual spaces and number of virtual spaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	426 size_t _virtual_space_total;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	427 size_t _virtual_space_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	428
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	429 ~VirtualSpaceList();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	430
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	431 VirtualSpaceNode* virtual_space_list() const { return _virtual_space_list; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	432
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	433 void set_virtual_space_list(VirtualSpaceNode* v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	434 _virtual_space_list = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	435 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	436 void set_current_virtual_space(VirtualSpaceNode* v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	437 _current_virtual_space = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	438 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	439
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	440 void link_vs(VirtualSpaceNode* new_entry, size_t vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	441
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	442 // Get another virtual space and add it to the list. This
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	443 // is typically prompted by a failed attempt to allocate a chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	444 // and is typically followed by the allocation of a chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	445 bool grow_vs(size_t vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	446
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	447 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	448 VirtualSpaceList(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	449 VirtualSpaceList(ReservedSpace rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	450
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	451 size_t free_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	452
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	453 Metachunk* get_new_chunk(size_t word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	454 size_t grow_chunks_by_words,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	455 size_t medium_chunk_bunch);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	456
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	457 // Get the first chunk for a Metaspace. Used for
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	458 // special cases such as the boot class loader, reflection
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	459 // class loader and anonymous class loader.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	460 Metachunk* get_initialization_chunk(size_t word_size, size_t chunk_bunch);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	461
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	462 VirtualSpaceNode* current_virtual_space() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	463 return _current_virtual_space;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	464 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	465
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	466 ChunkManager* chunk_manager() { return &_chunk_manager; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	467 bool is_class() const { return _is_class; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	468
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	469 // Allocate the first virtualspace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	470 void initialize(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	471
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	472 size_t virtual_space_total() { return _virtual_space_total; }
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	473
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	474 void inc_virtual_space_total(size_t v);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	475 void dec_virtual_space_total(size_t v);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	476 void inc_virtual_space_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	477 void dec_virtual_space_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	478
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	479 // Unlink empty VirtualSpaceNodes and free it.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	480 void purge();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	481
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	482 // Used and capacity in the entire list of virtual spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	483 // These are global values shared by all Metaspaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	484 size_t capacity_words_sum();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	485 size_t capacity_bytes_sum() { return capacity_words_sum() * BytesPerWord; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	486 size_t used_words_sum();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	487 size_t used_bytes_sum() { return used_words_sum() * BytesPerWord; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	488
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	489 bool contains(const void *ptr);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	490
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	491 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	492
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	493 class VirtualSpaceListIterator : public StackObj {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	494 VirtualSpaceNode* _virtual_spaces;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	495 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	496 VirtualSpaceListIterator(VirtualSpaceNode* virtual_spaces) :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	497 _virtual_spaces(virtual_spaces) {}
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	498
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	499 bool repeat() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	500 return _virtual_spaces != NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	501 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	502
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	503 VirtualSpaceNode* get_next() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	504 VirtualSpaceNode* result = _virtual_spaces;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	505 if (_virtual_spaces != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	506 _virtual_spaces = _virtual_spaces->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	507 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	508 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	509 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	510 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	511 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	512
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	513 class Metadebug : AllStatic {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	514 // Debugging support for Metaspaces
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	515 static int _deallocate_block_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	516 static int _deallocate_chunk_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	517 static int _allocation_fail_alot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	518
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	519 public:
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	520 static int deallocate_block_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	521 return _deallocate_block_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	522 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	523 static void set_deallocate_block_a_lot_count(int v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	524 _deallocate_block_a_lot_count = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	525 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	526 static void inc_deallocate_block_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	527 _deallocate_block_a_lot_count++;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	528 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	529 static int deallocate_chunk_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	530 return _deallocate_chunk_a_lot_count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	531 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	532 static void reset_deallocate_chunk_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	533 _deallocate_chunk_a_lot_count = 1;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	534 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	535 static void inc_deallocate_chunk_a_lot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	536 _deallocate_chunk_a_lot_count++;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	537 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	538
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	539 static void init_allocation_fail_alot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	540 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	541 static bool test_metadata_failure();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	542 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	543
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	544 static void deallocate_chunk_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	545 size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	546 static void deallocate_block_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	547 size_t chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	548
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	549 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	550
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	551 int Metadebug::_deallocate_block_a_lot_count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	552 int Metadebug::_deallocate_chunk_a_lot_count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	553 int Metadebug::_allocation_fail_alot_count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	554
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	555 // SpaceManager - used by Metaspace to handle allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	556 class SpaceManager : public CHeapObj<mtClass> {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	557 friend class Metaspace;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	558 friend class Metadebug;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	559
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	560 private:
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	561
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	562 // protects allocations and contains.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	563 Mutex* const _lock;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	564
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	565 // Chunk related size
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	566 size_t _medium_chunk_bunch;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	567
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	568 // List of chunks in use by this SpaceManager. Allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	569 // are done from the current chunk. The list is used for deallocating
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	570 // chunks when the SpaceManager is freed.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	571 Metachunk* _chunks_in_use[NumberOfInUseLists];
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	572 Metachunk* _current_chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	573
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	574 // Virtual space where allocation comes from.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	575 VirtualSpaceList* _vs_list;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	576
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	577 // Number of small chunks to allocate to a manager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	578 // If class space manager, small chunks are unlimited
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	579 static uint const _small_chunk_limit;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	580 bool has_small_chunk_limit() { return !vs_list()->is_class(); }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	581
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	582 // Sum of all space in allocated chunks
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	583 size_t _allocated_blocks_words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	584
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	585 // Sum of all allocated chunks
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	586 size_t _allocated_chunks_words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	587 size_t _allocated_chunks_count;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	588
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	589 // Free lists of blocks are per SpaceManager since they
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	590 // are assumed to be in chunks in use by the SpaceManager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	591 // and all chunks in use by a SpaceManager are freed when
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	592 // the class loader using the SpaceManager is collected.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	593 BlockFreelist _block_freelists;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	594
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	595 // protects virtualspace and chunk expansions
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	596 static const char* _expand_lock_name;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	597 static const int _expand_lock_rank;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	598 static Mutex* const _expand_lock;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	599
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	600 private:
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	601 // Accessors
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	602 Metachunk* chunks_in_use(ChunkIndex index) const { return _chunks_in_use[index]; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	603 void set_chunks_in_use(ChunkIndex index, Metachunk* v) { _chunks_in_use[index] = v; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	604
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	605 BlockFreelist* block_freelists() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	606 return (BlockFreelist*) &_block_freelists;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	607 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	608
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	609 VirtualSpaceList* vs_list() const { return _vs_list; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	610
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	611 Metachunk* current_chunk() const { return _current_chunk; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	612 void set_current_chunk(Metachunk* v) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	613 _current_chunk = v;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	614 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	615
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	616 Metachunk* find_current_chunk(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	617
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	618 // Add chunk to the list of chunks in use
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	619 void add_chunk(Metachunk* v, bool make_current);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	620
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	621 Mutex* lock() const { return _lock; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	622
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	623 const char* chunk_size_name(ChunkIndex index) const;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	624
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	625 protected:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	626 void initialize();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	627
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	628 public:
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	629 SpaceManager(Mutex* lock,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	630 VirtualSpaceList* vs_list);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	631 ~SpaceManager();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	632
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	633 enum ChunkMultiples {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	634 MediumChunkMultiple = 4
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	635 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	636
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	637 // Accessors
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	638 size_t specialized_chunk_size() { return SpecializedChunk; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	639 size_t small_chunk_size() { return (size_t) vs_list()->is_class() ? ClassSmallChunk : SmallChunk; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	640 size_t medium_chunk_size() { return (size_t) vs_list()->is_class() ? ClassMediumChunk : MediumChunk; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	641 size_t medium_chunk_bunch() { return medium_chunk_size() * MediumChunkMultiple; }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	642
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	643 size_t allocated_blocks_words() const { return _allocated_blocks_words; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	644 size_t allocated_blocks_bytes() const { return _allocated_blocks_words * BytesPerWord; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	645 size_t allocated_chunks_words() const { return _allocated_chunks_words; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	646 size_t allocated_chunks_count() const { return _allocated_chunks_count; }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	647
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	648 bool is_humongous(size_t word_size) { return word_size > medium_chunk_size(); }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	649
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	650 static Mutex* expand_lock() { return _expand_lock; }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	651
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	652 // Increment the per Metaspace and global running sums for Metachunks
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	653 // by the given size. This is used when a Metachunk to added to
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	654 // the in-use list.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	655 void inc_size_metrics(size_t words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	656 // Increment the per Metaspace and global running sums Metablocks by the given
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	657 // size. This is used when a Metablock is allocated.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	658 void inc_used_metrics(size_t words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	659 // Delete the portion of the running sums for this SpaceManager. That is,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	660 // the globals running sums for the Metachunks and Metablocks are
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	661 // decremented for all the Metachunks in-use by this SpaceManager.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	662 void dec_total_from_size_metrics();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	663
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	664 // Set the sizes for the initial chunks.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	665 void get_initial_chunk_sizes(Metaspace::MetaspaceType type,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	666 size_t* chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	667 size_t* class_chunk_word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	668
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	669 size_t sum_capacity_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	670 size_t sum_used_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	671 size_t sum_free_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	672 size_t sum_waste_in_chunks_in_use() const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	673 size_t sum_waste_in_chunks_in_use(ChunkIndex index ) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	674
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	675 size_t sum_count_in_chunks_in_use();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	676 size_t sum_count_in_chunks_in_use(ChunkIndex i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	677
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	678 Metachunk* get_new_chunk(size_t word_size, size_t grow_chunks_by_words);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	679
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	680 // Block allocation and deallocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	681 // Allocates a block from the current chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	682 MetaWord* allocate(size_t word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	683
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	684 // Helper for allocations
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	685 MetaWord* allocate_work(size_t word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	686
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	687 // Returns a block to the per manager freelist
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	688 void deallocate(MetaWord* p, size_t word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	689
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	690 // Based on the allocation size and a minimum chunk size,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	691 // returned chunk size (for expanding space for chunk allocation).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	692 size_t calc_chunk_size(size_t allocation_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	693
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	694 // Called when an allocation from the current chunk fails.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	695 // Gets a new chunk (may require getting a new virtual space),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	696 // and allocates from that chunk.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	697 MetaWord* grow_and_allocate(size_t word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	698
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	699 // debugging support.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	700
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	701 void dump(outputStream* const out) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	702 void print_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	703 void locked_print_chunks_in_use_on(outputStream* st) const;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	704
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	705 void verify();
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	706 void verify_chunk_size(Metachunk* chunk);
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	707 NOT_PRODUCT(void mangle_freed_chunks();)
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	708 #ifdef ASSERT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	709 void verify_allocated_blocks_words();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	710 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	711 };
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	712
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	713 uint const SpaceManager::_small_chunk_limit = 4;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	714
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	715 const char* SpaceManager::_expand_lock_name =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	716 "SpaceManager chunk allocation lock";
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	717 const int SpaceManager::_expand_lock_rank = Monitor::leaf - 1;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	718 Mutex* const SpaceManager::_expand_lock =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	719 new Mutex(SpaceManager::_expand_lock_rank,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	720 SpaceManager::_expand_lock_name,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	721 Mutex::_allow_vm_block_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	722
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	723 void VirtualSpaceNode::inc_container_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	724 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	725 _container_count++;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	726 assert(_container_count == container_count_slow(),
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	727 err_msg("Inconsistency in countainer_count _container_count " SIZE_FORMAT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	728 "container_count_slow() " SIZE_FORMAT,
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	729 _container_count, container_count_slow()));
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	730 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	731
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	732 void VirtualSpaceNode::dec_container_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	733 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	734 _container_count--;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	735 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	736
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	737 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	738 void VirtualSpaceNode::verify_container_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	739 assert(_container_count == container_count_slow(),
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	740 err_msg("Inconsistency in countainer_count _container_count " SIZE_FORMAT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	741 "container_count_slow() " SIZE_FORMAT, _container_count, container_count_slow()));
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	742 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	743 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	744
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	745 // BlockFreelist methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	746
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	747 BlockFreelist::BlockFreelist() : _dictionary(NULL) {}
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	748
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	749 BlockFreelist::~BlockFreelist() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	750 if (_dictionary != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	751 if (Verbose && TraceMetadataChunkAllocation) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	752 _dictionary->print_free_lists(gclog_or_tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	753 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	754 delete _dictionary;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	755 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	756 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	757
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	758 Metablock* BlockFreelist::initialize_free_chunk(MetaWord* p, size_t word_size) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	759 Metablock* block = (Metablock*) p;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	760 block->set_word_size(word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	761 block->set_prev(NULL);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	762 block->set_next(NULL);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	763
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	764 return block;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	765 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	766
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	767 void BlockFreelist::return_block(MetaWord* p, size_t word_size) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	768 Metablock* free_chunk = initialize_free_chunk(p, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	769 if (dictionary() == NULL) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	770 _dictionary = new BlockTreeDictionary();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	771 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	772 dictionary()->return_chunk(free_chunk);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	773 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	774
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	775 MetaWord* BlockFreelist::get_block(size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	776 if (dictionary() == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	777 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	778 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	779
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	780 if (word_size < TreeChunk<Metablock, FreeList>::min_size()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	781 // Dark matter. Too small for dictionary.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	782 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	783 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	784
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	785 Metablock* free_block =
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	786 dictionary()->get_chunk(word_size, FreeBlockDictionary<Metablock>::exactly);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	787 if (free_block == NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	788 return NULL;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	789 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	790
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	791 return (MetaWord*) free_block;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	792 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	793
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	794 void BlockFreelist::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	795 if (dictionary() == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	796 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	797 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	798 dictionary()->print_free_lists(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	799 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	800
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	801 // VirtualSpaceNode methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	802
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	803 VirtualSpaceNode::~VirtualSpaceNode() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	804 _rs.release();
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	805 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	806 size_t word_size = sizeof(*this) / BytesPerWord;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	807 Copy::fill_to_words((HeapWord*) this, word_size, 0xf1f1f1f1);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	808 #endif
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	809 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	810
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	811 size_t VirtualSpaceNode::used_words_in_vs() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	812 return pointer_delta(top(), bottom(), sizeof(MetaWord));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	813 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	814
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	815 // Space committed in the VirtualSpace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	816 size_t VirtualSpaceNode::capacity_words_in_vs() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	817 return pointer_delta(end(), bottom(), sizeof(MetaWord));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	818 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	819
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	820 size_t VirtualSpaceNode::free_words_in_vs() const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	821 return pointer_delta(end(), top(), sizeof(MetaWord));
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	822 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	823
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	824 // Allocates the chunk from the virtual space only.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	825 // This interface is also used internally for debugging. Not all
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	826 // chunks removed here are necessarily used for allocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	827 Metachunk* VirtualSpaceNode::take_from_committed(size_t chunk_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	828 // Bottom of the new chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	829 MetaWord* chunk_limit = top();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	830 assert(chunk_limit != NULL, "Not safe to call this method");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	831
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	832 if (!is_available(chunk_word_size)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	833 if (TraceMetadataChunkAllocation) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	834 tty->print("VirtualSpaceNode::take_from_committed() not available %d words ", chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	835 // Dump some information about the virtual space that is nearly full
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	836 print_on(tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	837 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	838 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	839 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	840
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	841 // Take the space (bump top on the current virtual space).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	842 inc_top(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	843
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	844 // Initialize the chunk
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	845 Metachunk* result = ::new (chunk_limit) Metachunk(chunk_word_size, this);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	846 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	847 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	848
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	849
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	850 // Expand the virtual space (commit more of the reserved space)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	851 bool VirtualSpaceNode::expand_by(size_t words, bool pre_touch) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	852 size_t bytes = words * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	853 bool result = virtual_space()->expand_by(bytes, pre_touch);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	854 if (TraceMetavirtualspaceAllocation && !result) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	855 gclog_or_tty->print_cr("VirtualSpaceNode::expand_by() failed "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	856 "for byte size " SIZE_FORMAT, bytes);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	857 virtual_space()->print();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	858 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	859 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	860 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	861
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	862 // Shrink the virtual space (commit more of the reserved space)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	863 bool VirtualSpaceNode::shrink_by(size_t words) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	864 size_t bytes = words * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	865 virtual_space()->shrink_by(bytes);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	866 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	867 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	868
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	869 // Add another chunk to the chunk list.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	870
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	871 Metachunk* VirtualSpaceNode::get_chunk_vs(size_t chunk_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	872 assert_lock_strong(SpaceManager::expand_lock());
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	873 Metachunk* result = take_from_committed(chunk_word_size);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	874 if (result != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	875 inc_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	876 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	877 return result;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	878 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	879
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	880 Metachunk* VirtualSpaceNode::get_chunk_vs_with_expand(size_t chunk_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	881 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	882
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	883 Metachunk* new_chunk = get_chunk_vs(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	884
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	885 if (new_chunk == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	886 // Only a small part of the virtualspace is committed when first
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	887 // allocated so committing more here can be expected.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	888 size_t page_size_words = os::vm_page_size() / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	889 size_t aligned_expand_vs_by_words = align_size_up(chunk_word_size,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	890 page_size_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	891 expand_by(aligned_expand_vs_by_words, false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	892 new_chunk = get_chunk_vs(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	893 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	894 return new_chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	895 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	896
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	897 bool VirtualSpaceNode::initialize() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	898
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	899 if (!_rs.is_reserved()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	900 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	901 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	902
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	903 // An allocation out of this Virtualspace that is larger
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	904 // than an initial commit size can waste that initial committed
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	905 // space.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	906 size_t committed_byte_size = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	907 bool result = virtual_space()->initialize(_rs, committed_byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	908 if (result) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	909 set_top((MetaWord*)virtual_space()->low());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	910 set_reserved(MemRegion((HeapWord*)_rs.base(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	911 (HeapWord*)(_rs.base() + _rs.size())));
6726 03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	912
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	913 assert(reserved()->start() == (HeapWord*) _rs.base(),
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	914 err_msg("Reserved start was not set properly " PTR_FORMAT
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	915 " != " PTR_FORMAT, reserved()->start(), _rs.base()));
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	916 assert(reserved()->word_size() == _rs.size() / BytesPerWord,
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	917 err_msg("Reserved size was not set properly " SIZE_FORMAT
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	918 " != " SIZE_FORMAT, reserved()->word_size(),
03049e0e8544 7195823: NPG: CMS reserved() doesn't match _rs.base(). coleenp parents: 6725 diff changeset	919 _rs.size() / BytesPerWord));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	920 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	921
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	922 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	923 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	924
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	925 void VirtualSpaceNode::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	926 size_t used = used_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	927 size_t capacity = capacity_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	928 VirtualSpace* vs = virtual_space();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	929 st->print_cr(" space @ " PTR_FORMAT " " SIZE_FORMAT "K, %3d%% used "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	930 "[" PTR_FORMAT ", " PTR_FORMAT ", "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	931 PTR_FORMAT ", " PTR_FORMAT ")",
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	932 vs, capacity / K,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	933 capacity == 0 ? 0 : used * 100 / capacity,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	934 bottom(), top(), end(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	935 vs->high_boundary());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	936 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	937
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	938 #ifdef ASSERT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	939 void VirtualSpaceNode::mangle() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	940 size_t word_size = capacity_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	941 Copy::fill_to_words((HeapWord*) low(), word_size, 0xf1f1f1f1);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	942 }
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	943 #endif // ASSERT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	944
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	945 // VirtualSpaceList methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	946 // Space allocated from the VirtualSpace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	947
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	948 VirtualSpaceList::~VirtualSpaceList() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	949 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	950 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	951 VirtualSpaceNode* vsl = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	952 delete vsl;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	953 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	954 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	955
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	956 void VirtualSpaceList::inc_virtual_space_total(size_t v) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	957 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	958 _virtual_space_total = _virtual_space_total + v;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	959 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	960 void VirtualSpaceList::dec_virtual_space_total(size_t v) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	961 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	962 _virtual_space_total = _virtual_space_total - v;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	963 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	964
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	965 void VirtualSpaceList::inc_virtual_space_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	966 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	967 _virtual_space_count++;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	968 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	969 void VirtualSpaceList::dec_virtual_space_count() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	970 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	971 _virtual_space_count--;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	972 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	973
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	974 void ChunkManager::remove_chunk(Metachunk* chunk) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	975 size_t word_size = chunk->word_size();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	976 ChunkIndex index = list_index(word_size);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	977 if (index != HumongousIndex) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	978 free_chunks(index)->remove_chunk(chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	979 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	980 humongous_dictionary()->remove_chunk(chunk);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	981 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	982
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	983 // Chunk is being removed from the chunks free list.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	984 dec_free_chunks_total(chunk->capacity_word_size());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	985 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	986
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	987 // Walk the list of VirtualSpaceNodes and delete
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	988 // nodes with a 0 container_count. Remove Metachunks in
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	989 // the node from their respective freelists.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	990 void VirtualSpaceList::purge() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	991 assert_lock_strong(SpaceManager::expand_lock());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	992 // Don't use a VirtualSpaceListIterator because this
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	993 // list is being changed and a straightforward use of an iterator is not safe.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	994 VirtualSpaceNode* purged_vsl = NULL;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	995 VirtualSpaceNode* prev_vsl = virtual_space_list();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	996 VirtualSpaceNode* next_vsl = prev_vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	997 while (next_vsl != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	998 VirtualSpaceNode* vsl = next_vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	999 next_vsl = vsl->next();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1000 // Don't free the current virtual space since it will likely
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1001 // be needed soon.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1002 if (vsl->container_count() == 0 && vsl != current_virtual_space()) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1003 // Unlink it from the list
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1004 if (prev_vsl == vsl) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1005 // This is the case of the current note being the first note.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1006 assert(vsl == virtual_space_list(), "Expected to be the first note");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1007 set_virtual_space_list(vsl->next());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1008 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1009 prev_vsl->set_next(vsl->next());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1010 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1011
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1012 vsl->purge(chunk_manager());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1013 dec_virtual_space_total(vsl->reserved()->word_size());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1014 dec_virtual_space_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1015 purged_vsl = vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1016 delete vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1017 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1018 prev_vsl = vsl;
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1019 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1020 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1021 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1022 if (purged_vsl != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1023 // List should be stable enough to use an iterator here.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1024 VirtualSpaceListIterator iter(virtual_space_list());
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1025 while (iter.repeat()) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1026 VirtualSpaceNode* vsl = iter.get_next();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1027 assert(vsl != purged_vsl, "Purge of vsl failed");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1028 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1029 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1030 #endif
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1031 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1032
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1033 size_t VirtualSpaceList::used_words_sum() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1034 size_t allocated_by_vs = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1035 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1036 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1037 VirtualSpaceNode* vsl = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1038 // Sum used region [bottom, top) in each virtualspace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1039 allocated_by_vs += vsl->used_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1040 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1041 assert(allocated_by_vs >= chunk_manager()->free_chunks_total(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1042 err_msg("Total in free chunks " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1043 " greater than total from virtual_spaces " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1044 allocated_by_vs, chunk_manager()->free_chunks_total()));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1045 size_t used =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1046 allocated_by_vs - chunk_manager()->free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1047 return used;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1048 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1049
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1050 // Space available in all MetadataVirtualspaces allocated
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1051 // for metadata. This is the upper limit on the capacity
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1052 // of chunks allocated out of all the MetadataVirtualspaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1053 size_t VirtualSpaceList::capacity_words_sum() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1054 size_t capacity = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1055 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1056 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1057 VirtualSpaceNode* vsl = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1058 capacity += vsl->capacity_words_in_vs();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1059 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1060 return capacity;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1061 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1062
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1063 VirtualSpaceList::VirtualSpaceList(size_t word_size ) :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1064 _is_class(false),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1065 _virtual_space_list(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1066 _current_virtual_space(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1067 _virtual_space_total(0),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1068 _virtual_space_count(0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1069 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1070 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1071 bool initialization_succeeded = grow_vs(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1072
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1073 _chunk_manager.free_chunks(SpecializedIndex)->set_size(SpecializedChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1074 _chunk_manager.free_chunks(SmallIndex)->set_size(SmallChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1075 _chunk_manager.free_chunks(MediumIndex)->set_size(MediumChunk);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1076 assert(initialization_succeeded,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1077 " VirtualSpaceList initialization should not fail");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1078 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1079
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1080 VirtualSpaceList::VirtualSpaceList(ReservedSpace rs) :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1081 _is_class(true),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1082 _virtual_space_list(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1083 _current_virtual_space(NULL),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1084 _virtual_space_total(0),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1085 _virtual_space_count(0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1086 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1087 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1088 VirtualSpaceNode* class_entry = new VirtualSpaceNode(rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1089 bool succeeded = class_entry->initialize();
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1090 _chunk_manager.free_chunks(SpecializedIndex)->set_size(SpecializedChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1091 _chunk_manager.free_chunks(SmallIndex)->set_size(ClassSmallChunk);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1092 _chunk_manager.free_chunks(MediumIndex)->set_size(ClassMediumChunk);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1093 assert(succeeded, " VirtualSpaceList initialization should not fail");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1094 link_vs(class_entry, rs.size()/BytesPerWord);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1095 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1096
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1097 size_t VirtualSpaceList::free_bytes() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1098 return virtual_space_list()->free_words_in_vs() * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1099 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1100
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1101 // Allocate another meta virtual space and add it to the list.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1102 bool VirtualSpaceList::grow_vs(size_t vs_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1103 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1104 if (vs_word_size == 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1105 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1106 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1107 // Reserve the space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1108 size_t vs_byte_size = vs_word_size * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1109 assert(vs_byte_size % os::vm_page_size() == 0, "Not aligned");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1110
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1111 // Allocate the meta virtual space and initialize it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1112 VirtualSpaceNode* new_entry = new VirtualSpaceNode(vs_byte_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1113 if (!new_entry->initialize()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1114 delete new_entry;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1115 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1116 } else {
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	1117 // ensure lock-free iteration sees fully initialized node
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	1118 OrderAccess::storestore();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1119 link_vs(new_entry, vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1120 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1121 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1122 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1123
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1124 void VirtualSpaceList::link_vs(VirtualSpaceNode* new_entry, size_t vs_word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1125 if (virtual_space_list() == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1126 set_virtual_space_list(new_entry);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1127 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1128 current_virtual_space()->set_next(new_entry);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1129 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1130 set_current_virtual_space(new_entry);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1131 inc_virtual_space_total(vs_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1132 inc_virtual_space_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1133 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1134 new_entry->mangle();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1135 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1136 if (TraceMetavirtualspaceAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1137 VirtualSpaceNode* vsl = current_virtual_space();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1138 vsl->print_on(tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1139 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1140 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1141
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1142 Metachunk* VirtualSpaceList::get_new_chunk(size_t word_size,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1143 size_t grow_chunks_by_words,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1144 size_t medium_chunk_bunch) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1145
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1146 // Get a chunk from the chunk freelist
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1147 Metachunk* next = chunk_manager()->chunk_freelist_allocate(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1148
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1149 if (next != NULL) {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1150 next->container()->inc_container_count();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1151 } else {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1152 // Allocate a chunk out of the current virtual space.
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1153 next = current_virtual_space()->get_chunk_vs(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1154 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1155
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1156 if (next == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1157 // Not enough room in current virtual space. Try to commit
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1158 // more space.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1159 size_t expand_vs_by_words = MAX2(medium_chunk_bunch,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1160 grow_chunks_by_words);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1161 size_t page_size_words = os::vm_page_size() / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1162 size_t aligned_expand_vs_by_words = align_size_up(expand_vs_by_words,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1163 page_size_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1164 bool vs_expanded =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1165 current_virtual_space()->expand_by(aligned_expand_vs_by_words, false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1166 if (!vs_expanded) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1167 // Should the capacity of the metaspaces be expanded for
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1168 // this allocation? If it's the virtual space for classes and is
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1169 // being used for CompressedHeaders, don't allocate a new virtualspace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1170 if (can_grow() && MetaspaceGC::should_expand(this, word_size)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1171 // Get another virtual space.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1172 size_t grow_vs_words =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1173 MAX2((size_t)VirtualSpaceSize, aligned_expand_vs_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1174 if (grow_vs(grow_vs_words)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1175 // Got it. It's on the list now. Get a chunk from it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1176 next = current_virtual_space()->get_chunk_vs_with_expand(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1177 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1178 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1179 // Allocation will fail and induce a GC
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1180 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1181 gclog_or_tty->print_cr("VirtualSpaceList::get_new_chunk():"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1182 " Fail instead of expand the metaspace");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1183 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1184 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1185 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1186 // The virtual space expanded, get a new chunk
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1187 next = current_virtual_space()->get_chunk_vs(grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1188 assert(next != NULL, "Just expanded, should succeed");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1189 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1190 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1191
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1192 assert(next == NULL \|\| (next->next() == NULL && next->prev() == NULL),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1193 "New chunk is still on some list");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1194 return next;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1195 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1196
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1197 Metachunk* VirtualSpaceList::get_initialization_chunk(size_t chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1198 size_t chunk_bunch) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1199 // Get a chunk from the chunk freelist
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1200 Metachunk* new_chunk = get_new_chunk(chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1201 chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1202 chunk_bunch);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1203 return new_chunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1204 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1205
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1206 void VirtualSpaceList::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1207 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1208 VirtualSpaceListIterator iter(virtual_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1209 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1210 VirtualSpaceNode* node = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1211 node->print_on(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1212 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1213 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1214 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1215
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1216 bool VirtualSpaceList::contains(const void *ptr) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1217 VirtualSpaceNode* list = virtual_space_list();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1218 VirtualSpaceListIterator iter(list);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1219 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1220 VirtualSpaceNode* node = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1221 if (node->reserved()->contains(ptr)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1222 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1223 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1224 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1225 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1226 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1227
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1228
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1229 // MetaspaceGC methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1230
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1231 // VM_CollectForMetadataAllocation is the vm operation used to GC.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1232 // Within the VM operation after the GC the attempt to allocate the metadata
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1233 // should succeed. If the GC did not free enough space for the metaspace
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1234 // allocation, the HWM is increased so that another virtualspace will be
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1235 // allocated for the metadata. With perm gen the increase in the perm
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1236 // gen had bounds, MinMetaspaceExpansion and MaxMetaspaceExpansion. The
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1237 // metaspace policy uses those as the small and large steps for the HWM.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1238 //
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1239 // After the GC the compute_new_size() for MetaspaceGC is called to
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1240 // resize the capacity of the metaspaces. The current implementation
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1241 // is based on the flags MinMetaspaceFreeRatio and MaxMetaspaceFreeRatio used
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1242 // to resize the Java heap by some GC's. New flags can be implemented
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1243 // if really needed. MinMetaspaceFreeRatio is used to calculate how much
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1244 // free space is desirable in the metaspace capacity to decide how much
8040 a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1245 // to increase the HWM. MaxMetaspaceFreeRatio is used to decide how much
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1246 // free space is desirable in the metaspace capacity before decreasing
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1247 // the HWM.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1248
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1249 // Calculate the amount to increase the high water mark (HWM).
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1250 // Increase by a minimum amount (MinMetaspaceExpansion) so that
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1251 // another expansion is not requested too soon. If that is not
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1252 // enough to satisfy the allocation (i.e. big enough for a word_size
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1253 // allocation), increase by MaxMetaspaceExpansion. If that is still
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1254 // not enough, expand by the size of the allocation (word_size) plus
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1255 // some.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1256 size_t MetaspaceGC::delta_capacity_until_GC(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1257 size_t before_inc = MetaspaceGC::capacity_until_GC();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1258 size_t min_delta_words = MinMetaspaceExpansion / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1259 size_t max_delta_words = MaxMetaspaceExpansion / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1260 size_t page_size_words = os::vm_page_size() / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1261 size_t size_delta_words = align_size_up(word_size, page_size_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1262 size_t delta_words = MAX2(size_delta_words, min_delta_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1263 if (delta_words > min_delta_words) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1264 // Don't want to hit the high water mark on the next
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1265 // allocation so make the delta greater than just enough
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1266 // for this allocation.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1267 delta_words = MAX2(delta_words, max_delta_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1268 if (delta_words > max_delta_words) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1269 // This allocation is large but the next ones are probably not
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1270 // so increase by the minimum.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1271 delta_words = delta_words + min_delta_words;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1272 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1273 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1274 return delta_words;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1275 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1276
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1277 bool MetaspaceGC::should_expand(VirtualSpaceList* vsl, size_t word_size) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1278
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1279 size_t committed_capacity_bytes = MetaspaceAux::allocated_capacity_bytes();
8790 7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1280 // If the user wants a limit, impose one.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1281 size_t max_metaspace_size_bytes = MaxMetaspaceSize;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1282 size_t metaspace_size_bytes = MetaspaceSize;
8790 7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1283 if (!FLAG_IS_DEFAULT(MaxMetaspaceSize) &&
7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1284 MetaspaceAux::reserved_in_bytes() >= MaxMetaspaceSize) {
7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1285 return false;
7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1286 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1287
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1288 // Class virtual space should always be expanded. Call GC for the other
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1289 // metadata virtual space.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1290 if (vsl == Metaspace::class_space_list()) return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1291
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1292 // If this is part of an allocation after a GC, expand
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1293 // unconditionally.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1294 if (MetaspaceGC::expand_after_GC()) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1295 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1296 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1297
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1298
8790 7f0cb32dd233 8004241: NPG: Metaspace occupies more memory than specified by -XX:MaxMetaspaceSize option mgerdin parents: 8786 diff changeset	1299
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1300 // If the capacity is below the minimum capacity, allow the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1301 // expansion. Also set the high-water-mark (capacity_until_GC)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1302 // to that minimum capacity so that a GC will not be induced
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1303 // until that minimum capacity is exceeded.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1304 if (committed_capacity_bytes < metaspace_size_bytes \|\|
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1305 capacity_until_GC() == 0) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1306 set_capacity_until_GC(metaspace_size_bytes);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1307 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1308 } else {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1309 if (committed_capacity_bytes < capacity_until_GC()) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1310 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1311 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1312 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1313 gclog_or_tty->print_cr(" allocation request size " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1314 " capacity_until_GC " SIZE_FORMAT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1315 " allocated_capacity_bytes " SIZE_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1316 word_size,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1317 capacity_until_GC(),
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1318 MetaspaceAux::allocated_capacity_bytes());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1319 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1320 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1321 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1322 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1323 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1324
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1325
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1326
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1327 void MetaspaceGC::compute_new_size() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1328 assert(_shrink_factor <= 100, "invalid shrink factor");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1329 uint current_shrink_factor = _shrink_factor;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1330 _shrink_factor = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1331
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1332 // Until a faster way of calculating the "used" quantity is implemented,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1333 // use "capacity".
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1334 const size_t used_after_gc = MetaspaceAux::allocated_capacity_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1335 const size_t capacity_until_GC = MetaspaceGC::capacity_until_GC();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1336
8040 a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1337 const double minimum_free_percentage = MinMetaspaceFreeRatio / 100.0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1338 const double maximum_used_percentage = 1.0 - minimum_free_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1339
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1340 const double min_tmp = used_after_gc / maximum_used_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1341 size_t minimum_desired_capacity =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1342 (size_t)MIN2(min_tmp, double(max_uintx));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1343 // Don't shrink less than the initial generation size
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1344 minimum_desired_capacity = MAX2(minimum_desired_capacity,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1345 MetaspaceSize);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1346
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1347 if (PrintGCDetails && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1348 gclog_or_tty->print_cr("\nMetaspaceGC::compute_new_size: ");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1349 gclog_or_tty->print_cr(" "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1350 " minimum_free_percentage: %6.2f"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1351 " maximum_used_percentage: %6.2f",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1352 minimum_free_percentage,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1353 maximum_used_percentage);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1354 gclog_or_tty->print_cr(" "
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1355 " used_after_gc : %6.1fKB",
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1356 used_after_gc / (double) K);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1357 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1358
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1359
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1360 size_t shrink_bytes = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1361 if (capacity_until_GC < minimum_desired_capacity) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1362 // If we have less capacity below the metaspace HWM, then
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1363 // increment the HWM.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1364 size_t expand_bytes = minimum_desired_capacity - capacity_until_GC;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1365 // Don't expand unless it's significant
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1366 if (expand_bytes >= MinMetaspaceExpansion) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1367 MetaspaceGC::set_capacity_until_GC(capacity_until_GC + expand_bytes);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1368 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1369 if (PrintGCDetails && Verbose) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1370 size_t new_capacity_until_GC = capacity_until_GC;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1371 gclog_or_tty->print_cr(" expanding:"
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1372 " minimum_desired_capacity: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1373 " expand_bytes: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1374 " MinMetaspaceExpansion: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1375 " new metaspace HWM: %6.1fKB",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1376 minimum_desired_capacity / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1377 expand_bytes / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1378 MinMetaspaceExpansion / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1379 new_capacity_until_GC / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1380 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1381 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1382 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1383
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1384 // No expansion, now see if we want to shrink
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1385 // We would never want to shrink more than this
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1386 size_t max_shrink_bytes = capacity_until_GC - minimum_desired_capacity;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1387 assert(max_shrink_bytes >= 0, err_msg("max_shrink_bytes " SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1388 max_shrink_bytes));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1389
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1390 // Should shrinking be considered?
8040 a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1391 if (MaxMetaspaceFreeRatio < 100) {
a83cd101fd62 8005452: NPG: Create new flags for Metaspace resizing policy jmasa parents: 8007 diff changeset	1392 const double maximum_free_percentage = MaxMetaspaceFreeRatio / 100.0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1393 const double minimum_used_percentage = 1.0 - maximum_free_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1394 const double max_tmp = used_after_gc / minimum_used_percentage;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1395 size_t maximum_desired_capacity = (size_t)MIN2(max_tmp, double(max_uintx));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1396 maximum_desired_capacity = MAX2(maximum_desired_capacity,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1397 MetaspaceSize);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1398 if (PrintGCDetails && Verbose) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1399 gclog_or_tty->print_cr(" "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1400 " maximum_free_percentage: %6.2f"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1401 " minimum_used_percentage: %6.2f",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1402 maximum_free_percentage,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1403 minimum_used_percentage);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1404 gclog_or_tty->print_cr(" "
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1405 " minimum_desired_capacity: %6.1fKB"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1406 " maximum_desired_capacity: %6.1fKB",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1407 minimum_desired_capacity / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1408 maximum_desired_capacity / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1409 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1410
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1411 assert(minimum_desired_capacity <= maximum_desired_capacity,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1412 "sanity check");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1413
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1414 if (capacity_until_GC > maximum_desired_capacity) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1415 // Capacity too large, compute shrinking size
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1416 shrink_bytes = capacity_until_GC - maximum_desired_capacity;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1417 // We don't want shrink all the way back to initSize if people call
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1418 // System.gc(), because some programs do that between "phases" and then
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1419 // we'd just have to grow the heap up again for the next phase. So we
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1420 // damp the shrinking: 0% on the first call, 10% on the second call, 40%
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1421 // on the third call, and 100% by the fourth call. But if we recompute
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1422 // size without shrinking, it goes back to 0%.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1423 shrink_bytes = shrink_bytes / 100 * current_shrink_factor;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1424 assert(shrink_bytes <= max_shrink_bytes,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1425 err_msg("invalid shrink size " SIZE_FORMAT " not <= " SIZE_FORMAT,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1426 shrink_bytes, max_shrink_bytes));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1427 if (current_shrink_factor == 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1428 _shrink_factor = 10;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1429 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1430 _shrink_factor = MIN2(current_shrink_factor * 4, (uint) 100);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1431 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1432 if (PrintGCDetails && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1433 gclog_or_tty->print_cr(" "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1434 " shrinking:"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1435 " initSize: %.1fK"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1436 " maximum_desired_capacity: %.1fK",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1437 MetaspaceSize / (double) K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1438 maximum_desired_capacity / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1439 gclog_or_tty->print_cr(" "
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1440 " shrink_bytes: %.1fK"
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1441 " current_shrink_factor: %d"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1442 " new shrink factor: %d"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1443 " MinMetaspaceExpansion: %.1fK",
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1444 shrink_bytes / (double) K,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1445 current_shrink_factor,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1446 _shrink_factor,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1447 MinMetaspaceExpansion / (double) K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1448 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1449 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1450 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1451
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1452 // Don't shrink unless it's significant
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1453 if (shrink_bytes >= MinMetaspaceExpansion &&
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1454 ((capacity_until_GC - shrink_bytes) >= MetaspaceSize)) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1455 MetaspaceGC::set_capacity_until_GC(capacity_until_GC - shrink_bytes);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1456 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1457 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1458
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1459 // Metadebug methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1460
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1461 void Metadebug::deallocate_chunk_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1462 size_t chunk_word_size){
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1463 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1464 VirtualSpaceList* vsl = sm->vs_list();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1465 if (MetaDataDeallocateALot &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1466 Metadebug::deallocate_chunk_a_lot_count() % MetaDataDeallocateALotInterval == 0 ) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1467 Metadebug::reset_deallocate_chunk_a_lot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1468 for (uint i = 0; i < metadata_deallocate_a_lock_chunk; i++) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1469 Metachunk* dummy_chunk = vsl->current_virtual_space()->take_from_committed(chunk_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1470 if (dummy_chunk == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1471 break;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1472 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1473 vsl->chunk_manager()->chunk_freelist_deallocate(dummy_chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1474
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1475 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1476 gclog_or_tty->print("Metadebug::deallocate_chunk_a_lot: %d) ",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1477 sm->sum_count_in_chunks_in_use());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1478 dummy_chunk->print_on(gclog_or_tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1479 gclog_or_tty->print_cr(" Free chunks total %d count %d",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1480 vsl->chunk_manager()->free_chunks_total(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1481 vsl->chunk_manager()->free_chunks_count());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1482 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1483 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1484 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1485 Metadebug::inc_deallocate_chunk_a_lot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1486 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1487 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1488 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1489
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1490 void Metadebug::deallocate_block_a_lot(SpaceManager* sm,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1491 size_t raw_word_size){
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1492 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1493 if (MetaDataDeallocateALot &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1494 Metadebug::deallocate_block_a_lot_count() % MetaDataDeallocateALotInterval == 0 ) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1495 Metadebug::set_deallocate_block_a_lot_count(0);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1496 for (uint i = 0; i < metadata_deallocate_a_lot_block; i++) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1497 MetaWord* dummy_block = sm->allocate_work(raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1498 if (dummy_block == 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1499 break;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1500 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1501 sm->deallocate(dummy_block, raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1502 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1503 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1504 Metadebug::inc_deallocate_block_a_lot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1505 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1506 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1507 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1508
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1509 void Metadebug::init_allocation_fail_alot_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1510 if (MetadataAllocationFailALot) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1511 _allocation_fail_alot_count =
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1512 1+(long)((double)MetadataAllocationFailALotInterval*os::random()/(max_jint+1.0));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1513 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1514 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1515
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1516 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1517 bool Metadebug::test_metadata_failure() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1518 if (MetadataAllocationFailALot &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1519 Threads::is_vm_complete()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1520 if (_allocation_fail_alot_count > 0) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1521 _allocation_fail_alot_count--;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1522 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1523 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1524 gclog_or_tty->print_cr("Metadata allocation failing for "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1525 "MetadataAllocationFailALot");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1526 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1527 init_allocation_fail_alot_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1528 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1529 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1530 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1531 return false;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1532 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1533 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1534
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1535 // ChunkManager methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1536
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1537 // Verification of _free_chunks_total and _free_chunks_count does not
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1538 // work with the CMS collector because its use of additional locks
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1539 // complicate the mutex deadlock detection but it can still be useful
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1540 // for detecting errors in the chunk accounting with other collectors.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1541
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1542 size_t ChunkManager::free_chunks_total() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1543 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1544 if (!UseConcMarkSweepGC && !SpaceManager::expand_lock()->is_locked()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1545 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1546 Mutex::_no_safepoint_check_flag);
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1547 slow_locked_verify_free_chunks_total();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1548 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1549 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1550 return _free_chunks_total;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1551 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1552
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1553 size_t ChunkManager::free_chunks_total_in_bytes() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1554 return free_chunks_total() * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1555 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1556
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1557 size_t ChunkManager::free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1558 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1559 if (!UseConcMarkSweepGC && !SpaceManager::expand_lock()->is_locked()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1560 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1561 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1562 // This lock is only needed in debug because the verification
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1563 // of the _free_chunks_totals walks the list of free chunks
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1564 slow_locked_verify_free_chunks_count();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1565 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1566 #endif
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1567 return _free_chunks_count;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1568 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1569
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1570 void ChunkManager::locked_verify_free_chunks_total() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1571 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1572 assert(sum_free_chunks() == _free_chunks_total,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1573 err_msg("_free_chunks_total " SIZE_FORMAT " is not the"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1574 " same as sum " SIZE_FORMAT, _free_chunks_total,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1575 sum_free_chunks()));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1576 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1577
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1578 void ChunkManager::verify_free_chunks_total() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1579 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1580 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1581 locked_verify_free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1582 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1583
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1584 void ChunkManager::locked_verify_free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1585 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1586 assert(sum_free_chunks_count() == _free_chunks_count,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1587 err_msg("_free_chunks_count " SIZE_FORMAT " is not the"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1588 " same as sum " SIZE_FORMAT, _free_chunks_count,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1589 sum_free_chunks_count()));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1590 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1591
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1592 void ChunkManager::verify_free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1593 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1594 MutexLockerEx cl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1595 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1596 locked_verify_free_chunks_count();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1597 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1598 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1599
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1600 void ChunkManager::verify() {
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1601 MutexLockerEx cl(SpaceManager::expand_lock(),
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1602 Mutex::_no_safepoint_check_flag);
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1603 locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1604 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1605
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1606 void ChunkManager::locked_verify() {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1607 locked_verify_free_chunks_count();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1608 locked_verify_free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1609 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1610
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1611 void ChunkManager::locked_print_free_chunks(outputStream* st) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1612 assert_lock_strong(SpaceManager::expand_lock());
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1613 st->print_cr("Free chunk total " SIZE_FORMAT " count " SIZE_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1614 _free_chunks_total, _free_chunks_count);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1615 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1616
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1617 void ChunkManager::locked_print_sum_free_chunks(outputStream* st) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1618 assert_lock_strong(SpaceManager::expand_lock());
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1619 st->print_cr("Sum free chunk total " SIZE_FORMAT " count " SIZE_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1620 sum_free_chunks(), sum_free_chunks_count());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1621 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1622 ChunkList* ChunkManager::free_chunks(ChunkIndex index) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1623 return &_free_chunks[index];
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1624 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1625
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1626 // These methods that sum the free chunk lists are used in printing
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1627 // methods that are used in product builds.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1628 size_t ChunkManager::sum_free_chunks() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1629 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1630 size_t result = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1631 for (ChunkIndex i = ZeroIndex; i < NumberOfFreeLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1632 ChunkList* list = free_chunks(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1633
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1634 if (list == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1635 continue;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1636 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1637
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1638 result = result + list->count() * list->size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1639 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1640 result = result + humongous_dictionary()->total_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1641 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1642 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1643
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1644 size_t ChunkManager::sum_free_chunks_count() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1645 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1646 size_t count = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1647 for (ChunkIndex i = ZeroIndex; i < NumberOfFreeLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1648 ChunkList* list = free_chunks(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1649 if (list == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1650 continue;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1651 }
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1652 count = count + list->count();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1653 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1654 count = count + humongous_dictionary()->total_free_blocks();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1655 return count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1656 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1657
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1658 ChunkList* ChunkManager::find_free_chunks_list(size_t word_size) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1659 ChunkIndex index = list_index(word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1660 assert(index < HumongousIndex, "No humongous list");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1661 return free_chunks(index);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1662 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1663
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1664 void ChunkManager::free_chunks_put(Metachunk* chunk) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1665 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1666 ChunkList* free_list = find_free_chunks_list(chunk->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1667 chunk->set_next(free_list->head());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1668 free_list->set_head(chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1669 // chunk is being returned to the chunk free list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1670 inc_free_chunks_total(chunk->capacity_word_size());
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1671 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1672 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1673
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1674 void ChunkManager::chunk_freelist_deallocate(Metachunk* chunk) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1675 // The deallocation of a chunk originates in the freelist
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1676 // manangement code for a Metaspace and does not hold the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1677 // lock.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1678 assert(chunk != NULL, "Deallocating NULL");
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1679 assert_lock_strong(SpaceManager::expand_lock());
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1680 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1681 if (TraceMetadataChunkAllocation) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1682 tty->print_cr("ChunkManager::chunk_freelist_deallocate: chunk "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1683 PTR_FORMAT " size " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1684 chunk, chunk->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1685 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1686 free_chunks_put(chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1687 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1688
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1689 Metachunk* ChunkManager::free_chunks_get(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1690 assert_lock_strong(SpaceManager::expand_lock());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1691
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1692 slow_locked_verify();
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1693
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1694 Metachunk* chunk = NULL;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1695 if (list_index(word_size) != HumongousIndex) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1696 ChunkList* free_list = find_free_chunks_list(word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1697 assert(free_list != NULL, "Sanity check");
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1698
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1699 chunk = free_list->head();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1700 debug_only(Metachunk* debug_head = chunk;)
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1701
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1702 if (chunk == NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1703 return NULL;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1704 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1705
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1706 // Remove the chunk as the head of the list.
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1707 free_list->remove_chunk(chunk);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1708
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1709 // Chunk is being removed from the chunks free list.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1710 dec_free_chunks_total(chunk->capacity_word_size());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1711
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1712 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1713 tty->print_cr("ChunkManager::free_chunks_get: free_list "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1714 PTR_FORMAT " head " PTR_FORMAT " size " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1715 free_list, chunk, chunk->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1716 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1717 } else {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1718 chunk = humongous_dictionary()->get_chunk(
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1719 word_size,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1720 FreeBlockDictionary<Metachunk>::atLeast);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1721
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1722 if (chunk != NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1723 if (TraceMetadataHumongousAllocation) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1724 size_t waste = chunk->word_size() - word_size;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1725 tty->print_cr("Free list allocate humongous chunk size " SIZE_FORMAT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1726 " for requested size " SIZE_FORMAT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1727 " waste " SIZE_FORMAT,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1728 chunk->word_size(), word_size, waste);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1729 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1730 // Chunk is being removed from the chunks free list.
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1731 dec_free_chunks_total(chunk->capacity_word_size());
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1732 } else {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1733 return NULL;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1734 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1735 }
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1736
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1737 // Remove it from the links to this freelist
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1738 chunk->set_next(NULL);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1739 chunk->set_prev(NULL);
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1740 #ifdef ASSERT
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1741 // Chunk is no longer on any freelist. Setting to false make container_count_slow()
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1742 // work.
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1743 chunk->set_is_free(false);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	1744 #endif
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1745 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1746 return chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1747 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1748
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1749 Metachunk* ChunkManager::chunk_freelist_allocate(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1750 assert_lock_strong(SpaceManager::expand_lock());
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	1751 slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1752
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1753 // Take from the beginning of the list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1754 Metachunk* chunk = free_chunks_get(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1755 if (chunk == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1756 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1757 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1758
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1759 assert((word_size <= chunk->word_size()) \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1760 list_index(chunk->word_size() == HumongousIndex),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1761 "Non-humongous variable sized chunk");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1762 if (TraceMetadataChunkAllocation) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1763 size_t list_count;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1764 if (list_index(word_size) < HumongousIndex) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1765 ChunkList* list = find_free_chunks_list(word_size);
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	1766 list_count = list->count();
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1767 } else {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1768 list_count = humongous_dictionary()->total_count();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1769 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1770 tty->print("ChunkManager::chunk_freelist_allocate: " PTR_FORMAT " chunk "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1771 PTR_FORMAT " size " SIZE_FORMAT " count " SIZE_FORMAT " ",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1772 this, chunk, chunk->word_size(), list_count);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1773 locked_print_free_chunks(tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1774 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1775
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1776 return chunk;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1777 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1778
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1779 void ChunkManager::print_on(outputStream* out) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1780 if (PrintFLSStatistics != 0) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1781 humongous_dictionary()->report_statistics();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1782 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1783 }
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1784
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1785 // SpaceManager methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1786
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1787 void SpaceManager::get_initial_chunk_sizes(Metaspace::MetaspaceType type,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1788 size_t* chunk_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1789 size_t* class_chunk_word_size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1790 switch (type) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1791 case Metaspace::BootMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1792 *chunk_word_size = Metaspace::first_chunk_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1793 *class_chunk_word_size = Metaspace::first_class_chunk_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1794 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1795 case Metaspace::ROMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1796 *chunk_word_size = SharedReadOnlySize / wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1797 *class_chunk_word_size = ClassSpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1798 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1799 case Metaspace::ReadWriteMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1800 *chunk_word_size = SharedReadWriteSize / wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1801 *class_chunk_word_size = ClassSpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1802 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1803 case Metaspace::AnonymousMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1804 case Metaspace::ReflectionMetaspaceType:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1805 *chunk_word_size = SpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1806 *class_chunk_word_size = ClassSpecializedChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1807 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1808 default:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1809 *chunk_word_size = SmallChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1810 *class_chunk_word_size = ClassSmallChunk;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1811 break;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1812 }
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	1813 assert(chunk_word_size != 0 && class_chunk_word_size != 0,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1814 err_msg("Initial chunks sizes bad: data " SIZE_FORMAT
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1815 " class " SIZE_FORMAT,
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	1816 chunk_word_size, class_chunk_word_size));
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1817 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1818
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1819 size_t SpaceManager::sum_free_in_chunks_in_use() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1820 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1821 size_t free = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1822 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1823 Metachunk* chunk = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1824 while (chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1825 free += chunk->free_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1826 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1827 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1828 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1829 return free;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1830 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1831
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1832 size_t SpaceManager::sum_waste_in_chunks_in_use() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1833 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1834 size_t result = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1835 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1836 result += sum_waste_in_chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1837 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1838
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1839 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1840 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1841
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1842 size_t SpaceManager::sum_waste_in_chunks_in_use(ChunkIndex index) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1843 size_t result = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1844 Metachunk* chunk = chunks_in_use(index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1845 // Count the free space in all the chunk but not the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1846 // current chunk from which allocations are still being done.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1847 if (chunk != NULL) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1848 Metachunk* prev = chunk;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1849 while (chunk != NULL && chunk != current_chunk()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1850 result += chunk->free_word_size();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1851 prev = chunk;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1852 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1853 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1854 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1855 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1856 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1857
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1858 size_t SpaceManager::sum_capacity_in_chunks_in_use() const {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1859 // For CMS use "allocated_chunks_words()" which does not need the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1860 // Metaspace lock. For the other collectors sum over the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1861 // lists. Use both methods as a check that "allocated_chunks_words()"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1862 // is correct. That is, sum_capacity_in_chunks() is too expensive
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1863 // to use in the product and allocated_chunks_words() should be used
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1864 // but allow for checking that allocated_chunks_words() returns the same
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1865 // value as sum_capacity_in_chunks_in_use() which is the definitive
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1866 // answer.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1867 if (UseConcMarkSweepGC) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1868 return allocated_chunks_words();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1869 } else {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1870 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1871 size_t sum = 0;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1872 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1873 Metachunk* chunk = chunks_in_use(i);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1874 while (chunk != NULL) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1875 sum += chunk->capacity_word_size();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1876 chunk = chunk->next();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1877 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1878 }
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	1879 return sum;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1880 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1881 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1882
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1883 size_t SpaceManager::sum_count_in_chunks_in_use() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1884 size_t count = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1885 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1886 count = count + sum_count_in_chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1887 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1888
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1889 return count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1890 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1891
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1892 size_t SpaceManager::sum_count_in_chunks_in_use(ChunkIndex i) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1893 size_t count = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1894 Metachunk* chunk = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1895 while (chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1896 count++;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1897 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1898 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1899 return count;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1900 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1901
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1902
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1903 size_t SpaceManager::sum_used_in_chunks_in_use() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1904 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1905 size_t used = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1906 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1907 Metachunk* chunk = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1908 while (chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1909 used += chunk->used_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1910 chunk = chunk->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1911 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1912 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1913 return used;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1914 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1915
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1916 void SpaceManager::locked_print_chunks_in_use_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1917
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1918 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1919 Metachunk* chunk = chunks_in_use(i);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1920 st->print("SpaceManager: %s " PTR_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1921 chunk_size_name(i), chunk);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1922 if (chunk != NULL) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1923 st->print_cr(" free " SIZE_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1924 chunk->free_word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1925 } else {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1926 st->print_cr("");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1927 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1928 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1929
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1930 vs_list()->chunk_manager()->locked_print_free_chunks(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1931 vs_list()->chunk_manager()->locked_print_sum_free_chunks(st);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1932 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1933
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1934 size_t SpaceManager::calc_chunk_size(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1935
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1936 // Decide between a small chunk and a medium chunk. Up to
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1937 // _small_chunk_limit small chunks can be allocated but
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1938 // once a medium chunk has been allocated, no more small
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1939 // chunks will be allocated.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1940 size_t chunk_word_size;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1941 if (chunks_in_use(MediumIndex) == NULL &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1942 (!has_small_chunk_limit() \|\|
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1943 sum_count_in_chunks_in_use(SmallIndex) < _small_chunk_limit)) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1944 chunk_word_size = (size_t) small_chunk_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1945 if (word_size + Metachunk::overhead() > small_chunk_size()) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1946 chunk_word_size = medium_chunk_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1947 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1948 } else {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1949 chunk_word_size = medium_chunk_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1950 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1951
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1952 // Might still need a humongous chunk. Enforce an
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1953 // eight word granularity to facilitate reuse (some
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1954 // wastage but better chance of reuse).
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1955 size_t if_humongous_sized_chunk =
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1956 align_size_up(word_size + Metachunk::overhead(),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1957 HumongousChunkGranularity);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1958 chunk_word_size =
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1959 MAX2((size_t) chunk_word_size, if_humongous_sized_chunk);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1960
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1961 assert(!SpaceManager::is_humongous(word_size) \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1962 chunk_word_size == if_humongous_sized_chunk,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1963 err_msg("Size calculation is wrong, word_size " SIZE_FORMAT
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1964 " chunk_word_size " SIZE_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1965 word_size, chunk_word_size));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1966 if (TraceMetadataHumongousAllocation &&
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1967 SpaceManager::is_humongous(word_size)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1968 gclog_or_tty->print_cr("Metadata humongous allocation:");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1969 gclog_or_tty->print_cr(" word_size " PTR_FORMAT, word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1970 gclog_or_tty->print_cr(" chunk_word_size " PTR_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1971 chunk_word_size);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1972 gclog_or_tty->print_cr(" chunk overhead " PTR_FORMAT,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1973 Metachunk::overhead());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1974 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1975 return chunk_word_size;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1976 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1977
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	1978 MetaWord* SpaceManager::grow_and_allocate(size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1979 assert(vs_list()->current_virtual_space() != NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1980 "Should have been set");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1981 assert(current_chunk() == NULL \|\|
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1982 current_chunk()->allocate(word_size) == NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1983 "Don't need to expand");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1984 MutexLockerEx cl(SpaceManager::expand_lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1985
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1986 if (TraceMetadataChunkAllocation && Verbose) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1987 size_t words_left = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1988 size_t words_used = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1989 if (current_chunk() != NULL) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1990 words_left = current_chunk()->free_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1991 words_used = current_chunk()->used_word_size();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1992 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1993 gclog_or_tty->print_cr("SpaceManager::grow_and_allocate for " SIZE_FORMAT
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1994 " words " SIZE_FORMAT " words used " SIZE_FORMAT
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1995 " words left",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	1996 word_size, words_used, words_left);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1997 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1998
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	1999 // Get another chunk out of the virtual space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2000 size_t grow_chunks_by_words = calc_chunk_size(word_size);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2001 Metachunk* next = get_new_chunk(word_size, grow_chunks_by_words);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2002
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2003 // If a chunk was available, add it to the in-use chunk list
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2004 // and do an allocation from it.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2005 if (next != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2006 Metadebug::deallocate_chunk_a_lot(this, grow_chunks_by_words);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2007 // Add to this manager's list of chunks in use.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2008 add_chunk(next, false);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2009 return next->allocate(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2010 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2011 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2012 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2013
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2014 void SpaceManager::print_on(outputStream* st) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2015
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2016 for (ChunkIndex i = ZeroIndex;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2017 i < NumberOfInUseLists ;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2018 i = next_chunk_index(i) ) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2019 st->print_cr(" chunks_in_use " PTR_FORMAT " chunk size " PTR_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2020 chunks_in_use(i),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2021 chunks_in_use(i) == NULL ? 0 : chunks_in_use(i)->word_size());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2022 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2023 st->print_cr(" waste: Small " SIZE_FORMAT " Medium " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2024 " Humongous " SIZE_FORMAT,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2025 sum_waste_in_chunks_in_use(SmallIndex),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2026 sum_waste_in_chunks_in_use(MediumIndex),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2027 sum_waste_in_chunks_in_use(HumongousIndex));
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2028 // block free lists
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2029 if (block_freelists() != NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2030 st->print_cr("total in block free lists " SIZE_FORMAT,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2031 block_freelists()->total_size());
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2032 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2033 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2034
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2035 SpaceManager::SpaceManager(Mutex* lock,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2036 VirtualSpaceList* vs_list) :
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2037 _vs_list(vs_list),
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2038 _allocated_blocks_words(0),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2039 _allocated_chunks_words(0),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2040 _allocated_chunks_count(0),
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2041 _lock(lock)
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2042 {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2043 initialize();
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2044 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2045
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2046 void SpaceManager::inc_size_metrics(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2047 assert_lock_strong(SpaceManager::expand_lock());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2048 // Total of allocated Metachunks and allocated Metachunks count
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2049 // for each SpaceManager
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2050 _allocated_chunks_words = _allocated_chunks_words + words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2051 _allocated_chunks_count++;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2052 // Global total of capacity in allocated Metachunks
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2053 MetaspaceAux::inc_capacity(words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2054 // Global total of allocated Metablocks.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2055 // used_words_slow() includes the overhead in each
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2056 // Metachunk so include it in the used when the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2057 // Metachunk is first added (so only added once per
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2058 // Metachunk).
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2059 MetaspaceAux::inc_used(Metachunk::overhead());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2060 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2061
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2062 void SpaceManager::inc_used_metrics(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2063 // Add to the per SpaceManager total
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2064 Atomic::add_ptr(words, &_allocated_blocks_words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2065 // Add to the global total
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2066 MetaspaceAux::inc_used(words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2067 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2068
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2069 void SpaceManager::dec_total_from_size_metrics() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2070 MetaspaceAux::dec_capacity(allocated_chunks_words());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2071 MetaspaceAux::dec_used(allocated_blocks_words());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2072 // Also deduct the overhead per Metachunk
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2073 MetaspaceAux::dec_used(allocated_chunks_count() * Metachunk::overhead());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2074 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2075
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2076 void SpaceManager::initialize() {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2077 Metadebug::init_allocation_fail_alot_count();
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2078 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2079 _chunks_in_use[i] = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2080 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2081 _current_chunk = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2082 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2083 gclog_or_tty->print_cr("SpaceManager(): " PTR_FORMAT, this);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2084 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2085 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2086
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2087 void ChunkManager::return_chunks(ChunkIndex index, Metachunk* chunks) {
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2088 if (chunks == NULL) {
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2089 return;
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2090 }
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2091 ChunkList* list = free_chunks(index);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2092 assert(list->size() == chunks->word_size(), "Mismatch in chunk sizes");
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2093 assert_lock_strong(SpaceManager::expand_lock());
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2094 Metachunk* cur = chunks;
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2095
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2096 // This returns chunks one at a time. If a new
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2097 // class List can be created that is a base class
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2098 // of FreeList then something like FreeList::prepend()
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2099 // can be used in place of this loop
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2100 while (cur != NULL) {
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2101 assert(cur->container() != NULL, "Container should have been set");
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2102 cur->container()->dec_container_count();
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2103 // Capture the next link before it is changed
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2104 // by the call to return_chunk_at_head();
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2105 Metachunk* next = cur->next();
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2106 cur->set_is_free(true);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2107 list->return_chunk_at_head(cur);
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2108 cur = next;
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2109 }
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2110 }
df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2111
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2112 SpaceManager::~SpaceManager() {
8784 79af1312fc2c 8005602: NPG: classunloading does not happen while CMS GC with -XX:+CMSClassUnloadingEnabled is used mgerdin parents: 8738 diff changeset	2113 // This call this->_lock which can't be done while holding expand_lock()
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2114 assert(sum_capacity_in_chunks_in_use() == allocated_chunks_words(),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2115 err_msg("sum_capacity_in_chunks_in_use() " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2116 " allocated_chunks_words() " SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2117 sum_capacity_in_chunks_in_use(), allocated_chunks_words()));
8784 79af1312fc2c 8005602: NPG: classunloading does not happen while CMS GC with -XX:+CMSClassUnloadingEnabled is used mgerdin parents: 8738 diff changeset	2118
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2119 MutexLockerEx fcl(SpaceManager::expand_lock(),
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2120 Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2121
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2122 ChunkManager* chunk_manager = vs_list()->chunk_manager();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2123
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2124 chunk_manager->slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2125
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2126 dec_total_from_size_metrics();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2127
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2128 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2129 gclog_or_tty->print_cr("~SpaceManager(): " PTR_FORMAT, this);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2130 locked_print_chunks_in_use_on(gclog_or_tty);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2131 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2132
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2133 // Do not mangle freed Metachunks. The chunk size inside Metachunks
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2134 // is during the freeing of a VirtualSpaceNodes.
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	2135
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2136 // Have to update before the chunks_in_use lists are emptied
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2137 // below.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2138 chunk_manager->inc_free_chunks_total(allocated_chunks_words(),
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2139 sum_count_in_chunks_in_use());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2140
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2141 // Add all the chunks in use by this space manager
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2142 // to the global list of free chunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2143
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2144 // Follow each list of chunks-in-use and add them to the
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2145 // free lists. Each list is NULL terminated.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2146
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2147 for (ChunkIndex i = ZeroIndex; i < HumongousIndex; i = next_chunk_index(i)) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2148 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2149 gclog_or_tty->print_cr("returned %d %s chunks to freelist",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2150 sum_count_in_chunks_in_use(i),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2151 chunk_size_name(i));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2152 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2153 Metachunk* chunks = chunks_in_use(i);
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2154 chunk_manager->return_chunks(i, chunks);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2155 set_chunks_in_use(i, NULL);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2156 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2157 gclog_or_tty->print_cr("updated freelist count %d %s",
10101 df254344edf1 8011173: NPG: Replace the ChunkList implementation with class FreeList<Metachunk> jmasa parents: 8813 diff changeset	2158 chunk_manager->free_chunks(i)->count(),
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2159 chunk_size_name(i));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2160 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2161 assert(i != HumongousIndex, "Humongous chunks are handled explicitly later");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2162 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2163
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2164 // The medium chunk case may be optimized by passing the head and
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2165 // tail of the medium chunk list to add_at_head(). The tail is often
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2166 // the current chunk but there are probably exceptions.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2167
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2168 // Humongous chunks
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2169 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2170 gclog_or_tty->print_cr("returned %d %s humongous chunks to dictionary",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2171 sum_count_in_chunks_in_use(HumongousIndex),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2172 chunk_size_name(HumongousIndex));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2173 gclog_or_tty->print("Humongous chunk dictionary: ");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2174 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2175 // Humongous chunks are never the current chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2176 Metachunk* humongous_chunks = chunks_in_use(HumongousIndex);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2177
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2178 while (humongous_chunks != NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2179 #ifdef ASSERT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2180 humongous_chunks->set_is_free(true);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2181 #endif
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2182 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2183 gclog_or_tty->print(PTR_FORMAT " (" SIZE_FORMAT ") ",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2184 humongous_chunks,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2185 humongous_chunks->word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2186 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2187 assert(humongous_chunks->word_size() == (size_t)
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2188 align_size_up(humongous_chunks->word_size(),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2189 HumongousChunkGranularity),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2190 err_msg("Humongous chunk size is wrong: word size " SIZE_FORMAT
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2191 " granularity %d",
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2192 humongous_chunks->word_size(), HumongousChunkGranularity));
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2193 Metachunk* next_humongous_chunks = humongous_chunks->next();
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	2194 humongous_chunks->container()->dec_container_count();
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2195 chunk_manager->humongous_dictionary()->return_chunk(humongous_chunks);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2196 humongous_chunks = next_humongous_chunks;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2197 }
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2198 if (TraceMetadataChunkAllocation && Verbose) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2199 gclog_or_tty->print_cr("");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2200 gclog_or_tty->print_cr("updated dictionary count %d %s",
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2201 chunk_manager->humongous_dictionary()->total_count(),
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2202 chunk_size_name(HumongousIndex));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2203 }
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2204 chunk_manager->slow_locked_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2205 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2206
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2207 const char* SpaceManager::chunk_size_name(ChunkIndex index) const {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2208 switch (index) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2209 case SpecializedIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2210 return "Specialized";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2211 case SmallIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2212 return "Small";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2213 case MediumIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2214 return "Medium";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2215 case HumongousIndex:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2216 return "Humongous";
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2217 default:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2218 return NULL;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2219 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2220 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2221
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2222 ChunkIndex ChunkManager::list_index(size_t size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2223 switch (size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2224 case SpecializedChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2225 assert(SpecializedChunk == ClassSpecializedChunk,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2226 "Need branch for ClassSpecializedChunk");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2227 return SpecializedIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2228 case SmallChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2229 case ClassSmallChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2230 return SmallIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2231 case MediumChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2232 case ClassMediumChunk:
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2233 return MediumIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2234 default:
7447 1de1b145f6bc 8005486: NPG: Incorrect assertion in ChunkManager::list_index() jmasa parents: 7446 diff changeset	2235 assert(size > MediumChunk \|\| size > ClassMediumChunk,
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2236 "Not a humongous chunk");
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2237 return HumongousIndex;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2238 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2239 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2240
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2241 void SpaceManager::deallocate(MetaWord* p, size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2242 assert_lock_strong(_lock);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2243 size_t min_size = TreeChunk<Metablock, FreeList>::min_size();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2244 assert(word_size >= min_size,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2245 err_msg("Should not deallocate dark matter " SIZE_FORMAT, word_size));
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2246 block_freelists()->return_block(p, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2247 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2248
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2249 // Adds a chunk to the list of chunks in use.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2250 void SpaceManager::add_chunk(Metachunk* new_chunk, bool make_current) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2251
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2252 assert(new_chunk != NULL, "Should not be NULL");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2253 assert(new_chunk->next() == NULL, "Should not be on a list");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2254
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2255 new_chunk->reset_empty();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2256
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2257 // Find the correct list and and set the current
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2258 // chunk for that list.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2259 ChunkIndex index = ChunkManager::list_index(new_chunk->word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2260
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2261 if (index != HumongousIndex) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2262 set_current_chunk(new_chunk);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2263 new_chunk->set_next(chunks_in_use(index));
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2264 set_chunks_in_use(index, new_chunk);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2265 } else {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2266 // For null class loader data and DumpSharedSpaces, the first chunk isn't
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2267 // small, so small will be null. Link this first chunk as the current
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2268 // chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2269 if (make_current) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2270 // Set as the current chunk but otherwise treat as a humongous chunk.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2271 set_current_chunk(new_chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2272 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2273 // Link at head. The _current_chunk only points to a humongous chunk for
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2274 // the null class loader metaspace (class and data virtual space managers)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2275 // any humongous chunks so will not point to the tail
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2276 // of the humongous chunks list.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2277 new_chunk->set_next(chunks_in_use(HumongousIndex));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2278 set_chunks_in_use(HumongousIndex, new_chunk);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2279
7447 1de1b145f6bc 8005486: NPG: Incorrect assertion in ChunkManager::list_index() jmasa parents: 7446 diff changeset	2280 assert(new_chunk->word_size() > medium_chunk_size(), "List inconsistency");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2281 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2282
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2283 // Add to the running sum of capacity
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2284 inc_size_metrics(new_chunk->word_size());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2285
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2286 assert(new_chunk->is_empty(), "Not ready for reuse");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2287 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2288 gclog_or_tty->print("SpaceManager::add_chunk: %d) ",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2289 sum_count_in_chunks_in_use());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2290 new_chunk->print_on(gclog_or_tty);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2291 if (vs_list() != NULL) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2292 vs_list()->chunk_manager()->locked_print_free_chunks(tty);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2293 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2294 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2295 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2296
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2297 Metachunk* SpaceManager::get_new_chunk(size_t word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2298 size_t grow_chunks_by_words) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2299
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2300 Metachunk* next = vs_list()->get_new_chunk(word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2301 grow_chunks_by_words,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2302 medium_chunk_bunch());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2303
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2304 if (TraceMetadataHumongousAllocation &&
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2305 SpaceManager::is_humongous(next->word_size())) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2306 gclog_or_tty->print_cr(" new humongous chunk word size " PTR_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2307 next->word_size());
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2308 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2309
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2310 return next;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2311 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2312
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2313 MetaWord* SpaceManager::allocate(size_t word_size) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2314 MutexLockerEx cl(lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2315
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2316 // If only the dictionary is going to be used (i.e., no
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2317 // indexed free list), then there is a minimum size requirement.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2318 // MinChunkSize is a placeholder for the real minimum size JJJ
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2319 size_t byte_size = word_size * BytesPerWord;
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2320
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2321 size_t byte_size_with_overhead = byte_size + Metablock::overhead();
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2322
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2323 size_t raw_bytes_size = MAX2(byte_size_with_overhead,
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2324 Metablock::min_block_byte_size());
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2325 raw_bytes_size = ARENA_ALIGN(raw_bytes_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2326 size_t raw_word_size = raw_bytes_size / BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2327 assert(raw_word_size * BytesPerWord == raw_bytes_size, "Size problem");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2328
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2329 BlockFreelist* fl = block_freelists();
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2330 MetaWord* p = NULL;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2331 // Allocation from the dictionary is expensive in the sense that
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2332 // the dictionary has to be searched for a size. Don't allocate
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2333 // from the dictionary until it starts to get fat. Is this
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2334 // a reasonable policy? Maybe an skinny dictionary is fast enough
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2335 // for allocations. Do some profiling. JJJ
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2336 if (fl->total_size() > allocation_from_dictionary_limit) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2337 p = fl->get_block(raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2338 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2339 if (p == NULL) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2340 p = allocate_work(raw_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2341 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2342 Metadebug::deallocate_block_a_lot(this, raw_word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2343
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2344 return p;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2345 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2346
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2347 // Returns the address of spaced allocated for "word_size".
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2348 // This methods does not know about blocks (Metablocks)
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2349 MetaWord* SpaceManager::allocate_work(size_t word_size) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2350 assert_lock_strong(_lock);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2351 #ifdef ASSERT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2352 if (Metadebug::test_metadata_failure()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2353 return NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2354 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2355 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2356 // Is there space in the current chunk?
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2357 MetaWord* result = NULL;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2358
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2359 // For DumpSharedSpaces, only allocate out of the current chunk which is
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2360 // never null because we gave it the size we wanted. Caller reports out
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2361 // of memory if this returns null.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2362 if (DumpSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2363 assert(current_chunk() != NULL, "should never happen");
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2364 inc_used_metrics(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2365 return current_chunk()->allocate(word_size); // caller handles null result
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2366 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2367 if (current_chunk() != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2368 result = current_chunk()->allocate(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2369 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2370
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2371 if (result == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2372 result = grow_and_allocate(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2373 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2374 if (result > 0) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2375 inc_used_metrics(word_size);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2376 assert(result != (MetaWord*) chunks_in_use(MediumIndex),
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2377 "Head of the list is being allocated");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2378 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2379
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2380 return result;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2381 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2382
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2383 void SpaceManager::verify() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2384 // If there are blocks in the dictionary, then
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2385 // verfication of chunks does not work since
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2386 // being in the dictionary alters a chunk.
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2387 if (block_freelists()->total_size() == 0) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2388 for (ChunkIndex i = ZeroIndex; i < NumberOfInUseLists; i = next_chunk_index(i)) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2389 Metachunk* curr = chunks_in_use(i);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2390 while (curr != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2391 curr->verify();
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2392 verify_chunk_size(curr);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2393 curr = curr->next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2394 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2395 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2396 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2397 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2398
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2399 void SpaceManager::verify_chunk_size(Metachunk* chunk) {
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2400 assert(is_humongous(chunk->word_size()) \|\|
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2401 chunk->word_size() == medium_chunk_size() \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2402 chunk->word_size() == small_chunk_size() \|\|
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2403 chunk->word_size() == specialized_chunk_size(),
7208 eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2404 "Chunk size is wrong");
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2405 return;
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2406 }
eade6b2e4782 8003554: NPG: move Metablock and Metachunk code out of metaspace.cpp jmasa parents: 7187 diff changeset	2407
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2408 #ifdef ASSERT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2409 void SpaceManager::verify_allocated_blocks_words() {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2410 // Verification is only guaranteed at a safepoint.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2411 assert(SafepointSynchronize::is_at_safepoint() \|\| !Universe::is_fully_initialized(),
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2412 "Verification can fail if the applications is running");
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2413 assert(allocated_blocks_words() == sum_used_in_chunks_in_use(),
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2414 err_msg("allocation total is not consistent " SIZE_FORMAT
d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2415 " vs " SIZE_FORMAT,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2416 allocated_blocks_words(), sum_used_in_chunks_in_use()));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2417 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2418
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2419 #endif
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2420
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2421 void SpaceManager::dump(outputStream* const out) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2422 size_t curr_total = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2423 size_t waste = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2424 uint i = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2425 size_t used = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2426 size_t capacity = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2427
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2428 // Add up statistics for all chunks in this SpaceManager.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2429 for (ChunkIndex index = ZeroIndex;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2430 index < NumberOfInUseLists;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2431 index = next_chunk_index(index)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2432 for (Metachunk* curr = chunks_in_use(index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2433 curr != NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2434 curr = curr->next()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2435 out->print("%d) ", i++);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2436 curr->print_on(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2437 if (TraceMetadataChunkAllocation && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2438 block_freelists()->print_on(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2439 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2440 curr_total += curr->word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2441 used += curr->used_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2442 capacity += curr->capacity_word_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2443 waste += curr->free_word_size() + curr->overhead();;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2444 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2445 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2446
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2447 size_t free = current_chunk() == NULL ? 0 : current_chunk()->free_word_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2448 // Free space isn't wasted.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2449 waste -= free;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2450
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2451 out->print_cr("total of all chunks " SIZE_FORMAT " used " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2452 " free " SIZE_FORMAT " capacity " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2453 " waste " SIZE_FORMAT, curr_total, used, free, capacity, waste);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2454 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2455
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	2456 #ifndef PRODUCT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2457 void SpaceManager::mangle_freed_chunks() {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2458 for (ChunkIndex index = ZeroIndex;
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2459 index < NumberOfInUseLists;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2460 index = next_chunk_index(index)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2461 for (Metachunk* curr = chunks_in_use(index);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2462 curr != NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2463 curr = curr->next()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2464 curr->mangle();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2465 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2466 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2467 }
7185 90273fc0a981 8000662: NPG: nashorn ant clean test262 out-of-memory with Java heap coleenp parents: 6969 diff changeset	2468 #endif // PRODUCT
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2469
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2470 // MetaspaceAux
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2471
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2472
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2473 size_t MetaspaceAux::_allocated_capacity_words = 0;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2474 size_t MetaspaceAux::_allocated_used_words = 0;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2475
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2476 size_t MetaspaceAux::free_bytes() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2477 size_t result = 0;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2478 if (Metaspace::class_space_list() != NULL) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2479 result = result + Metaspace::class_space_list()->free_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2480 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2481 if (Metaspace::space_list() != NULL) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2482 result = result + Metaspace::space_list()->free_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2483 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2484 return result;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2485 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2486
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2487 void MetaspaceAux::dec_capacity(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2488 assert_lock_strong(SpaceManager::expand_lock());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2489 assert(words <= _allocated_capacity_words,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2490 err_msg("About to decrement below 0: words " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2491 " is greater than _allocated_capacity_words " SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2492 words, _allocated_capacity_words));
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2493 _allocated_capacity_words = _allocated_capacity_words - words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2494 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2495
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2496 void MetaspaceAux::inc_capacity(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2497 assert_lock_strong(SpaceManager::expand_lock());
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2498 // Needs to be atomic
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2499 _allocated_capacity_words = _allocated_capacity_words + words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2500 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2501
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2502 void MetaspaceAux::dec_used(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2503 assert(words <= _allocated_used_words,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2504 err_msg("About to decrement below 0: words " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2505 " is greater than _allocated_used_words " SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2506 words, _allocated_used_words));
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2507 // For CMS deallocation of the Metaspaces occurs during the
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2508 // sweep which is a concurrent phase. Protection by the expand_lock()
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2509 // is not enough since allocation is on a per Metaspace basis
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2510 // and protected by the Metaspace lock.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2511 jlong minus_words = (jlong) - (jlong) words;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2512 Atomic::add_ptr(minus_words, &_allocated_used_words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2513 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2514
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2515 void MetaspaceAux::inc_used(size_t words) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2516 // _allocated_used_words tracks allocations for
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2517 // each piece of metadata. Those allocations are
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2518 // generally done concurrently by different application
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2519 // threads so must be done atomically.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2520 Atomic::add_ptr(words, &_allocated_used_words);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2521 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2522
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2523 size_t MetaspaceAux::used_bytes_slow(Metaspace::MetadataType mdtype) {
6730 5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2524 size_t used = 0;
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2525 ClassLoaderDataGraphMetaspaceIterator iter;
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2526 while (iter.repeat()) {
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2527 Metaspace* msp = iter.get_next();
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2528 // Sum allocated_blocks_words for each metaspace
6730 5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2529 if (msp != NULL) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2530 used += msp->used_words_slow(mdtype);
6730 5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2531 }
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2532 }
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2533 return used * BytesPerWord;
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2534 }
5d2156bcb78b 7195789: NPG: assert(used + free == capacity) failed: Accounting is wrong jmasa parents: 6726 diff changeset	2535
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2536 size_t MetaspaceAux::free_in_bytes(Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2537 size_t free = 0;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2538 ClassLoaderDataGraphMetaspaceIterator iter;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2539 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2540 Metaspace* msp = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2541 if (msp != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2542 free += msp->free_words(mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2543 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2544 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2545 return free * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2546 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2547
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2548 size_t MetaspaceAux::capacity_bytes_slow(Metaspace::MetadataType mdtype) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2549 // Don't count the space in the freelists. That space will be
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2550 // added to the capacity calculation as needed.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2551 size_t capacity = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2552 ClassLoaderDataGraphMetaspaceIterator iter;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2553 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2554 Metaspace* msp = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2555 if (msp != NULL) {
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2556 capacity += msp->capacity_words_slow(mdtype);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2557 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2558 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2559 return capacity * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2560 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2561
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2562 size_t MetaspaceAux::reserved_in_bytes(Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2563 size_t reserved = (mdtype == Metaspace::ClassType) ?
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2564 Metaspace::class_space_list()->virtual_space_total() :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2565 Metaspace::space_list()->virtual_space_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2566 return reserved * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2567 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2568
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2569 size_t MetaspaceAux::min_chunk_size() { return Metaspace::first_chunk_word_size(); }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2570
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2571 size_t MetaspaceAux::free_chunks_total(Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2572 ChunkManager* chunk = (mdtype == Metaspace::ClassType) ?
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2573 Metaspace::class_space_list()->chunk_manager() :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2574 Metaspace::space_list()->chunk_manager();
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2575 chunk->slow_verify();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2576 return chunk->free_chunks_total();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2577 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2578
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2579 size_t MetaspaceAux::free_chunks_total_in_bytes(Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2580 return free_chunks_total(mdtype) * BytesPerWord;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2581 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2582
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2583 size_t MetaspaceAux::free_chunks_total() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2584 return free_chunks_total(Metaspace::ClassType) +
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2585 free_chunks_total(Metaspace::NonClassType);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2586 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2587
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2588 size_t MetaspaceAux::free_chunks_total_in_bytes() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2589 return free_chunks_total() * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2590 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2591
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2592 void MetaspaceAux::print_metaspace_change(size_t prev_metadata_used) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2593 gclog_or_tty->print(", [Metaspace:");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2594 if (PrintGCDetails && Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2595 gclog_or_tty->print(" " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2596 "->" SIZE_FORMAT
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2597 "(" SIZE_FORMAT ")",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2598 prev_metadata_used,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2599 allocated_capacity_bytes(),
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2600 reserved_in_bytes());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2601 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2602 gclog_or_tty->print(" " SIZE_FORMAT "K"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2603 "->" SIZE_FORMAT "K"
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2604 "(" SIZE_FORMAT "K)",
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2605 prev_metadata_used / K,
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2606 allocated_capacity_bytes() / K,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2607 reserved_in_bytes()/ K);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2608 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2609
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2610 gclog_or_tty->print("]");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2611 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2612
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2613 // This is printed when PrintGCDetails
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2614 void MetaspaceAux::print_on(outputStream* out) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2615 Metaspace::MetadataType ct = Metaspace::ClassType;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2616 Metaspace::MetadataType nct = Metaspace::NonClassType;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2617
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2618 out->print_cr(" Metaspace total "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2619 SIZE_FORMAT "K, used " SIZE_FORMAT "K,"
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2620 " reserved " SIZE_FORMAT "K",
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2621 allocated_capacity_bytes()/K, allocated_used_bytes()/K, reserved_in_bytes()/K);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2622 #if 0
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2623 // The calls to capacity_bytes_slow() and used_bytes_slow() cause
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2624 // lock ordering assertion failures with some collectors. Do
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2625 // not include this code until the lock ordering is fixed.
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2626 if (PrintGCDetails && Verbose) {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2627 out->print_cr(" data space "
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2628 SIZE_FORMAT "K, used " SIZE_FORMAT "K,"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2629 " reserved " SIZE_FORMAT "K",
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2630 capacity_bytes_slow(nct)/K, used_bytes_slow(nct)/K, reserved_in_bytes(nct)/K);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2631 out->print_cr(" class space "
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2632 SIZE_FORMAT "K, used " SIZE_FORMAT "K,"
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2633 " reserved " SIZE_FORMAT "K",
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2634 capacity_bytes_slow(ct)/K, used_bytes_slow(ct)/K, reserved_in_bytes(ct)/K);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2635 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2636 #endif
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2637 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2638
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2639 // Print information for class space and data space separately.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2640 // This is almost the same as above.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2641 void MetaspaceAux::print_on(outputStream* out, Metaspace::MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2642 size_t free_chunks_capacity_bytes = free_chunks_total_in_bytes(mdtype);
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2643 size_t capacity_bytes = capacity_bytes_slow(mdtype);
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2644 size_t used_bytes = used_bytes_slow(mdtype);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2645 size_t free_bytes = free_in_bytes(mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2646 size_t used_and_free = used_bytes + free_bytes +
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2647 free_chunks_capacity_bytes;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2648 out->print_cr(" Chunk accounting: used in chunks " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2649 "K + unused in chunks " SIZE_FORMAT "K + "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2650 " capacity in free chunks " SIZE_FORMAT "K = " SIZE_FORMAT
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2651 "K capacity in allocated chunks " SIZE_FORMAT "K",
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2652 used_bytes / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2653 free_bytes / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2654 free_chunks_capacity_bytes / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2655 used_and_free / K,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2656 capacity_bytes / K);
8738 1c88b99a2b01 8009282: Assertion "assert(used_and_free == capacity_bytes) failed: Accounting is wrong" failed with -XX:+Verbose -XX:+TraceMetadataChunkAllocation mgerdin parents: 8040 diff changeset	2657 // Accounting can only be correct if we got the values during a safepoint
1c88b99a2b01 8009282: Assertion "assert(used_and_free == capacity_bytes) failed: Accounting is wrong" failed with -XX:+Verbose -XX:+TraceMetadataChunkAllocation mgerdin parents: 8040 diff changeset	2658 assert(!SafepointSynchronize::is_at_safepoint() \|\| used_and_free == capacity_bytes, "Accounting is wrong");
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2659 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2660
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2661 // Print total fragmentation for class and data metaspaces separately
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2662 void MetaspaceAux::print_waste(outputStream* out) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2663
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2664 size_t specialized_waste = 0, small_waste = 0, medium_waste = 0, large_waste = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2665 size_t specialized_count = 0, small_count = 0, medium_count = 0, large_count = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2666 size_t cls_specialized_waste = 0, cls_small_waste = 0, cls_medium_waste = 0, cls_large_waste = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2667 size_t cls_specialized_count = 0, cls_small_count = 0, cls_medium_count = 0, cls_large_count = 0;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2668
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2669 ClassLoaderDataGraphMetaspaceIterator iter;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2670 while (iter.repeat()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2671 Metaspace* msp = iter.get_next();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2672 if (msp != NULL) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2673 specialized_waste += msp->vsm()->sum_waste_in_chunks_in_use(SpecializedIndex);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2674 specialized_count += msp->vsm()->sum_count_in_chunks_in_use(SpecializedIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2675 small_waste += msp->vsm()->sum_waste_in_chunks_in_use(SmallIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2676 small_count += msp->vsm()->sum_count_in_chunks_in_use(SmallIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2677 medium_waste += msp->vsm()->sum_waste_in_chunks_in_use(MediumIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2678 medium_count += msp->vsm()->sum_count_in_chunks_in_use(MediumIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2679 large_waste += msp->vsm()->sum_waste_in_chunks_in_use(HumongousIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2680 large_count += msp->vsm()->sum_count_in_chunks_in_use(HumongousIndex);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2681
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2682 cls_specialized_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(SpecializedIndex);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2683 cls_specialized_count += msp->class_vsm()->sum_count_in_chunks_in_use(SpecializedIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2684 cls_small_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(SmallIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2685 cls_small_count += msp->class_vsm()->sum_count_in_chunks_in_use(SmallIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2686 cls_medium_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(MediumIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2687 cls_medium_count += msp->class_vsm()->sum_count_in_chunks_in_use(MediumIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2688 cls_large_waste += msp->class_vsm()->sum_waste_in_chunks_in_use(HumongousIndex);
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2689 cls_large_count += msp->class_vsm()->sum_count_in_chunks_in_use(HumongousIndex);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2690 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2691 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2692 out->print_cr("Total fragmentation waste (words) doesn't count free space");
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2693 out->print_cr(" data: " SIZE_FORMAT " specialized(s) " SIZE_FORMAT ", "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2694 SIZE_FORMAT " small(s) " SIZE_FORMAT ", "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2695 SIZE_FORMAT " medium(s) " SIZE_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2696 specialized_count, specialized_waste, small_count,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2697 small_waste, medium_count, medium_waste);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2698 out->print_cr(" class: " SIZE_FORMAT " specialized(s) " SIZE_FORMAT ", "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2699 SIZE_FORMAT " small(s) " SIZE_FORMAT,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2700 cls_specialized_count, cls_specialized_waste,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2701 cls_small_count, cls_small_waste);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2702 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2703
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2704 // Dump global metaspace things from the end of ClassLoaderDataGraph
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2705 void MetaspaceAux::dump(outputStream* out) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2706 out->print_cr("All Metaspace:");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2707 out->print("data space: "); print_on(out, Metaspace::NonClassType);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2708 out->print("class space: "); print_on(out, Metaspace::ClassType);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2709 print_waste(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2710 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2711
6969 6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2712 void MetaspaceAux::verify_free_chunks() {
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2713 Metaspace::space_list()->chunk_manager()->verify();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2714 Metaspace::class_space_list()->chunk_manager()->verify();
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2715 }
6bc207d87e5d 7200229: NPG: possible performance issue exposed by closed/runtime/6559877/Test6559877.java mgerdin parents: 6885 diff changeset	2716
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2717 void MetaspaceAux::verify_capacity() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2718 #ifdef ASSERT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2719 size_t running_sum_capacity_bytes = allocated_capacity_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2720 // For purposes of the running sum of used, verify against capacity
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2721 size_t capacity_in_use_bytes = capacity_bytes_slow();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2722 assert(running_sum_capacity_bytes == capacity_in_use_bytes,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2723 err_msg("allocated_capacity_words() * BytesPerWord " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2724 " capacity_bytes_slow()" SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2725 running_sum_capacity_bytes, capacity_in_use_bytes));
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2726 #endif
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2727 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2728
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2729 void MetaspaceAux::verify_used() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2730 #ifdef ASSERT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2731 size_t running_sum_used_bytes = allocated_used_bytes();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2732 // For purposes of the running sum of used, verify against capacity
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2733 size_t used_in_use_bytes = used_bytes_slow();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2734 assert(allocated_used_bytes() == used_in_use_bytes,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2735 err_msg("allocated_used_bytes() " SIZE_FORMAT
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2736 " used_bytes_slow()()" SIZE_FORMAT,
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2737 allocated_used_bytes(), used_in_use_bytes));
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2738 #endif
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2739 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2740
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2741 void MetaspaceAux::verify_metrics() {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2742 verify_capacity();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2743 verify_used();
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2744 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2745
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2746
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2747 // Metaspace methods
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2748
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2749 size_t Metaspace::_first_chunk_word_size = 0;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2750 size_t Metaspace::_first_class_chunk_word_size = 0;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2751
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2752 Metaspace::Metaspace(Mutex* lock, MetaspaceType type) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2753 initialize(lock, type);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2754 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2755
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2756 Metaspace::~Metaspace() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2757 delete _vsm;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2758 delete _class_vsm;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2759 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2760
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2761 VirtualSpaceList* Metaspace::_space_list = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2762 VirtualSpaceList* Metaspace::_class_space_list = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2763
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2764 #define VIRTUALSPACEMULTIPLIER 2
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2765
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2766 void Metaspace::global_initialize() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2767 // Initialize the alignment for shared spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2768 int max_alignment = os::vm_page_size();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2769 MetaspaceShared::set_max_alignment(max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2770
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2771 if (DumpSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2772 SharedReadOnlySize = align_size_up(SharedReadOnlySize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2773 SharedReadWriteSize = align_size_up(SharedReadWriteSize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2774 SharedMiscDataSize = align_size_up(SharedMiscDataSize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2775 SharedMiscCodeSize = align_size_up(SharedMiscCodeSize, max_alignment);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2776
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2777 // Initialize with the sum of the shared space sizes. The read-only
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2778 // and read write metaspace chunks will be allocated out of this and the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2779 // remainder is the misc code and data chunks.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2780 size_t total = align_size_up(SharedReadOnlySize + SharedReadWriteSize +
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2781 SharedMiscDataSize + SharedMiscCodeSize,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2782 os::vm_allocation_granularity());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2783 size_t word_size = total/wordSize;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2784 _space_list = new VirtualSpaceList(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2785 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2786 // If using shared space, open the file that contains the shared space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2787 // and map in the memory before initializing the rest of metaspace (so
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2788 // the addresses don't conflict)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2789 if (UseSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2790 FileMapInfo* mapinfo = new FileMapInfo();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2791 memset(mapinfo, 0, sizeof(FileMapInfo));
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2792
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2793 // Open the shared archive file, read and validate the header. If
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2794 // initialization fails, shared spaces [UseSharedSpaces] are
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2795 // disabled and the file is closed.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2796 // Map in spaces now also
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2797 if (mapinfo->initialize() && MetaspaceShared::map_shared_spaces(mapinfo)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2798 FileMapInfo::set_current_info(mapinfo);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2799 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2800 assert(!mapinfo->is_open() && !UseSharedSpaces,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2801 "archive file not closed or shared spaces not disabled.");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2802 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2803 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2804
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2805 // Initialize these before initializing the VirtualSpaceList
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2806 _first_chunk_word_size = InitialBootClassLoaderMetaspaceSize / BytesPerWord;
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2807 _first_chunk_word_size = align_word_size_up(_first_chunk_word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2808 // Make the first class chunk bigger than a medium chunk so it's not put
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2809 // on the medium chunk list. The next chunk will be small and progress
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2810 // from there. This size calculated by -version.
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2811 _first_class_chunk_word_size = MIN2((size_t)MediumChunk*6,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2812 (ClassMetaspaceSize/BytesPerWord)*2);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2813 _first_class_chunk_word_size = align_word_size_up(_first_class_chunk_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2814 // Arbitrarily set the initial virtual space to a multiple
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2815 // of the boot class loader size.
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2816 size_t word_size = VIRTUALSPACEMULTIPLIER * first_chunk_word_size();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2817 // Initialize the list of virtual spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2818 _space_list = new VirtualSpaceList(word_size);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2819 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2820 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2821
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2822 // For UseCompressedKlassPointers the class space is reserved as a piece of the
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2823 // Java heap because the compression algorithm is the same for each. The
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2824 // argument passed in is at the top of the compressed space
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2825 void Metaspace::initialize_class_space(ReservedSpace rs) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2826 // The reserved space size may be bigger because of alignment, esp with UseLargePages
8007 d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2827 assert(rs.size() >= ClassMetaspaceSize,
d9058e388631 8007257: NPG: metaspace.cpp: Incorrect arguments in calls to err_msg mikael parents: 7447 diff changeset	2828 err_msg(SIZE_FORMAT " != " UINTX_FORMAT, rs.size(), ClassMetaspaceSize));
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2829 _class_space_list = new VirtualSpaceList(rs);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2830 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2831
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2832 void Metaspace::initialize(Mutex* lock,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2833 MetaspaceType type) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2834
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2835 assert(space_list() != NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2836 "Metadata VirtualSpaceList has not been initialized");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2837
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2838 _vsm = new SpaceManager(lock, space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2839 if (_vsm == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2840 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2841 }
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2842 size_t word_size;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2843 size_t class_word_size;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2844 vsm()->get_initial_chunk_sizes(type,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2845 &word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2846 &class_word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2847
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2848 assert(class_space_list() != NULL,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2849 "Class VirtualSpaceList has not been initialized");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2850
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2851 // Allocate SpaceManager for classes.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2852 _class_vsm = new SpaceManager(lock, class_space_list());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2853 if (_class_vsm == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2854 return;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2855 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2856
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2857 MutexLockerEx cl(SpaceManager::expand_lock(), Mutex::_no_safepoint_check_flag);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2858
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2859 // Allocate chunk for metadata objects
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2860 Metachunk* new_chunk =
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2861 space_list()->get_initialization_chunk(word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2862 vsm()->medium_chunk_bunch());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2863 assert(!DumpSharedSpaces \|\| new_chunk != NULL, "should have enough space for both chunks");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2864 if (new_chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2865 // Add to this manager's list of chunks in use and current_chunk().
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2866 vsm()->add_chunk(new_chunk, true);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2867 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2868
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2869 // Allocate chunk for class metadata objects
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2870 Metachunk* class_chunk =
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2871 class_space_list()->get_initialization_chunk(class_word_size,
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2872 class_vsm()->medium_chunk_bunch());
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2873 if (class_chunk != NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2874 class_vsm()->add_chunk(class_chunk, true);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2875 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2876 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2877
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2878 size_t Metaspace::align_word_size_up(size_t word_size) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2879 size_t byte_size = word_size * wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2880 return ReservedSpace::allocation_align_size_up(byte_size) / wordSize;
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2881 }
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	2882
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2883 MetaWord* Metaspace::allocate(size_t word_size, MetadataType mdtype) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2884 // DumpSharedSpaces doesn't use class metadata area (yet)
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2885 if (mdtype == ClassType && !DumpSharedSpaces) {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2886 return class_vsm()->allocate(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2887 } else {
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2888 return vsm()->allocate(word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2889 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2890 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2891
6753 8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2892 MetaWord* Metaspace::expand_and_allocate(size_t word_size, MetadataType mdtype) {
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2893 MetaWord* result;
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2894 MetaspaceGC::set_expand_after_GC(true);
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2895 size_t before_inc = MetaspaceGC::capacity_until_GC();
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2896 size_t delta_bytes = MetaspaceGC::delta_capacity_until_GC(word_size) * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2897 MetaspaceGC::inc_capacity_until_GC(delta_bytes);
6753 8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2898 if (PrintGCDetails && Verbose) {
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2899 gclog_or_tty->print_cr("Increase capacity to GC from " SIZE_FORMAT
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2900 " to " SIZE_FORMAT, before_inc, MetaspaceGC::capacity_until_GC());
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2901 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2902
6753 8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2903 result = allocate(word_size, mdtype);
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2904
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2905 return result;
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2906 }
8da5e203b993 7197557: NPG: nsk/sysdict/vm/stress/chain/chain004 hangs intermittently jmasa parents: 6736 diff changeset	2907
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2908 // Space allocated in the Metaspace. This may
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2909 // be across several metadata virtual spaces.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2910 char* Metaspace::bottom() const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2911 assert(DumpSharedSpaces, "only useful and valid for dumping shared spaces");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2912 return (char*)vsm()->current_chunk()->bottom();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2913 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2914
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2915 size_t Metaspace::used_words_slow(MetadataType mdtype) const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2916 // return vsm()->allocated_used_words();
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2917 return mdtype == ClassType ? class_vsm()->sum_used_in_chunks_in_use() :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2918 vsm()->sum_used_in_chunks_in_use(); // includes overhead!
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2919 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2920
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2921 size_t Metaspace::free_words(MetadataType mdtype) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2922 return mdtype == ClassType ? class_vsm()->sum_free_in_chunks_in_use() :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2923 vsm()->sum_free_in_chunks_in_use();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2924 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2925
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2926 // Space capacity in the Metaspace. It includes
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2927 // space in the list of chunks from which allocations
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2928 // have been made. Don't include space in the global freelist and
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2929 // in the space available in the dictionary which
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2930 // is already counted in some chunk.
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2931 size_t Metaspace::capacity_words_slow(MetadataType mdtype) const {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2932 return mdtype == ClassType ? class_vsm()->sum_capacity_in_chunks_in_use() :
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2933 vsm()->sum_capacity_in_chunks_in_use();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2934 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2935
10183 868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2936 size_t Metaspace::used_bytes_slow(MetadataType mdtype) const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2937 return used_words_slow(mdtype) * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2938 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2939
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2940 size_t Metaspace::capacity_bytes_slow(MetadataType mdtype) const {
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2941 return capacity_words_slow(mdtype) * BytesPerWord;
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2942 }
868d87ed63c8 8008966: NPG: Inefficient Metaspace counter functions cause large young GC regressions jmasa parents: 10175 diff changeset	2943
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2944 void Metaspace::deallocate(MetaWord* ptr, size_t word_size, bool is_class) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2945 if (SafepointSynchronize::is_at_safepoint()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2946 assert(Thread::current()->is_VM_thread(), "should be the VM thread");
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2947 // Don't take Heap_lock
10191 601183f604b2 8013129: Possible deadlock with Metaspace locks due to mixed usage of safepoint aware and non-safepoint aware locking mgerdin parents: 10183 diff changeset	2948 MutexLockerEx ml(vsm()->lock(), Mutex::_no_safepoint_check_flag);
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2949 if (word_size < TreeChunk<Metablock, FreeList>::min_size()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2950 // Dark matter. Too small for dictionary.
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2951 #ifdef ASSERT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2952 Copy::fill_to_words((HeapWord*)ptr, word_size, 0xf5f5f5f5);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2953 #endif
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2954 return;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2955 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2956 if (is_class) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2957 class_vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2958 } else {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2959 vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2960 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2961 } else {
10191 601183f604b2 8013129: Possible deadlock with Metaspace locks due to mixed usage of safepoint aware and non-safepoint aware locking mgerdin parents: 10183 diff changeset	2962 MutexLockerEx ml(vsm()->lock(), Mutex::_no_safepoint_check_flag);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2963
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2964 if (word_size < TreeChunk<Metablock, FreeList>::min_size()) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2965 // Dark matter. Too small for dictionary.
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2966 #ifdef ASSERT
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2967 Copy::fill_to_words((HeapWord*)ptr, word_size, 0xf5f5f5f5);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2968 #endif
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2969 return;
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2970 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2971 if (is_class) {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2972 class_vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2973 } else {
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2974 vsm()->deallocate(ptr, word_size);
685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2975 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2976 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2977 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2978
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	2979 Metablock* Metaspace::allocate(ClassLoaderData* loader_data, size_t word_size,
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2980 bool read_only, MetadataType mdtype, TRAPS) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2981 if (HAS_PENDING_EXCEPTION) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2982 assert(false, "Should not allocate with exception pending");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2983 return NULL; // caller does a CHECK_NULL too
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2984 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2985
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2986 // SSS: Should we align the allocations and make sure the sizes are aligned.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2987 MetaWord* result = NULL;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2988
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2989 assert(loader_data != NULL, "Should never pass around a NULL loader_data. "
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2990 "ClassLoaderData::the_null_class_loader_data() should have been used.");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2991 // Allocate in metaspaces without taking out a lock, because it deadlocks
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2992 // with the SymbolTable_lock. Dumping is single threaded for now. We'll have
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2993 // to revisit this for application class data sharing.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2994 if (DumpSharedSpaces) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2995 if (read_only) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2996 result = loader_data->ro_metaspace()->allocate(word_size, NonClassType);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2997 } else {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2998 result = loader_data->rw_metaspace()->allocate(word_size, NonClassType);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	2999 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3000 if (result == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3001 report_out_of_shared_space(read_only ? SharedReadOnly : SharedReadWrite);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3002 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3003 return Metablock::initialize(result, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3004 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3005
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3006 result = loader_data->metaspace_non_null()->allocate(word_size, mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3007
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3008 if (result == NULL) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3009 // Try to clean out some memory and retry.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3010 result =
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3011 Universe::heap()->collector_policy()->satisfy_failed_metadata_allocation(
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3012 loader_data, word_size, mdtype);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3013
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3014 // If result is still null, we are out of memory.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3015 if (result == NULL) {
7446 e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3016 if (Verbose && TraceMetadataChunkAllocation) {
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3017 gclog_or_tty->print_cr("Metaspace allocation failed for size "
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3018 SIZE_FORMAT, word_size);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3019 if (loader_data->metaspace_or_null() != NULL) loader_data->metaspace_or_null()->dump(gclog_or_tty);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3020 MetaspaceAux::dump(gclog_or_tty);
e51c9860cf66 8005082: NPG: Add specialized Metachunk sizes for reflection and anonymous classloaders jmasa parents: 7435 diff changeset	3021 }
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3022 // -XX:+HeapDumpOnOutOfMemoryError and -XX:OnOutOfMemoryError support
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3023 report_java_out_of_memory("Metadata space");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3024
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3025 if (JvmtiExport::should_post_resource_exhausted()) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3026 JvmtiExport::post_resource_exhausted(
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3027 JVMTI_RESOURCE_EXHAUSTED_OOM_ERROR,
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3028 "Metadata space");
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3029 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3030 THROW_OOP_0(Universe::out_of_memory_error_perm_gen());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3031 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3032 }
6885 685df3c6f84b 7045397: NPG: Add freelists to class loader arenas. jmasa parents: 6786 diff changeset	3033 return Metablock::initialize(result, word_size);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3034 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3035
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3036 void Metaspace::purge() {
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3037 MutexLockerEx cl(SpaceManager::expand_lock(),
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3038 Mutex::_no_safepoint_check_flag);
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3039 space_list()->purge();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3040 class_space_list()->purge();
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3041 }
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3042
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3043 void Metaspace::print_on(outputStream* out) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3044 // Print both class virtual space counts and metaspace.
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3045 if (Verbose) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3046 vsm()->print_on(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3047 class_vsm()->print_on(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3048 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3049 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3050
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3051 bool Metaspace::contains(const void * ptr) {
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3052 if (MetaspaceShared::is_in_shared_space(ptr)) {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3053 return true;
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3054 }
7176 59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3055 // This is checked while unlocked. As long as the virtualspaces are added
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3056 // at the end, the pointer will be in one of them. The virtual spaces
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3057 // aren't deleted presently. When they are, some sort of locking might
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3058 // be needed. Note, locking this can cause inversion problems with the
59c790074993 8003635: NPG: AsynchGetCallTrace broken by Method* virtual call coleenp parents: 6969 diff changeset	3059 // caller in MetaspaceObj::is_metadata() function.
10175 c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3060 return space_list()->contains(ptr) \|\|
c23dbf0e8ab7 8011268: NPG: Free unused VirtualSpaceNodes jmasa parents: 10101 diff changeset	3061 class_space_list()->contains(ptr);
6725 da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3062 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3063
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3064 void Metaspace::verify() {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3065 vsm()->verify();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3066 class_vsm()->verify();
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3067 }
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3068
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3069 void Metaspace::dump(outputStream* const out) const {
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3070 out->print_cr("\nVirtual space manager: " INTPTR_FORMAT, vsm());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3071 vsm()->dump(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3072 out->print_cr("\nClass space manager: " INTPTR_FORMAT, class_vsm());
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3073 class_vsm()->dump(out);
da91efe96a93 6964458: Reimplement class meta-data storage to use native memory coleenp parents: diff changeset	3074 }

Mercurial > hg > graal-compiler

annotate src/share/vm/memory/metaspace.cpp @ 10191:601183f604b2