truffle: src/share/vm/gc_implementation/g1/g1CollectorPolicy.cpp annotate

annotate src/share/vm/gc_implementation/g1/g1CollectorPolicy.cpp @ 6611:7383557659bd

7185699: G1: Prediction model discrepancies Summary: Correct the result value of G1CollectedHeap::pending_card_num(). Change the code that calculates the GC efficiency of a non-young heap region to use historical data from mixed GCs and the actual number of live bytes when predicting how long it would take to collect the region. Changes were also reviewed by Thomas Schatzl. Reviewed-by: azeemj, brutisso

author	johnc
date	Tue, 21 Aug 2012 14:10:39 -0700
parents	a2f7274eb6ef
children	bb3f6194fedb

rev	line source
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1 /*
4787 2ace1c4ee8da 6888336: G1: avoid explicitly marking and pushing objects in survivor spaces tonyp parents: 4729 diff changeset	2 * Copyright (c) 2001, 2012, Oracle and/or its affiliates. All rights reserved.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	4 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	7 * published by the Free Software Foundation.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	8 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	13 * accompanied this code).
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	14 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	18 *
1552 c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1394 diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1394 diff changeset	20 * or visit www.oracle.com if you need additional information or have any
c18cbe5936b8 6941466: Oracle rebranding changes for Hotspot repositories trims parents: 1394 diff changeset	21 * questions.
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	22 *
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	23 */
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	24
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	25 #include "precompiled.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	26 #include "gc_implementation/g1/concurrentG1Refine.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	27 #include "gc_implementation/g1/concurrentMark.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	28 #include "gc_implementation/g1/concurrentMarkThread.inline.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	29 #include "gc_implementation/g1/g1CollectedHeap.inline.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	30 #include "gc_implementation/g1/g1CollectorPolicy.hpp"
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	31 #include "gc_implementation/g1/g1ErgoVerbose.hpp"
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	32 #include "gc_implementation/g1/g1GCPhaseTimes.hpp"
6007 5c86f8211d1e 7160728: Introduce an extra logging level for G1 logging brutisso parents: 5988 diff changeset	33 #include "gc_implementation/g1/g1Log.hpp"
1972 f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	34 #include "gc_implementation/g1/heapRegionRemSet.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	35 #include "gc_implementation/shared/gcPolicyCounters.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	36 #include "runtime/arguments.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	37 #include "runtime/java.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	38 #include "runtime/mutexLocker.hpp"
f95d63e2154a 6989984: Use standard include model for Hospot stefank parents: 1833 diff changeset	39 #include "utilities/debug.hpp"
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	40
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	41 // Different defaults for different number of GC threads
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	42 // They were chosen by running GCOld and SPECjbb on debris with different
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	43 // numbers of GC threads and choosing them based on the results
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	44
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	45 // all the same
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	46 static double rs_length_diff_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	47 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	48 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	49
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	50 static double cost_per_card_ms_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	51 0.01, 0.005, 0.005, 0.003, 0.003, 0.002, 0.002, 0.0015
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	52 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	53
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	54 // all the same
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	55 static double young_cards_per_entry_ratio_defaults[] = {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	56 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	57 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	58
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	59 static double cost_per_entry_ms_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	60 0.015, 0.01, 0.01, 0.008, 0.008, 0.0055, 0.0055, 0.005
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	61 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	62
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	63 static double cost_per_byte_ms_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	64 0.00006, 0.00003, 0.00003, 0.000015, 0.000015, 0.00001, 0.00001, 0.000009
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	65 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	66
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	67 // these should be pretty consistent
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	68 static double constant_other_time_ms_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	69 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	70 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	71
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	72
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	73 static double young_other_cost_per_region_ms_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	74 0.3, 0.2, 0.2, 0.15, 0.15, 0.12, 0.12, 0.1
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	75 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	76
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	77 static double non_young_other_cost_per_region_ms_defaults[] = {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	78 1.0, 0.7, 0.7, 0.5, 0.5, 0.42, 0.42, 0.30
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	79 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	80
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	81 G1CollectorPolicy::G1CollectorPolicy() :
1833 8b10f48633dc 6984287: Regularize how GC parallel workers are specified. jmasa parents: 1779 diff changeset	82 _parallel_gc_threads(G1CollectedHeap::use_parallel_gc_threads()
3823 14a2fd14c0db 7068240: G1: Long "parallel other time" and "ext root scanning" when running specific benchmark johnc parents: 3778 diff changeset	83 ? ParallelGCThreads : 1),
1833 8b10f48633dc 6984287: Regularize how GC parallel workers are specified. jmasa parents: 1779 diff changeset	84
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	85 _recent_gc_times_ms(new TruncatedSeq(NumPrevPausesForHeuristics)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	86 _stop_world_start(0.0),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	87
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	88 _concurrent_mark_remark_times_ms(new TruncatedSeq(NumPrevPausesForHeuristics)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	89 _concurrent_mark_cleanup_times_ms(new TruncatedSeq(NumPrevPausesForHeuristics)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	90
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	91 _alloc_rate_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	92 _prev_collection_pause_end_ms(0.0),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	93 _rs_length_diff_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	94 _cost_per_card_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	95 _young_cards_per_entry_ratio_seq(new TruncatedSeq(TruncatedSeqLength)),
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	96 _mixed_cards_per_entry_ratio_seq(new TruncatedSeq(TruncatedSeqLength)),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	97 _cost_per_entry_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	98 _mixed_cost_per_entry_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	99 _cost_per_byte_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	100 _cost_per_byte_ms_during_cm_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	101 _constant_other_time_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	102 _young_other_cost_per_region_ms_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	103 _non_young_other_cost_per_region_ms_seq(
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	104 new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	105
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	106 _pending_cards_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	107 _rs_lengths_seq(new TruncatedSeq(TruncatedSeqLength)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	108
751 20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	109 _pause_time_target_ms((double) MaxGCPauseMillis),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	110
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	111 _gcs_are_young(true),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	112
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	113 _during_marking(false),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	114 _in_marking_window(false),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	115 _in_marking_window_im(false),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	116
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	117 _recent_prev_end_times_for_all_gcs_sec(
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	118 new TruncatedSeq(NumPrevPausesForHeuristics)),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	119
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	120 _recent_avg_pause_time_ratio(0.0),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	121
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	122 _initiate_conc_mark_if_possible(false),
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	123 _during_initial_mark_pause(false),
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	124 _last_young_gc(false),
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	125 _last_gc_was_young(false),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	126
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	127 _eden_bytes_before_gc(0),
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	128 _survivor_bytes_before_gc(0),
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	129 _capacity_before_gc(0),
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	130
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	131 _eden_cset_region_length(0),
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	132 _survivor_cset_region_length(0),
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	133 _old_cset_region_length(0),
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	134
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	135 _collection_set(NULL),
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	136 _collection_set_bytes_used_before(0),
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	137
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	138 // Incremental CSet attributes
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	139 _inc_cset_build_state(Inactive),
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	140 _inc_cset_head(NULL),
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	141 _inc_cset_tail(NULL),
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	142 _inc_cset_bytes_used_before(0),
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	143 _inc_cset_max_finger(NULL),
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	144 _inc_cset_recorded_rs_lengths(0),
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	145 _inc_cset_recorded_rs_lengths_diffs(0),
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	146 _inc_cset_predicted_elapsed_time_ms(0.0),
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	147 _inc_cset_predicted_elapsed_time_ms_diffs(0.0),
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	148
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	149 #ifdef _MSC_VER // the use of 'this' below gets a warning, make it go away
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	150 #pragma warning( disable:4355 ) // 'this' : used in base member initializer list
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	151 #endif // _MSC_VER
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	152
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	153 _short_lived_surv_rate_group(new SurvRateGroup(this, "Short Lived",
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	154 G1YoungSurvRateNumRegionsSummary)),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	155 _survivor_surv_rate_group(new SurvRateGroup(this, "Survivor",
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	156 G1YoungSurvRateNumRegionsSummary)),
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	157 // add here any more surv rate groups
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	158 _recorded_survivor_regions(0),
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	159 _recorded_survivor_head(NULL),
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	160 _recorded_survivor_tail(NULL),
1356 56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	161 _survivors_age_table(true),
56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	162
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	163 _gc_overhead_perc(0.0) {
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	164
942 2c79770d1f6e 6819085: G1: use larger and/or user settable region size tonyp parents: 936 diff changeset	165 // Set up the region size and associated fields. Given that the
2c79770d1f6e 6819085: G1: use larger and/or user settable region size tonyp parents: 936 diff changeset	166 // policy is created before the heap, we have to set this up here,
2c79770d1f6e 6819085: G1: use larger and/or user settable region size tonyp parents: 936 diff changeset	167 // so it's done as soon as possible.
2c79770d1f6e 6819085: G1: use larger and/or user settable region size tonyp parents: 936 diff changeset	168 HeapRegion::setup_heap_region_size(Arguments::min_heap_size());
1261 0414c1049f15 6923991: G1: improve scalability of RSet scanning iveresov parents: 1111 diff changeset	169 HeapRegionRemSet::setup_remset_size();
942 2c79770d1f6e 6819085: G1: use larger and/or user settable region size tonyp parents: 936 diff changeset	170
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	171 G1ErgoVerbose::initialize();
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	172 if (PrintAdaptiveSizePolicy) {
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	173 // Currently, we only use a single switch for all the heuristics.
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	174 G1ErgoVerbose::set_enabled(true);
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	175 // Given that we don't currently have a verboseness level
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	176 // parameter, we'll hardcode this to high. This can be easily
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	177 // changed in the future.
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	178 G1ErgoVerbose::set_level(ErgoHigh);
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	179 } else {
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	180 G1ErgoVerbose::set_enabled(false);
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	181 }
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	182
1391 79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	183 // Verify PLAB sizes
3986 65a8ff39a6da 7095194: G1: HeapRegion::GrainBytes, GrainWords, and CardsPerRegion should be size_t johnc parents: 3982 diff changeset	184 const size_t region_size = HeapRegion::GrainWords;
1391 79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	185 if (YoungPLABSize > region_size \|\| OldPLABSize > region_size) {
79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	186 char buffer[128];
3986 65a8ff39a6da 7095194: G1: HeapRegion::GrainBytes, GrainWords, and CardsPerRegion should be size_t johnc parents: 3982 diff changeset	187 jio_snprintf(buffer, sizeof(buffer), "%sPLABSize should be at most "SIZE_FORMAT,
1391 79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	188 OldPLABSize > region_size ? "Old" : "Young", region_size);
79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	189 vm_exit_during_initialization(buffer);
79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	190 }
79e419e5ea3b 6942253: G1: replace G1ParallelGCAllocBufferSize with YoungPLABSize and OldPLABSize apetrusenko parents: 1388 diff changeset	191
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	192 _recent_prev_end_times_for_all_gcs_sec->add(os::elapsedTime());
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	193 _prev_collection_pause_end_ms = os::elapsedTime() * 1000.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	194
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	195 _phase_times = new G1GCPhaseTimes(_parallel_gc_threads);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	196
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	197 int index = MIN2(_parallel_gc_threads - 1, 7);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	198
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	199 _rs_length_diff_seq->add(rs_length_diff_defaults[index]);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	200 _cost_per_card_ms_seq->add(cost_per_card_ms_defaults[index]);
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	201 _young_cards_per_entry_ratio_seq->add(
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	202 young_cards_per_entry_ratio_defaults[index]);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	203 _cost_per_entry_ms_seq->add(cost_per_entry_ms_defaults[index]);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	204 _cost_per_byte_ms_seq->add(cost_per_byte_ms_defaults[index]);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	205 _constant_other_time_ms_seq->add(constant_other_time_ms_defaults[index]);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	206 _young_other_cost_per_region_ms_seq->add(
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	207 young_other_cost_per_region_ms_defaults[index]);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	208 _non_young_other_cost_per_region_ms_seq->add(
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	209 non_young_other_cost_per_region_ms_defaults[index]);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	210
1610 79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	211 // Below, we might need to calculate the pause time target based on
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	212 // the pause interval. When we do so we are going to give G1 maximum
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	213 // flexibility and allow it to do pauses when it needs to. So, we'll
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	214 // arrange that the pause interval to be pause time target + 1 to
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	215 // ensure that a) the pause time target is maximized with respect to
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	216 // the pause interval and b) we maintain the invariant that pause
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	217 // time target < pause interval. If the user does not want this
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	218 // maximum flexibility, they will have to set the pause interval
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	219 // explicitly.
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	220
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	221 // First make sure that, if either parameter is set, its value is
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	222 // reasonable.
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	223 if (!FLAG_IS_DEFAULT(MaxGCPauseMillis)) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	224 if (MaxGCPauseMillis < 1) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	225 vm_exit_during_initialization("MaxGCPauseMillis should be "
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	226 "greater than 0");
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	227 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	228 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	229 if (!FLAG_IS_DEFAULT(GCPauseIntervalMillis)) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	230 if (GCPauseIntervalMillis < 1) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	231 vm_exit_during_initialization("GCPauseIntervalMillis should be "
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	232 "greater than 0");
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	233 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	234 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	235
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	236 // Then, if the pause time target parameter was not set, set it to
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	237 // the default value.
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	238 if (FLAG_IS_DEFAULT(MaxGCPauseMillis)) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	239 if (FLAG_IS_DEFAULT(GCPauseIntervalMillis)) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	240 // The default pause time target in G1 is 200ms
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	241 FLAG_SET_DEFAULT(MaxGCPauseMillis, 200);
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	242 } else {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	243 // We do not allow the pause interval to be set without the
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	244 // pause time target
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	245 vm_exit_during_initialization("GCPauseIntervalMillis cannot be set "
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	246 "without setting MaxGCPauseMillis");
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	247 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	248 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	249
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	250 // Then, if the interval parameter was not set, set it according to
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	251 // the pause time target (this will also deal with the case when the
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	252 // pause time target is the default value).
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	253 if (FLAG_IS_DEFAULT(GCPauseIntervalMillis)) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	254 FLAG_SET_DEFAULT(GCPauseIntervalMillis, MaxGCPauseMillis + 1);
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	255 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	256
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	257 // Finally, make sure that the two parameters are consistent.
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	258 if (MaxGCPauseMillis >= GCPauseIntervalMillis) {
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	259 char buffer[256];
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	260 jio_snprintf(buffer, 256,
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	261 "MaxGCPauseMillis (%u) should be less than "
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	262 "GCPauseIntervalMillis (%u)",
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	263 MaxGCPauseMillis, GCPauseIntervalMillis);
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	264 vm_exit_during_initialization(buffer);
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	265 }
79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	266
751 20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	267 double max_gc_time = (double) MaxGCPauseMillis / 1000.0;
1610 79107c3a6bd5 6949307: G1: raise a vm error, do not core dump, if target pause time and target interval are inconsistent tonyp parents: 1579 diff changeset	268 double time_slice = (double) GCPauseIntervalMillis / 1000.0;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	269 _mmu_tracker = new G1MMUTrackerQueue(time_slice, max_gc_time);
751 20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	270 _sigma = (double) G1ConfidencePercent / 100.0;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	271
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	272 // start conservatively (around 50ms is about right)
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	273 _concurrent_mark_remark_times_ms->add(0.05);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	274 _concurrent_mark_cleanup_times_ms->add(0.20);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	275 _tenuring_threshold = MaxTenuringThreshold;
3868 ae73da50be4b 7081064: G1: remove develop params G1FixedSurvivorSpaceSize, G1FixedTenuringThreshold, and G1FixedEdenSize tonyp parents: 3867 diff changeset	276 // _max_survivor_regions will be calculated by
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	277 // update_young_list_target_length() during initialization.
3868 ae73da50be4b 7081064: G1: remove develop params G1FixedSurvivorSpaceSize, G1FixedTenuringThreshold, and G1FixedEdenSize tonyp parents: 3867 diff changeset	278 _max_survivor_regions = 0;
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	279
1356 56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	280 assert(GCTimeRatio > 0,
56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	281 "we should have set it to a default value set_g1_gc_flags() "
56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	282 "if a user set it to 0");
56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	283 _gc_overhead_perc = 100.0 * (1.0 / (1.0 + GCTimeRatio));
56507bcd639e 6937160: G1: should observe GCTimeRatio tonyp parents: 1285 diff changeset	284
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	285 uintx reserve_perc = G1ReservePercent;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	286 // Put an artificial ceiling on this so that it's not set to a silly value.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	287 if (reserve_perc > 50) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	288 reserve_perc = 50;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	289 warning("G1ReservePercent is set to a value that is too large, "
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	290 "it's been updated to %u", reserve_perc);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	291 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	292 _reserve_factor = (double) reserve_perc / 100.0;
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	293 // This will be set when the heap is expanded
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	294 // for the first time during initialization.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	295 _reserve_regions = 0;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	296
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	297 initialize_all();
4013 074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	298 _collectionSetChooser = new CollectionSetChooser();
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	299 _young_gen_sizer = new G1YoungGenSizer(); // Must be after call to initialize_flags
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	300 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	301
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	302 void G1CollectorPolicy::initialize_flags() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	303 set_min_alignment(HeapRegion::GrainBytes);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	304 set_max_alignment(GenRemSet::max_alignment_constraint(rem_set_name()));
547 1e458753107d 6802413: G1: G1FixedSurvivorSpaceSize should be converted into regions in calculate_survivors_policy() apetrusenko parents: 545 diff changeset	305 if (SurvivorRatio < 1) {
1e458753107d 6802413: G1: G1FixedSurvivorSpaceSize should be converted into regions in calculate_survivors_policy() apetrusenko parents: 545 diff changeset	306 vm_exit_during_initialization("Invalid survivor ratio specified");
1e458753107d 6802413: G1: G1FixedSurvivorSpaceSize should be converted into regions in calculate_survivors_policy() apetrusenko parents: 545 diff changeset	307 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	308 CollectorPolicy::initialize_flags();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	309 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	310
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	311 G1YoungGenSizer::G1YoungGenSizer() : _sizer_kind(SizerDefaults), _adaptive_size(true) {
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	312 assert(G1DefaultMinNewGenPercent <= G1DefaultMaxNewGenPercent, "Min larger than max");
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	313 assert(G1DefaultMinNewGenPercent > 0 && G1DefaultMinNewGenPercent < 100, "Min out of bounds");
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	314 assert(G1DefaultMaxNewGenPercent > 0 && G1DefaultMaxNewGenPercent < 100, "Max out of bounds");
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	315
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	316 if (FLAG_IS_CMDLINE(NewRatio)) {
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	317 if (FLAG_IS_CMDLINE(NewSize) \|\| FLAG_IS_CMDLINE(MaxNewSize)) {
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	318 warning("-XX:NewSize and -XX:MaxNewSize override -XX:NewRatio");
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	319 } else {
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	320 _sizer_kind = SizerNewRatio;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	321 _adaptive_size = false;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	322 return;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	323 }
3976 d912b598c6c3 7091032: G1: assert failure when NewRatio is used tonyp parents: 3927 diff changeset	324 }
1285 a1c410de27e4 6928065: G1: use existing command line parameters to set the young generation size tonyp parents: 1283 diff changeset	325
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	326 if (FLAG_IS_CMDLINE(NewSize)) {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	327 _min_desired_young_length = MAX2((uint) (NewSize / HeapRegion::GrainBytes),
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	328 1U);
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	329 if (FLAG_IS_CMDLINE(MaxNewSize)) {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	330 _max_desired_young_length =
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	331 MAX2((uint) (MaxNewSize / HeapRegion::GrainBytes),
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	332 1U);
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	333 _sizer_kind = SizerMaxAndNewSize;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	334 _adaptive_size = _min_desired_young_length == _max_desired_young_length;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	335 } else {
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	336 _sizer_kind = SizerNewSizeOnly;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	337 }
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	338 } else if (FLAG_IS_CMDLINE(MaxNewSize)) {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	339 _max_desired_young_length =
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	340 MAX2((uint) (MaxNewSize / HeapRegion::GrainBytes),
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	341 1U);
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	342 _sizer_kind = SizerMaxNewSizeOnly;
1285 a1c410de27e4 6928065: G1: use existing command line parameters to set the young generation size tonyp parents: 1283 diff changeset	343 }
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	344 }
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	345
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	346 uint G1YoungGenSizer::calculate_default_min_length(uint new_number_of_heap_regions) {
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	347 uint default_value = (new_number_of_heap_regions * G1DefaultMinNewGenPercent) / 100;
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	348 return MAX2(1U, default_value);
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	349 }
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	350
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	351 uint G1YoungGenSizer::calculate_default_max_length(uint new_number_of_heap_regions) {
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	352 uint default_value = (new_number_of_heap_regions * G1DefaultMaxNewGenPercent) / 100;
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	353 return MAX2(1U, default_value);
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	354 }
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	355
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	356 void G1YoungGenSizer::heap_size_changed(uint new_number_of_heap_regions) {
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	357 assert(new_number_of_heap_regions > 0, "Heap must be initialized");
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	358
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	359 switch (_sizer_kind) {
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	360 case SizerDefaults:
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	361 _min_desired_young_length = calculate_default_min_length(new_number_of_heap_regions);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	362 _max_desired_young_length = calculate_default_max_length(new_number_of_heap_regions);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	363 break;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	364 case SizerNewSizeOnly:
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	365 _max_desired_young_length = calculate_default_max_length(new_number_of_heap_regions);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	366 _max_desired_young_length = MAX2(_min_desired_young_length, _max_desired_young_length);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	367 break;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	368 case SizerMaxNewSizeOnly:
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	369 _min_desired_young_length = calculate_default_min_length(new_number_of_heap_regions);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	370 _min_desired_young_length = MIN2(_min_desired_young_length, _max_desired_young_length);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	371 break;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	372 case SizerMaxAndNewSize:
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	373 // Do nothing. Values set on the command line, don't update them at runtime.
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	374 break;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	375 case SizerNewRatio:
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	376 _min_desired_young_length = new_number_of_heap_regions / (NewRatio + 1);
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	377 _max_desired_young_length = _min_desired_young_length;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	378 break;
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	379 default:
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	380 ShouldNotReachHere();
1285 a1c410de27e4 6928065: G1: use existing command line parameters to set the young generation size tonyp parents: 1283 diff changeset	381 }
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	382
1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	383 assert(_min_desired_young_length <= _max_desired_young_length, "Invalid min/max young gen size values");
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	384 }
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	385
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	386 void G1CollectorPolicy::init() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	387 // Set aside an initial future to_space.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	388 _g1 = G1CollectedHeap::heap();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	389
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	390 assert(Heap_lock->owned_by_self(), "Locking discipline.");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	391
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	392 initialize_gc_policy_counters();
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	393
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	394 if (adaptive_young_list_length()) {
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	395 _young_list_fixed_length = 0;
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	396 } else {
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	397 _young_list_fixed_length = _young_gen_sizer->min_desired_young_length();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	398 }
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	399 _free_regions_at_end_of_collection = _g1->free_regions();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	400 update_young_list_target_length();
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	401 _prev_eden_capacity = _young_list_target_length * HeapRegion::GrainBytes;
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	402
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	403 // We may immediately start allocating regions and placing them on the
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	404 // collection set list. Initialize the per-collection set info
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	405 start_incremental_cset_building();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	406 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	407
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	408 // Create the jstat counters for the policy.
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	409 void G1CollectorPolicy::initialize_gc_policy_counters() {
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	410 _gc_policy_counters = new GCPolicyCounters("GarbageFirst", 1, 3);
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	411 }
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	412
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	413 bool G1CollectorPolicy::predict_will_fit(uint young_length,
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	414 double base_time_ms,
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	415 uint base_free_regions,
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	416 double target_pause_time_ms) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	417 if (young_length >= base_free_regions) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	418 // end condition 1: not enough space for the young regions
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	419 return false;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	420 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	421
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	422 double accum_surv_rate = accum_yg_surv_rate_pred((int) young_length - 1);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	423 size_t bytes_to_copy =
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	424 (size_t) (accum_surv_rate * (double) HeapRegion::GrainBytes);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	425 double copy_time_ms = predict_object_copy_time_ms(bytes_to_copy);
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	426 double young_other_time_ms = predict_young_other_time_ms(young_length);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	427 double pause_time_ms = base_time_ms + copy_time_ms + young_other_time_ms;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	428 if (pause_time_ms > target_pause_time_ms) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	429 // end condition 2: prediction is over the target pause time
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	430 return false;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	431 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	432
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	433 size_t free_bytes =
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	434 (base_free_regions - young_length) * HeapRegion::GrainBytes;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	435 if ((2.0 * sigma()) * (double) bytes_to_copy > (double) free_bytes) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	436 // end condition 3: out-of-space (conservatively!)
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	437 return false;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	438 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	439
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	440 // success!
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	441 return true;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	442 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	443
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	444 void G1CollectorPolicy::record_new_heap_size(uint new_number_of_regions) {
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	445 // re-calculate the necessary reserve
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	446 double reserve_regions_d = (double) new_number_of_regions * _reserve_factor;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	447 // We use ceiling so that if reserve_regions_d is > 0.0 (but
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	448 // smaller than 1.0) we'll get 1.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	449 _reserve_regions = (uint) ceil(reserve_regions_d);
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	450
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	451 _young_gen_sizer->heap_size_changed(new_number_of_regions);
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	452 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	453
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	454 uint G1CollectorPolicy::calculate_young_list_desired_min_length(
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	455 uint base_min_length) {
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	456 uint desired_min_length = 0;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	457 if (adaptive_young_list_length()) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	458 if (_alloc_rate_ms_seq->num() > 3) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	459 double now_sec = os::elapsedTime();
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	460 double when_ms = _mmu_tracker->when_max_gc_sec(now_sec) * 1000.0;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	461 double alloc_rate_ms = predict_alloc_rate_ms();
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	462 desired_min_length = (uint) ceil(alloc_rate_ms * when_ms);
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	463 } else {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	464 // otherwise we don't have enough info to make the prediction
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	465 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	466 }
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	467 desired_min_length += base_min_length;
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	468 // make sure we don't go below any user-defined minimum bound
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	469 return MAX2(_young_gen_sizer->min_desired_young_length(), desired_min_length);
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	470 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	471
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	472 uint G1CollectorPolicy::calculate_young_list_desired_max_length() {
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	473 // Here, we might want to also take into account any additional
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	474 // constraints (i.e., user-defined minimum bound). Currently, we
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	475 // effectively don't set this bound.
4729 1cbe7978b021 7113021: G1: automatically enable young gen size auto-tuning when -Xms==-Xmx brutisso parents: 4728 diff changeset	476 return _young_gen_sizer->max_desired_young_length();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	477 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	478
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	479 void G1CollectorPolicy::update_young_list_target_length(size_t rs_lengths) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	480 if (rs_lengths == (size_t) -1) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	481 // if it's set to the default value (-1), we should predict it;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	482 // otherwise, use the given value.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	483 rs_lengths = (size_t) get_new_prediction(_rs_lengths_seq);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	484 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	485
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	486 // Calculate the absolute and desired min bounds.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	487
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	488 // This is how many young regions we already have (currently: the survivors).
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	489 uint base_min_length = recorded_survivor_regions();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	490 // This is the absolute minimum young length, which ensures that we
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	491 // can allocate one eden region in the worst-case.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	492 uint absolute_min_length = base_min_length + 1;
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	493 uint desired_min_length =
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	494 calculate_young_list_desired_min_length(base_min_length);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	495 if (desired_min_length < absolute_min_length) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	496 desired_min_length = absolute_min_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	497 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	498
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	499 // Calculate the absolute and desired max bounds.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	500
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	501 // We will try our best not to "eat" into the reserve.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	502 uint absolute_max_length = 0;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	503 if (_free_regions_at_end_of_collection > _reserve_regions) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	504 absolute_max_length = _free_regions_at_end_of_collection - _reserve_regions;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	505 }
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	506 uint desired_max_length = calculate_young_list_desired_max_length();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	507 if (desired_max_length > absolute_max_length) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	508 desired_max_length = absolute_max_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	509 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	510
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	511 uint young_list_target_length = 0;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	512 if (adaptive_young_list_length()) {
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	513 if (gcs_are_young()) {
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	514 young_list_target_length =
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	515 calculate_young_list_target_length(rs_lengths,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	516 base_min_length,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	517 desired_min_length,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	518 desired_max_length);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	519 _rs_lengths_prediction = rs_lengths;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	520 } else {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	521 // Don't calculate anything and let the code below bound it to
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	522 // the desired_min_length, i.e., do the next GC as soon as
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	523 // possible to maximize how many old regions we can add to it.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	524 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	525 } else {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	526 // The user asked for a fixed young gen so we'll fix the young gen
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	527 // whether the next GC is young or mixed.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	528 young_list_target_length = _young_list_fixed_length;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	529 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	530
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	531 // Make sure we don't go over the desired max length, nor under the
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	532 // desired min length. In case they clash, desired_min_length wins
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	533 // which is why that test is second.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	534 if (young_list_target_length > desired_max_length) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	535 young_list_target_length = desired_max_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	536 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	537 if (young_list_target_length < desired_min_length) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	538 young_list_target_length = desired_min_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	539 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	540
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	541 assert(young_list_target_length > recorded_survivor_regions(),
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	542 "we should be able to allocate at least one eden region");
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	543 assert(young_list_target_length >= absolute_min_length, "post-condition");
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	544 _young_list_target_length = young_list_target_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	545
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	546 update_max_gc_locker_expansion();
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	547 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	548
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	549 uint
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	550 G1CollectorPolicy::calculate_young_list_target_length(size_t rs_lengths,
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	551 uint base_min_length,
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	552 uint desired_min_length,
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	553 uint desired_max_length) {
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	554 assert(adaptive_young_list_length(), "pre-condition");
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	555 assert(gcs_are_young(), "only call this for young GCs");
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	556
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	557 // In case some edge-condition makes the desired max length too small...
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	558 if (desired_max_length <= desired_min_length) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	559 return desired_min_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	560 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	561
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	562 // We'll adjust min_young_length and max_young_length not to include
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	563 // the already allocated young regions (i.e., so they reflect the
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	564 // min and max eden regions we'll allocate). The base_min_length
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	565 // will be reflected in the predictions by the
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	566 // survivor_regions_evac_time prediction.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	567 assert(desired_min_length > base_min_length, "invariant");
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	568 uint min_young_length = desired_min_length - base_min_length;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	569 assert(desired_max_length > base_min_length, "invariant");
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	570 uint max_young_length = desired_max_length - base_min_length;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	571
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	572 double target_pause_time_ms = _mmu_tracker->max_gc_time() * 1000.0;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	573 double survivor_regions_evac_time = predict_survivor_regions_evac_time();
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	574 size_t pending_cards = (size_t) get_new_prediction(_pending_cards_seq);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	575 size_t adj_rs_lengths = rs_lengths + predict_rs_length_diff();
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	576 size_t scanned_cards = predict_young_card_num(adj_rs_lengths);
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	577 double base_time_ms =
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	578 predict_base_elapsed_time_ms(pending_cards, scanned_cards) +
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	579 survivor_regions_evac_time;
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	580 uint available_free_regions = _free_regions_at_end_of_collection;
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	581 uint base_free_regions = 0;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	582 if (available_free_regions > _reserve_regions) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	583 base_free_regions = available_free_regions - _reserve_regions;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	584 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	585
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	586 // Here, we will make sure that the shortest young length that
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	587 // makes sense fits within the target pause time.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	588
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	589 if (predict_will_fit(min_young_length, base_time_ms,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	590 base_free_regions, target_pause_time_ms)) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	591 // The shortest young length will fit into the target pause time;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	592 // we'll now check whether the absolute maximum number of young
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	593 // regions will fit in the target pause time. If not, we'll do
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	594 // a binary search between min_young_length and max_young_length.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	595 if (predict_will_fit(max_young_length, base_time_ms,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	596 base_free_regions, target_pause_time_ms)) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	597 // The maximum young length will fit into the target pause time.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	598 // We are done so set min young length to the maximum length (as
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	599 // the result is assumed to be returned in min_young_length).
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	600 min_young_length = max_young_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	601 } else {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	602 // The maximum possible number of young regions will not fit within
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	603 // the target pause time so we'll search for the optimal
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	604 // length. The loop invariants are:
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	605 //
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	606 // min_young_length < max_young_length
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	607 // min_young_length is known to fit into the target pause time
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	608 // max_young_length is known not to fit into the target pause time
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	609 //
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	610 // Going into the loop we know the above hold as we've just
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	611 // checked them. Every time around the loop we check whether
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	612 // the middle value between min_young_length and
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	613 // max_young_length fits into the target pause time. If it
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	614 // does, it becomes the new min. If it doesn't, it becomes
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	615 // the new max. This way we maintain the loop invariants.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	616
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	617 assert(min_young_length < max_young_length, "invariant");
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	618 uint diff = (max_young_length - min_young_length) / 2;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	619 while (diff > 0) {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	620 uint young_length = min_young_length + diff;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	621 if (predict_will_fit(young_length, base_time_ms,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	622 base_free_regions, target_pause_time_ms)) {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	623 min_young_length = young_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	624 } else {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	625 max_young_length = young_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	626 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	627 assert(min_young_length < max_young_length, "invariant");
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	628 diff = (max_young_length - min_young_length) / 2;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	629 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	630 // The results is min_young_length which, according to the
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	631 // loop invariants, should fit within the target pause time.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	632
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	633 // These are the post-conditions of the binary search above:
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	634 assert(min_young_length < max_young_length,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	635 "otherwise we should have discovered that max_young_length "
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	636 "fits into the pause target and not done the binary search");
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	637 assert(predict_will_fit(min_young_length, base_time_ms,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	638 base_free_regions, target_pause_time_ms),
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	639 "min_young_length, the result of the binary search, should "
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	640 "fit into the pause target");
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	641 assert(!predict_will_fit(min_young_length + 1, base_time_ms,
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	642 base_free_regions, target_pause_time_ms),
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	643 "min_young_length, the result of the binary search, should be "
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	644 "optimal, so no larger length should fit into the pause target");
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	645 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	646 } else {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	647 // Even the minimum length doesn't fit into the pause time
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	648 // target, return it as the result nevertheless.
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	649 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	650 return base_min_length + min_young_length;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	651 }
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	652
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	653 double G1CollectorPolicy::predict_survivor_regions_evac_time() {
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	654 double survivor_regions_evac_time = 0.0;
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	655 for (HeapRegion * r = _recorded_survivor_head;
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	656 r != NULL && r != _recorded_survivor_tail->get_next_young_region();
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	657 r = r->get_next_young_region()) {
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	658 survivor_regions_evac_time += predict_region_elapsed_time_ms(r, gcs_are_young());
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	659 }
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	660 return survivor_regions_evac_time;
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	661 }
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	662
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	663 void G1CollectorPolicy::revise_young_list_target_length_if_necessary() {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	664 guarantee( adaptive_young_list_length(), "should not call this otherwise" );
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	665
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	666 size_t rs_lengths = _g1->young_list()->sampled_rs_lengths();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	667 if (rs_lengths > _rs_lengths_prediction) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	668 // add 10% to avoid having to recalculate often
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	669 size_t rs_lengths_prediction = rs_lengths * 1100 / 1000;
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	670 update_young_list_target_length(rs_lengths_prediction);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	671 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	672 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	673
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	674
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	675
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	676 HeapWord* G1CollectorPolicy::mem_allocate_work(size_t size,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	677 bool is_tlab,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	678 bool* gc_overhead_limit_was_exceeded) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	679 guarantee(false, "Not using this policy feature yet.");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	680 return NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	681 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	682
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	683 // This method controls how a collector handles one or more
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	684 // of its generations being fully allocated.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	685 HeapWord* G1CollectorPolicy::satisfy_failed_allocation(size_t size,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	686 bool is_tlab) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	687 guarantee(false, "Not using this policy feature yet.");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	688 return NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	689 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	690
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	691
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	692 #ifndef PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	693 bool G1CollectorPolicy::verify_young_ages() {
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	694 HeapRegion* head = _g1->young_list()->first_region();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	695 return
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	696 verify_young_ages(head, _short_lived_surv_rate_group);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	697 // also call verify_young_ages on any additional surv rate groups
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	698 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	699
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	700 bool
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	701 G1CollectorPolicy::verify_young_ages(HeapRegion* head,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	702 SurvRateGroup *surv_rate_group) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	703 guarantee( surv_rate_group != NULL, "pre-condition" );
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	704
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	705 const char* name = surv_rate_group->name();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	706 bool ret = true;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	707 int prev_age = -1;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	708
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	709 for (HeapRegion* curr = head;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	710 curr != NULL;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	711 curr = curr->get_next_young_region()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	712 SurvRateGroup* group = curr->surv_rate_group();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	713 if (group == NULL && !curr->is_survivor()) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	714 gclog_or_tty->print_cr("## %s: encountered NULL surv_rate_group", name);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	715 ret = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	716 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	717
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	718 if (surv_rate_group == group) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	719 int age = curr->age_in_surv_rate_group();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	720
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	721 if (age < 0) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	722 gclog_or_tty->print_cr("## %s: encountered negative age", name);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	723 ret = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	724 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	725
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	726 if (age <= prev_age) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	727 gclog_or_tty->print_cr("## %s: region ages are not strictly increasing "
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	728 "(%d, %d)", name, age, prev_age);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	729 ret = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	730 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	731 prev_age = age;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	732 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	733 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	734
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	735 return ret;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	736 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	737 #endif // PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	738
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	739 void G1CollectorPolicy::record_full_collection_start() {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	740 _full_collection_start_sec = os::elapsedTime();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	741 // Release the future to-space so that it is available for compaction into.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	742 _g1->set_full_collection();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	743 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	744
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	745 void G1CollectorPolicy::record_full_collection_end() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	746 // Consider this like a collection pause for the purposes of allocation
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	747 // since last pause.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	748 double end_sec = os::elapsedTime();
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	749 double full_gc_time_sec = end_sec - _full_collection_start_sec;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	750 double full_gc_time_ms = full_gc_time_sec * 1000.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	751
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	752 _trace_gen1_time_data.record_full_collection(full_gc_time_ms);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	753
595 3698e8f47799 6804746: G1: guarantee(variance() > -1.0,"variance should be >= 0") (due to evacuation failure) tonyp parents: 547 diff changeset	754 update_recent_gc_times(end_sec, full_gc_time_ms);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	755
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	756 _g1->clear_full_collection();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	757
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	758 // "Nuke" the heuristics that control the young/mixed GC
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	759 // transitions and make sure we start with young GCs after the Full GC.
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	760 set_gcs_are_young(true);
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	761 _last_young_gc = false;
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	762 clear_initiate_conc_mark_if_possible();
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	763 clear_during_initial_mark_pause();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	764 _in_marking_window = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	765 _in_marking_window_im = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	766
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	767 _short_lived_surv_rate_group->start_adding_regions();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	768 // also call this on any additional surv rate groups
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	769
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	770 record_survivor_regions(0, NULL, NULL);
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	771
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	772 _free_regions_at_end_of_collection = _g1->free_regions();
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	773 // Reset survivors SurvRateGroup.
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	774 _survivor_surv_rate_group->reset();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	775 update_young_list_target_length();
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	776 _collectionSetChooser->clear();
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	777 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	778
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	779 void G1CollectorPolicy::record_stop_world_start() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	780 _stop_world_start = os::elapsedTime();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	781 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	782
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	783 void G1CollectorPolicy::record_collection_pause_start(double start_time_sec,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	784 size_t start_used) {
4837 eff609af17d7 7127706: G1: re-enable survivors during the initial-mark pause tonyp parents: 4834 diff changeset	785 // We only need to do this here as the policy will only be applied
eff609af17d7 7127706: G1: re-enable survivors during the initial-mark pause tonyp parents: 4834 diff changeset	786 // to the GC we're about to start. so, no point is calculating this
eff609af17d7 7127706: G1: re-enable survivors during the initial-mark pause tonyp parents: 4834 diff changeset	787 // every time we calculate / recalculate the target young length.
eff609af17d7 7127706: G1: re-enable survivors during the initial-mark pause tonyp parents: 4834 diff changeset	788 update_survivors_policy();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	789
1973 631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	790 assert(_g1->used() == _g1->recalculate_used(),
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	791 err_msg("sanity, used: "SIZE_FORMAT" recalculate_used: "SIZE_FORMAT,
631f79e71e90 6974966: G1: unnecessary direct-to-old allocations tonyp parents: 1972 diff changeset	792 _g1->used(), _g1->recalculate_used()));
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	793
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	794 double s_w_t_ms = (start_time_sec - _stop_world_start) * 1000.0;
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	795 _trace_gen0_time_data.record_start_collection(s_w_t_ms);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	796 _stop_world_start = 0.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	797
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	798 phase_times()->_cur_collection_start_sec = start_time_sec;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	799 _cur_collection_pause_used_at_start_bytes = start_used;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	800 _cur_collection_pause_used_regions_at_start = _g1->used_regions();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	801 _pending_cards = _g1->pending_card_num();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	802
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	803 _collection_set_bytes_used_before = 0;
3830 f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3823 diff changeset	804 _bytes_copied_during_gc = 0;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	805
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	806 YoungList* young_list = _g1->young_list();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	807 _eden_bytes_before_gc = young_list->eden_used_bytes();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	808 _survivor_bytes_before_gc = young_list->survivor_used_bytes();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	809 _capacity_before_gc = _g1->capacity();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	810
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	811 _last_gc_was_young = false;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	812
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	813 // do that for any other surv rate groups
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	814 _short_lived_surv_rate_group->stop_adding_regions();
1282 b81f3572f355 6928059: G1: command line parameter renaming tonyp parents: 1261 diff changeset	815 _survivors_age_table.clear();
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	816
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	817 assert( verify_young_ages(), "region age verification" );
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	818 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	819
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	820 void G1CollectorPolicy::record_concurrent_mark_init_end(double
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	821 mark_init_elapsed_time_ms) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	822 _during_marking = true;
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	823 assert(!initiate_conc_mark_if_possible(), "we should have cleared it by now");
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	824 clear_during_initial_mark_pause();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	825 _cur_mark_stop_world_time_ms = mark_init_elapsed_time_ms;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	826 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	827
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	828 void G1CollectorPolicy::record_concurrent_mark_remark_start() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	829 _mark_remark_start_sec = os::elapsedTime();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	830 _during_marking = false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	831 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	832
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	833 void G1CollectorPolicy::record_concurrent_mark_remark_end() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	834 double end_time_sec = os::elapsedTime();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	835 double elapsed_time_ms = (end_time_sec - _mark_remark_start_sec)*1000.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	836 _concurrent_mark_remark_times_ms->add(elapsed_time_ms);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	837 _cur_mark_stop_world_time_ms += elapsed_time_ms;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	838 _prev_collection_pause_end_ms += elapsed_time_ms;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	839
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	840 _mmu_tracker->add_pause(_mark_remark_start_sec, end_time_sec, true);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	841 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	842
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	843 void G1CollectorPolicy::record_concurrent_mark_cleanup_start() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	844 _mark_cleanup_start_sec = os::elapsedTime();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	845 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	846
4013 074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	847 void G1CollectorPolicy::record_concurrent_mark_cleanup_completed() {
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	848 _last_young_gc = true;
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	849 _in_marking_window = false;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	850 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	851
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	852 void G1CollectorPolicy::record_concurrent_pause() {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	853 if (_stop_world_start > 0.0) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	854 double yield_ms = (os::elapsedTime() - _stop_world_start) * 1000.0;
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	855 _trace_gen0_time_data.record_yield_time(yield_ms);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	856 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	857 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	858
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	859 bool G1CollectorPolicy::need_to_start_conc_mark(const char* source, size_t alloc_word_size) {
6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	860 if (_g1->concurrent_mark()->cmThread()->during_cycle()) {
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	861 return false;
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	862 }
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	863
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	864 size_t marking_initiating_used_threshold =
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	865 (_g1->capacity() / 100) * InitiatingHeapOccupancyPercent;
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	866 size_t cur_used_bytes = _g1->non_young_capacity_bytes();
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	867 size_t alloc_byte_size = alloc_word_size * HeapWordSize;
6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	868
6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	869 if ((cur_used_bytes + alloc_byte_size) > marking_initiating_used_threshold) {
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	870 if (gcs_are_young()) {
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	871 ergo_verbose5(ErgoConcCycles,
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	872 "request concurrent cycle initiation",
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	873 ergo_format_reason("occupancy higher than threshold")
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	874 ergo_format_byte("occupancy")
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	875 ergo_format_byte("allocation request")
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	876 ergo_format_byte_perc("threshold")
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	877 ergo_format_str("source"),
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	878 cur_used_bytes,
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	879 alloc_byte_size,
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	880 marking_initiating_used_threshold,
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	881 (double) InitiatingHeapOccupancyPercent,
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	882 source);
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	883 return true;
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	884 } else {
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	885 ergo_verbose5(ErgoConcCycles,
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	886 "do not request concurrent cycle initiation",
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	887 ergo_format_reason("still doing mixed collections")
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	888 ergo_format_byte("occupancy")
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	889 ergo_format_byte("allocation request")
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	890 ergo_format_byte_perc("threshold")
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	891 ergo_format_str("source"),
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	892 cur_used_bytes,
4834 6a78aa6ac1ff 7132311: G1: assert((s == klass->oop_size(this)) \|\| (Universe::heap()->is_gc_active() && ((is_typeArray()... brutisso parents: 4829 diff changeset	893 alloc_byte_size,
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	894 marking_initiating_used_threshold,
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	895 (double) InitiatingHeapOccupancyPercent,
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	896 source);
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	897 }
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	898 }
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	899
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	900 return false;
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	901 }
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	902
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	903 // Anything below that is considered to be zero
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	904 #define MIN_TIMER_GRANULARITY 0.0000001
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	905
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	906 void G1CollectorPolicy::record_collection_pause_end(double pause_time_ms) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	907 double end_time_sec = os::elapsedTime();
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	908 assert(_cur_collection_pause_used_regions_at_start >= cset_region_length(),
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	909 "otherwise, the subtraction below does not make sense");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	910 size_t rs_size =
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	911 _cur_collection_pause_used_regions_at_start - cset_region_length();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	912 size_t cur_used_bytes = _g1->used();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	913 assert(cur_used_bytes == _g1->recalculate_used(), "It should!");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	914 bool last_pause_included_initial_mark = false;
1707 0ce1569c90e5 6963209: G1: remove the concept of abandoned pauses tonyp parents: 1705 diff changeset	915 bool update_stats = !_g1->evacuation_failed();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	916
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	917 #ifndef PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	918 if (G1YoungSurvRateVerbose) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	919 gclog_or_tty->print_cr("");
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	920 _short_lived_surv_rate_group->print();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	921 // do that for any other surv rate groups too
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	922 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	923 #endif // PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	924
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	925 last_pause_included_initial_mark = during_initial_mark_pause();
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	926 if (last_pause_included_initial_mark) {
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	927 record_concurrent_mark_init_end(0.0);
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	928 } else if (!_last_young_gc && need_to_start_conc_mark("end of GC")) {
4829 9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	929 // Note: this might have already been set, if during the last
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	930 // pause we decided to start a cycle but at the beginning of
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	931 // this pause we decided to postpone it. That's OK.
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	932 set_initiate_conc_mark_if_possible();
9509c20bba28 6976060: G1: humongous object allocations should initiate marking cycles when necessary brutisso parents: 4787 diff changeset	933 }
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	934
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	935 _mmu_tracker->add_pause(end_time_sec - pause_time_ms/1000.0,
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	936 end_time_sec, false);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	937
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	938 size_t freed_bytes =
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	939 _cur_collection_pause_used_at_start_bytes - cur_used_bytes;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	940 size_t surviving_bytes = _collection_set_bytes_used_before - freed_bytes;
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	941
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	942 double survival_fraction =
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	943 (double)surviving_bytes/
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	944 (double)_collection_set_bytes_used_before;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	945
595 3698e8f47799 6804746: G1: guarantee(variance() > -1.0,"variance should be >= 0") (due to evacuation failure) tonyp parents: 547 diff changeset	946 if (update_stats) {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	947 _trace_gen0_time_data.record_end_collection(pause_time_ms, phase_times());
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	948 // this is where we update the allocation rate of the application
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	949 double app_time_ms =
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	950 (phase_times()->_cur_collection_start_sec * 1000.0 - _prev_collection_pause_end_ms);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	951 if (app_time_ms < MIN_TIMER_GRANULARITY) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	952 // This usually happens due to the timer not having the required
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	953 // granularity. Some Linuxes are the usual culprits.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	954 // We'll just set it to something (arbitrarily) small.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	955 app_time_ms = 1.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	956 }
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	957 // We maintain the invariant that all objects allocated by mutator
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	958 // threads will be allocated out of eden regions. So, we can use
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	959 // the eden region number allocated since the previous GC to
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	960 // calculate the application's allocate rate. The only exception
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	961 // to that is humongous objects that are allocated separately. But
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	962 // given that humongous object allocations do not really affect
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	963 // either the pause's duration nor when the next pause will take
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	964 // place we can safely ignore them here.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	965 uint regions_allocated = eden_cset_region_length();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	966 double alloc_rate_ms = (double) regions_allocated / app_time_ms;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	967 _alloc_rate_ms_seq->add(alloc_rate_ms);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	968
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	969 double interval_ms =
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	970 (end_time_sec - _recent_prev_end_times_for_all_gcs_sec->oldest()) * 1000.0;
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	971 update_recent_gc_times(end_time_sec, pause_time_ms);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	972 _recent_avg_pause_time_ratio = _recent_gc_times_ms->sum()/interval_ms;
1086 89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	973 if (recent_avg_pause_time_ratio() < 0.0 \|\|
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	974 (recent_avg_pause_time_ratio() - 1.0 > 0.0)) {
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	975 #ifndef PRODUCT
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	976 // Dump info to allow post-facto debugging
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	977 gclog_or_tty->print_cr("recent_avg_pause_time_ratio() out of bounds");
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	978 gclog_or_tty->print_cr("-------------------------------------------");
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	979 gclog_or_tty->print_cr("Recent GC Times (ms):");
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	980 _recent_gc_times_ms->dump();
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	981 gclog_or_tty->print_cr("(End Time=%3.3f) Recent GC End Times (s):", end_time_sec);
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	982 _recent_prev_end_times_for_all_gcs_sec->dump();
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	983 gclog_or_tty->print_cr("GC = %3.3f, Interval = %3.3f, Ratio = %3.3f",
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	984 _recent_gc_times_ms->sum(), interval_ms, recent_avg_pause_time_ratio());
1087 23b9a8d315fc 6902701: G1: protect debugging code related to 6898948 with a debug flag ysr parents: 1086 diff changeset	985 // In debug mode, terminate the JVM if the user wants to debug at this point.
23b9a8d315fc 6902701: G1: protect debugging code related to 6898948 with a debug flag ysr parents: 1086 diff changeset	986 assert(!G1FailOnFPError, "Debugging data for CR 6898948 has been dumped above");
23b9a8d315fc 6902701: G1: protect debugging code related to 6898948 with a debug flag ysr parents: 1086 diff changeset	987 #endif // !PRODUCT
23b9a8d315fc 6902701: G1: protect debugging code related to 6898948 with a debug flag ysr parents: 1086 diff changeset	988 // Clip ratio between 0.0 and 1.0, and continue. This will be fixed in
23b9a8d315fc 6902701: G1: protect debugging code related to 6898948 with a debug flag ysr parents: 1086 diff changeset	989 // CR 6902692 by redoing the manner in which the ratio is incrementally computed.
1086 89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	990 if (_recent_avg_pause_time_ratio < 0.0) {
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	991 _recent_avg_pause_time_ratio = 0.0;
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	992 } else {
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	993 assert(_recent_avg_pause_time_ratio - 1.0 > 0.0, "Ctl-point invariant");
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	994 _recent_avg_pause_time_ratio = 1.0;
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	995 }
89f1b9ae8991 6898948: G1: forensic instrumentation for out-of-bounds recent_avg_pause_time_ratio() ysr parents: 1043 diff changeset	996 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	997 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	998 bool new_in_marking_window = _in_marking_window;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	999 bool new_in_marking_window_im = false;
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1000 if (during_initial_mark_pause()) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1001 new_in_marking_window = true;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1002 new_in_marking_window_im = true;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1003 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1004
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1005 if (_last_young_gc) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1006 // This is supposed to to be the "last young GC" before we start
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1007 // doing mixed GCs. Here we decide whether to start mixed GCs or not.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1008
3982 273b46400613 7086533: G1: assert(!_g1->is_obj_dead(obj)): We should not be preserving dead objs: g1CollectedHeap.cpp:3835 johnc parents: 3979 diff changeset	1009 if (!last_pause_included_initial_mark) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1010 if (next_gc_should_be_mixed("start mixed GCs",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1011 "do not start mixed GCs")) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1012 set_gcs_are_young(false);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1013 }
3982 273b46400613 7086533: G1: assert(!_g1->is_obj_dead(obj)): We should not be preserving dead objs: g1CollectedHeap.cpp:3835 johnc parents: 3979 diff changeset	1014 } else {
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1015 ergo_verbose0(ErgoMixedGCs,
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1016 "do not start mixed GCs",
3982 273b46400613 7086533: G1: assert(!_g1->is_obj_dead(obj)): We should not be preserving dead objs: g1CollectedHeap.cpp:3835 johnc parents: 3979 diff changeset	1017 ergo_format_reason("concurrent cycle is about to start"));
273b46400613 7086533: G1: assert(!_g1->is_obj_dead(obj)): We should not be preserving dead objs: g1CollectedHeap.cpp:3835 johnc parents: 3979 diff changeset	1018 }
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1019 _last_young_gc = false;
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1020 }
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1021
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1022 if (!_last_gc_was_young) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1023 // This is a mixed GC. Here we decide whether to continue doing
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1024 // mixed GCs or not.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1025
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1026 if (!next_gc_should_be_mixed("continue mixed GCs",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1027 "do not continue mixed GCs")) {
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1028 set_gcs_are_young(true);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1029 }
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1030 }
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1031
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1032 _short_lived_surv_rate_group->start_adding_regions();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1033 // do that for any other surv rate groupsx
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1034
677 96b229c54d1e 6543938: G1: remove the concept of popularity apetrusenko parents: 648 diff changeset	1035 if (update_stats) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1036 double cost_per_card_ms = 0.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1037 if (_pending_cards > 0) {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1038 cost_per_card_ms = phase_times()->_update_rs_time / (double) _pending_cards;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1039 _cost_per_card_ms_seq->add(cost_per_card_ms);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1040 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1041
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1042 size_t cards_scanned = _g1->cards_scanned();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1043
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1044 double cost_per_entry_ms = 0.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1045 if (cards_scanned > 10) {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1046 cost_per_entry_ms = phase_times()->_scan_rs_time / (double) cards_scanned;
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1047 if (_last_gc_was_young) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1048 _cost_per_entry_ms_seq->add(cost_per_entry_ms);
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1049 } else {
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1050 _mixed_cost_per_entry_ms_seq->add(cost_per_entry_ms);
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1051 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1052 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1053
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1054 if (_max_rs_lengths > 0) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1055 double cards_per_entry_ratio =
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1056 (double) cards_scanned / (double) _max_rs_lengths;
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1057 if (_last_gc_was_young) {
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1058 _young_cards_per_entry_ratio_seq->add(cards_per_entry_ratio);
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1059 } else {
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1060 _mixed_cards_per_entry_ratio_seq->add(cards_per_entry_ratio);
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1061 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1062 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1063
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1064 // This is defensive. For a while _max_rs_lengths could get
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1065 // smaller than _recorded_rs_lengths which was causing
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1066 // rs_length_diff to get very large and mess up the RSet length
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1067 // predictions. The reason was unsafe concurrent updates to the
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1068 // _inc_cset_recorded_rs_lengths field which the code below guards
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1069 // against (see CR 7118202). This bug has now been fixed (see CR
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1070 // 7119027). However, I'm still worried that
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1071 // _inc_cset_recorded_rs_lengths might still end up somewhat
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1072 // inaccurate. The concurrent refinement thread calculates an
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1073 // RSet's length concurrently with other CR threads updating it
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1074 // which might cause it to calculate the length incorrectly (if,
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1075 // say, it's in mid-coarsening). So I'll leave in the defensive
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1076 // conditional below just in case.
4130 d23d2b18183e 7118202: G1: eden size unnecessarily drops to a minimum tonyp parents: 4097 diff changeset	1077 size_t rs_length_diff = 0;
d23d2b18183e 7118202: G1: eden size unnecessarily drops to a minimum tonyp parents: 4097 diff changeset	1078 if (_max_rs_lengths > _recorded_rs_lengths) {
d23d2b18183e 7118202: G1: eden size unnecessarily drops to a minimum tonyp parents: 4097 diff changeset	1079 rs_length_diff = _max_rs_lengths - _recorded_rs_lengths;
d23d2b18183e 7118202: G1: eden size unnecessarily drops to a minimum tonyp parents: 4097 diff changeset	1080 }
d23d2b18183e 7118202: G1: eden size unnecessarily drops to a minimum tonyp parents: 4097 diff changeset	1081 _rs_length_diff_seq->add((double) rs_length_diff);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1082
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1083 size_t copied_bytes = surviving_bytes;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1084 double cost_per_byte_ms = 0.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1085 if (copied_bytes > 0) {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1086 cost_per_byte_ms = phase_times()->_obj_copy_time / (double) copied_bytes;
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1087 if (_in_marking_window) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1088 _cost_per_byte_ms_during_cm_seq->add(cost_per_byte_ms);
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1089 } else {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1090 _cost_per_byte_ms_seq->add(cost_per_byte_ms);
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1091 }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1092 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1093
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1094 double all_other_time_ms = pause_time_ms -
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1095 (phase_times()->_update_rs_time + phase_times()->_scan_rs_time + phase_times()->_obj_copy_time + phase_times()->_termination_time);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1096
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1097 double young_other_time_ms = 0.0;
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1098 if (young_cset_region_length() > 0) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1099 young_other_time_ms =
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1100 phase_times()->_recorded_young_cset_choice_time_ms +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1101 phase_times()->_recorded_young_free_cset_time_ms;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1102 _young_other_cost_per_region_ms_seq->add(young_other_time_ms /
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1103 (double) young_cset_region_length());
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1104 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1105 double non_young_other_time_ms = 0.0;
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1106 if (old_cset_region_length() > 0) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1107 non_young_other_time_ms =
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1108 phase_times()->_recorded_non_young_cset_choice_time_ms +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1109 phase_times()->_recorded_non_young_free_cset_time_ms;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1110
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1111 _non_young_other_cost_per_region_ms_seq->add(non_young_other_time_ms /
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1112 (double) old_cset_region_length());
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1113 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1114
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1115 double constant_other_time_ms = all_other_time_ms -
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1116 (young_other_time_ms + non_young_other_time_ms);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1117 _constant_other_time_ms_seq->add(constant_other_time_ms);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1118
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1119 double survival_ratio = 0.0;
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1120 if (_collection_set_bytes_used_before > 0) {
3830 f44782f04dd4 7039627: G1: avoid BOT updates for survivor allocations and dirty survivor regions incrementally tonyp parents: 3823 diff changeset	1121 survival_ratio = (double) _bytes_copied_during_gc /
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1122 (double) _collection_set_bytes_used_before;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1123 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1124
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1125 _pending_cards_seq->add((double) _pending_cards);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1126 _rs_lengths_seq->add((double) _max_rs_lengths);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1127 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1128
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1129 _in_marking_window = new_in_marking_window;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1130 _in_marking_window_im = new_in_marking_window_im;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1131 _free_regions_at_end_of_collection = _g1->free_regions();
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1132 update_young_list_target_length();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1133
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1134 // Note that _mmu_tracker->max_gc_time() returns the time in seconds.
1282 b81f3572f355 6928059: G1: command line parameter renaming tonyp parents: 1261 diff changeset	1135 double update_rs_time_goal_ms = _mmu_tracker->max_gc_time() * MILLIUNITS * G1RSetUpdatingPauseTimePercent / 100.0;
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1136 adjust_concurrent_refinement(phase_times()->_update_rs_time, phase_times()->_update_rs_processed_buffers, update_rs_time_goal_ms);
4013 074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1137
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1138 _collectionSetChooser->verify();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1139 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1140
6059 3a22b77e755a 7161545: G1: Minor cleanups to the G1 logging brutisso parents: 6030 diff changeset	1141 #define EXT_SIZE_FORMAT "%.1f%s"
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1142 #define EXT_SIZE_PARAMS(bytes) \
6059 3a22b77e755a 7161545: G1: Minor cleanups to the G1 logging brutisso parents: 6030 diff changeset	1143 byte_size_in_proper_unit((double)(bytes)), \
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1144 proper_unit_for_byte_size((bytes))
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1145
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1146 void G1CollectorPolicy::print_heap_transition() {
6007 5c86f8211d1e 7160728: Introduce an extra logging level for G1 logging brutisso parents: 5988 diff changeset	1147 if (G1Log::finer()) {
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1148 YoungList* young_list = _g1->young_list();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1149 size_t eden_bytes = young_list->eden_used_bytes();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1150 size_t survivor_bytes = young_list->survivor_used_bytes();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1151 size_t used_before_gc = _cur_collection_pause_used_at_start_bytes;
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1152 size_t used = _g1->used();
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1153 size_t capacity = _g1->capacity();
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1154 size_t eden_capacity =
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1155 (_young_list_target_length * HeapRegion::GrainBytes) - survivor_bytes;
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1156
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1157 gclog_or_tty->print_cr(
3920 af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1158 " [Eden: "EXT_SIZE_FORMAT"("EXT_SIZE_FORMAT")->"EXT_SIZE_FORMAT"("EXT_SIZE_FORMAT") "
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1159 "Survivors: "EXT_SIZE_FORMAT"->"EXT_SIZE_FORMAT" "
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1160 "Heap: "EXT_SIZE_FORMAT"("EXT_SIZE_FORMAT")->"
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1161 EXT_SIZE_FORMAT"("EXT_SIZE_FORMAT")]",
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1162 EXT_SIZE_PARAMS(_eden_bytes_before_gc),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1163 EXT_SIZE_PARAMS(_prev_eden_capacity),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1164 EXT_SIZE_PARAMS(eden_bytes),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1165 EXT_SIZE_PARAMS(eden_capacity),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1166 EXT_SIZE_PARAMS(_survivor_bytes_before_gc),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1167 EXT_SIZE_PARAMS(survivor_bytes),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1168 EXT_SIZE_PARAMS(used_before_gc),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1169 EXT_SIZE_PARAMS(_capacity_before_gc),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1170 EXT_SIZE_PARAMS(used),
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1171 EXT_SIZE_PARAMS(capacity));
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1172
af2ab04e0038 6929868: G1: introduce min / max young gen size bounds brutisso parents: 3919 diff changeset	1173 _prev_eden_capacity = eden_capacity;
6007 5c86f8211d1e 7160728: Introduce an extra logging level for G1 logging brutisso parents: 5988 diff changeset	1174 } else if (G1Log::fine()) {
3764 053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1175 _g1->print_size_transition(gclog_or_tty,
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1176 _cur_collection_pause_used_at_start_bytes,
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1177 _g1->used(), _g1->capacity());
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1178 }
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1179 }
053d84a76d3d 7032531: G1: enhance GC logging to include more accurate eden / survivor size transitions tonyp parents: 2430 diff changeset	1180
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1181 void G1CollectorPolicy::adjust_concurrent_refinement(double update_rs_time,
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1182 double update_rs_processed_buffers,
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1183 double goal_ms) {
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1184 DirtyCardQueueSet& dcqs = JavaThread::dirty_card_queue_set();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1185 ConcurrentG1Refine *cg1r = G1CollectedHeap::heap()->concurrent_g1_refine();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1186
1282 b81f3572f355 6928059: G1: command line parameter renaming tonyp parents: 1261 diff changeset	1187 if (G1UseAdaptiveConcRefinement) {
1111 44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1188 const int k_gy = 3, k_gr = 6;
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1189 const double inc_k = 1.1, dec_k = 0.9;
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1190
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1191 int g = cg1r->green_zone();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1192 if (update_rs_time > goal_ms) {
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1193 g = (int)(g * dec_k); // Can become 0, that's OK. That would mean a mutator-only processing.
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1194 } else {
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1195 if (update_rs_time < goal_ms && update_rs_processed_buffers > g) {
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1196 g = (int)MAX2(g * inc_k, g + 1.0);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1197 }
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1198 }
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1199 // Change the refinement threads params
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1200 cg1r->set_green_zone(g);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1201 cg1r->set_yellow_zone(g * k_gy);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1202 cg1r->set_red_zone(g * k_gr);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1203 cg1r->reinitialize_threads();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1204
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1205 int processing_threshold_delta = MAX2((int)(cg1r->green_zone() * sigma()), 1);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1206 int processing_threshold = MIN2(cg1r->green_zone() + processing_threshold_delta,
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1207 cg1r->yellow_zone());
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1208 // Change the barrier params
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1209 dcqs.set_process_completed_threshold(processing_threshold);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1210 dcqs.set_max_completed_queue(cg1r->red_zone());
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1211 }
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1212
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1213 int curr_queue_size = dcqs.completed_buffers_num();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1214 if (curr_queue_size >= cg1r->yellow_zone()) {
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1215 dcqs.set_completed_queue_padding(curr_queue_size);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1216 } else {
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1217 dcqs.set_completed_queue_padding(0);
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1218 }
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1219 dcqs.notify_if_necessary();
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1220 }
44f61c24ddab 6862387: tune concurrent refinement further iveresov parents: 1088 diff changeset	1221
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1222 double
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1223 G1CollectorPolicy::predict_base_elapsed_time_ms(size_t pending_cards,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1224 size_t scanned_cards) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1225 return
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1226 predict_rs_update_time_ms(pending_cards) +
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1227 predict_rs_scan_time_ms(scanned_cards) +
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1228 predict_constant_other_time_ms();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1229 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1230
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1231 double
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1232 G1CollectorPolicy::predict_base_elapsed_time_ms(size_t pending_cards) {
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1233 size_t rs_length = predict_rs_length_diff();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1234 size_t card_num;
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1235 if (gcs_are_young()) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1236 card_num = predict_young_card_num(rs_length);
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1237 } else {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1238 card_num = predict_non_young_card_num(rs_length);
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1239 }
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1240 return predict_base_elapsed_time_ms(pending_cards, card_num);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1241 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1242
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1243 size_t G1CollectorPolicy::predict_bytes_to_copy(HeapRegion* hr) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1244 size_t bytes_to_copy;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1245 if (hr->is_marked())
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1246 bytes_to_copy = hr->max_live_bytes();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1247 else {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1248 assert(hr->is_young() && hr->age_in_surv_rate_group() != -1, "invariant");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1249 int age = hr->age_in_surv_rate_group();
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1250 double yg_surv_rate = predict_yg_surv_rate(age, hr->surv_rate_group());
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1251 bytes_to_copy = (size_t) ((double) hr->used() * yg_surv_rate);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1252 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1253 return bytes_to_copy;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1254 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1255
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1256 double
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1257 G1CollectorPolicy::predict_region_elapsed_time_ms(HeapRegion* hr,
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1258 bool for_young_gc) {
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1259 size_t rs_length = hr->rem_set()->occupied();
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1260 size_t card_num;
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1261
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1262 // Predicting the number of cards is based on which type of GC
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1263 // we're predicting for.
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1264 if (for_young_gc) {
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1265 card_num = predict_young_card_num(rs_length);
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1266 } else {
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1267 card_num = predict_non_young_card_num(rs_length);
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1268 }
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1269 size_t bytes_to_copy = predict_bytes_to_copy(hr);
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1270
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1271 double region_elapsed_time_ms =
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1272 predict_rs_scan_time_ms(card_num) +
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1273 predict_object_copy_time_ms(bytes_to_copy);
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1274
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1275 // The prediction of the "other" time for this region is based
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1276 // upon the region type and NOT the GC type.
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1277 if (hr->is_young()) {
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1278 region_elapsed_time_ms += predict_young_other_time_ms(1);
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1279 } else {
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1280 region_elapsed_time_ms += predict_non_young_other_time_ms(1);
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1281 }
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1282 return region_elapsed_time_ms;
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1283 }
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1284
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1285 void
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1286 G1CollectorPolicy::init_cset_region_lengths(uint eden_cset_region_length,
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1287 uint survivor_cset_region_length) {
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1288 _eden_cset_region_length = eden_cset_region_length;
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1289 _survivor_cset_region_length = survivor_cset_region_length;
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1290 _old_cset_region_length = 0;
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1291 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1292
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1293 void G1CollectorPolicy::set_recorded_rs_lengths(size_t rs_lengths) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1294 _recorded_rs_lengths = rs_lengths;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1295 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1296
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1297 void G1CollectorPolicy::update_recent_gc_times(double end_time_sec,
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1298 double elapsed_ms) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1299 _recent_gc_times_ms->add(elapsed_ms);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1300 _recent_prev_end_times_for_all_gcs_sec->add(end_time_sec);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1301 _prev_collection_pause_end_ms = end_time_sec * 1000.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1302 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1303
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1304 size_t G1CollectorPolicy::expansion_amount() {
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1305 double recent_gc_overhead = recent_avg_pause_time_ratio() * 100.0;
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1306 double threshold = _gc_overhead_perc;
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1307 if (recent_gc_overhead > threshold) {
751 20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	1308 // We will double the existing space, or take
20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	1309 // G1ExpandByPercentOfAvailable % of the available expansion
20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	1310 // space, whichever is smaller, bounded below by a minimum
20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	1311 // expansion (unless that's all that's left.)
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1312 const size_t min_expand_bytes = 1*M;
2188 c33825b68624 6923430: G1: assert(res != 0,"This should have worked.") johnc parents: 2152 diff changeset	1313 size_t reserved_bytes = _g1->max_capacity();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1314 size_t committed_bytes = _g1->capacity();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1315 size_t uncommitted_bytes = reserved_bytes - committed_bytes;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1316 size_t expand_bytes;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1317 size_t expand_bytes_via_pct =
751 20c6f43950b5 6490395: G1: Tidy up command line flags. johnc parents: 677 diff changeset	1318 uncommitted_bytes * G1ExpandByPercentOfAvailable / 100;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1319 expand_bytes = MIN2(expand_bytes_via_pct, committed_bytes);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1320 expand_bytes = MAX2(expand_bytes, min_expand_bytes);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1321 expand_bytes = MIN2(expand_bytes, uncommitted_bytes);
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1322
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1323 ergo_verbose5(ErgoHeapSizing,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1324 "attempt heap expansion",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1325 ergo_format_reason("recent GC overhead higher than "
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1326 "threshold after GC")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1327 ergo_format_perc("recent GC overhead")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1328 ergo_format_perc("threshold")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1329 ergo_format_byte("uncommitted")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1330 ergo_format_byte_perc("calculated expansion amount"),
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1331 recent_gc_overhead, threshold,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1332 uncommitted_bytes,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1333 expand_bytes_via_pct, (double) G1ExpandByPercentOfAvailable);
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1334
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1335 return expand_bytes;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1336 } else {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1337 return 0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1338 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1339 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1340
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1341 void G1CollectorPolicy::print_tracing_info() const {
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	1342 _trace_gen0_time_data.print();
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	1343 _trace_gen1_time_data.print();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1344 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1345
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1346 void G1CollectorPolicy::print_yg_surv_rate_info() const {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1347 #ifndef PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1348 _short_lived_surv_rate_group->print_surv_rate_summary();
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1349 // add this call for any other surv rate groups
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1350 #endif // PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1351 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1352
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1353 #ifndef PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1354 // for debugging, bit of a hack...
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1355 static char*
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1356 region_num_to_mbs(int length) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1357 static char buffer[64];
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1358 double bytes = (double) (length * HeapRegion::GrainBytes);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1359 double mbs = bytes / (double) (1024 * 1024);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1360 sprintf(buffer, "%7.2lfMB", mbs);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1361 return buffer;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1362 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1363 #endif // PRODUCT
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1364
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1365 uint G1CollectorPolicy::max_regions(int purpose) {
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1366 switch (purpose) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1367 case GCAllocForSurvived:
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1368 return _max_survivor_regions;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1369 case GCAllocForTenured:
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1370 return REGIONS_UNLIMITED;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1371 default:
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1372 ShouldNotReachHere();
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1373 return REGIONS_UNLIMITED;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1374 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1375 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1376
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1377 void G1CollectorPolicy::update_max_gc_locker_expansion() {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1378 uint expansion_region_num = 0;
1991 016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1379 if (GCLockerEdenExpansionPercent > 0) {
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1380 double perc = (double) GCLockerEdenExpansionPercent / 100.0;
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1381 double expansion_region_num_d = perc * (double) _young_list_target_length;
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1382 // We use ceiling so that if expansion_region_num_d is > 0.0 (but
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1383 // less than 1.0) we'll get 1.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1384 expansion_region_num = (uint) ceil(expansion_region_num_d);
1991 016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1385 } else {
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1386 assert(expansion_region_num == 0, "sanity");
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1387 }
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1388 _young_list_max_length = _young_list_target_length + expansion_region_num;
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1389 assert(_young_list_target_length <= _young_list_max_length, "post-condition");
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1390 }
016a3628c885 6994056: G1: when GC locker is active, extend the Eden instead of allocating into the old gen tonyp parents: 1973 diff changeset	1391
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1392 // Calculates survivor space parameters.
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1393 void G1CollectorPolicy::update_survivors_policy() {
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1394 double max_survivor_regions_d =
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1395 (double) _young_list_target_length / (double) SurvivorRatio;
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1396 // We use ceiling so that if max_survivor_regions_d is > 0.0 (but
4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1397 // smaller than 1.0) we'll get 1.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1398 _max_survivor_regions = (uint) ceil(max_survivor_regions_d);
3919 4f41766176cf 7084509: G1: fix inconsistencies and mistakes in the young list target length calculations tonyp parents: 3914 diff changeset	1399
3868 ae73da50be4b 7081064: G1: remove develop params G1FixedSurvivorSpaceSize, G1FixedTenuringThreshold, and G1FixedEdenSize tonyp parents: 3867 diff changeset	1400 _tenuring_threshold = _survivors_age_table.compute_tenuring_threshold(
545 58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1401 HeapRegion::GrainWords * _max_survivor_regions);
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1402 }
58054a18d735 6484959: G1: introduce survivor spaces apetrusenko parents: 526 diff changeset	1403
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1404 bool G1CollectorPolicy::force_initial_mark_if_outside_cycle(
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1405 GCCause::Cause gc_cause) {
1656 4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1406 bool during_cycle = _g1->concurrent_mark()->cmThread()->during_cycle();
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1407 if (!during_cycle) {
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1408 ergo_verbose1(ErgoConcCycles,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1409 "request concurrent cycle initiation",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1410 ergo_format_reason("requested by GC cause")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1411 ergo_format_str("GC cause"),
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1412 GCCause::to_string(gc_cause));
1656 4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1413 set_initiate_conc_mark_if_possible();
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1414 return true;
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1415 } else {
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1416 ergo_verbose1(ErgoConcCycles,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1417 "do not request concurrent cycle initiation",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1418 ergo_format_reason("concurrent cycle already in progress")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1419 ergo_format_str("GC cause"),
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1420 GCCause::to_string(gc_cause));
1656 4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1421 return false;
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1422 }
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1423 }
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1424
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1425 void
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1426 G1CollectorPolicy::decide_on_conc_mark_initiation() {
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1427 // We are about to decide on whether this pause will be an
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1428 // initial-mark pause.
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1429
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1430 // First, during_initial_mark_pause() should not be already set. We
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1431 // will set it here if we have to. However, it should be cleared by
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1432 // the end of the pause (it's only set for the duration of an
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1433 // initial-mark pause).
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1434 assert(!during_initial_mark_pause(), "pre-condition");
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1435
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1436 if (initiate_conc_mark_if_possible()) {
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1437 // We had noticed on a previous pause that the heap occupancy has
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1438 // gone over the initiating threshold and we should start a
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1439 // concurrent marking cycle. So we might initiate one.
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1440
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1441 bool during_cycle = _g1->concurrent_mark()->cmThread()->during_cycle();
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1442 if (!during_cycle) {
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1443 // The concurrent marking thread is not "during a cycle", i.e.,
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1444 // it has completed the last one. So we can go ahead and
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1445 // initiate a new cycle.
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1446
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1447 set_during_initial_mark_pause();
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1448 // We do not allow mixed GCs during marking.
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1449 if (!gcs_are_young()) {
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1450 set_gcs_are_young(true);
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1451 ergo_verbose0(ErgoMixedGCs,
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1452 "end mixed GCs",
3982 273b46400613 7086533: G1: assert(!_g1->is_obj_dead(obj)): We should not be preserving dead objs: g1CollectedHeap.cpp:3835 johnc parents: 3979 diff changeset	1453 ergo_format_reason("concurrent cycle is about to start"));
273b46400613 7086533: G1: assert(!_g1->is_obj_dead(obj)): We should not be preserving dead objs: g1CollectedHeap.cpp:3835 johnc parents: 3979 diff changeset	1454 }
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1455
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1456 // And we can now clear initiate_conc_mark_if_possible() as
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1457 // we've already acted on it.
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1458 clear_initiate_conc_mark_if_possible();
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1459
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1460 ergo_verbose0(ErgoConcCycles,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1461 "initiate concurrent cycle",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1462 ergo_format_reason("concurrent cycle initiation requested"));
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1463 } else {
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1464 // The concurrent marking thread is still finishing up the
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1465 // previous cycle. If we start one right now the two cycles
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1466 // overlap. In particular, the concurrent marking thread might
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1467 // be in the process of clearing the next marking bitmap (which
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1468 // we will use for the next cycle if we start one). Starting a
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1469 // cycle now will be bad given that parts of the marking
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1470 // information might get cleared by the marking thread. And we
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1471 // cannot wait for the marking thread to finish the cycle as it
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1472 // periodically yields while clearing the next marking bitmap
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1473 // and, if it's in a yield point, it's waiting for us to
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1474 // finish. So, at this point we will not start a cycle and we'll
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1475 // let the concurrent marking thread complete the last one.
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1476 ergo_verbose0(ErgoConcCycles,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1477 "do not initiate concurrent cycle",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1478 ergo_format_reason("concurrent cycle already in progress"));
1359 23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1479 }
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1480 }
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1481 }
23b1b27ac76c 6909756: G1: guarantee(G1CollectedHeap::heap()->mark_in_progress(),"Precondition.") tonyp parents: 1356 diff changeset	1482
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1483 class KnownGarbageClosure: public HeapRegionClosure {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1484 G1CollectedHeap* _g1h;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1485 CollectionSetChooser* _hrSorted;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1486
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1487 public:
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1488 KnownGarbageClosure(CollectionSetChooser* hrSorted) :
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1489 _g1h(G1CollectedHeap::heap()), _hrSorted(hrSorted) { }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1490
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1491 bool doHeapRegion(HeapRegion* r) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1492 // We only include humongous regions in collection
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1493 // sets when concurrent mark shows that their contained object is
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1494 // unreachable.
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1495
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1496 // Do we have any marking information for this region?
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1497 if (r->is_marked()) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1498 // We will skip any region that's currently used as an old GC
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1499 // alloc region (we should not consider those for collection
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1500 // before we fill them up).
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1501 if (_hrSorted->should_add(r) && !_g1h->is_old_gc_alloc_region(r)) {
f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1502 _hrSorted->add_region(r);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1503 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1504 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1505 return false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1506 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1507 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1508
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1509 class ParKnownGarbageHRClosure: public HeapRegionClosure {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1510 G1CollectedHeap* _g1h;
6254 a2f7274eb6ef 7114678: G1: various small fixes, code cleanup, and refactoring tonyp parents: 6219 diff changeset	1511 CSetChooserParUpdater _cset_updater;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1512
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1513 public:
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1514 ParKnownGarbageHRClosure(CollectionSetChooser* hrSorted,
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1515 uint chunk_size) :
6254 a2f7274eb6ef 7114678: G1: various small fixes, code cleanup, and refactoring tonyp parents: 6219 diff changeset	1516 _g1h(G1CollectedHeap::heap()),
a2f7274eb6ef 7114678: G1: various small fixes, code cleanup, and refactoring tonyp parents: 6219 diff changeset	1517 _cset_updater(hrSorted, true /* parallel */, chunk_size) { }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1518
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1519 bool doHeapRegion(HeapRegion* r) {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1520 // Do we have any marking information for this region?
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1521 if (r->is_marked()) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1522 // We will skip any region that's currently used as an old GC
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1523 // alloc region (we should not consider those for collection
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1524 // before we fill them up).
6254 a2f7274eb6ef 7114678: G1: various small fixes, code cleanup, and refactoring tonyp parents: 6219 diff changeset	1525 if (_cset_updater.should_add(r) && !_g1h->is_old_gc_alloc_region(r)) {
a2f7274eb6ef 7114678: G1: various small fixes, code cleanup, and refactoring tonyp parents: 6219 diff changeset	1526 _cset_updater.add_region(r);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1527 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1528 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1529 return false;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1530 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1531 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1532
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1533 class ParKnownGarbageTask: public AbstractGangTask {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1534 CollectionSetChooser* _hrSorted;
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1535 uint _chunk_size;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1536 G1CollectedHeap* _g1;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1537 public:
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1538 ParKnownGarbageTask(CollectionSetChooser* hrSorted, uint chunk_size) :
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1539 AbstractGangTask("ParKnownGarbageTask"),
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1540 _hrSorted(hrSorted), _chunk_size(chunk_size),
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1541 _g1(G1CollectedHeap::heap()) { }
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1542
4728 441e946dc1af 7121618: Change type of number of GC workers to unsigned int. jmasa parents: 4727 diff changeset	1543 void work(uint worker_id) {
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1544 ParKnownGarbageHRClosure parKnownGarbageCl(_hrSorted, _chunk_size);
f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1545
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1546 // Back to zero for the claim value.
4728 441e946dc1af 7121618: Change type of number of GC workers to unsigned int. jmasa parents: 4727 diff changeset	1547 _g1->heap_region_par_iterate_chunked(&parKnownGarbageCl, worker_id,
4095 bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1548 _g1->workers()->active_workers(),
355 0edda524b58c 6722565: G1: assert !r->is_on_unclean_list() fires tonyp parents: 342 diff changeset	1549 HeapRegion::InitialClaimValue);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1550 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1551 };
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1552
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1553 void
4095 bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1554 G1CollectorPolicy::record_concurrent_mark_cleanup_end(int no_of_gc_threads) {
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1555 _collectionSetChooser->clear();
4013 074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1556
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1557 uint region_num = _g1->n_regions();
1833 8b10f48633dc 6984287: Regularize how GC parallel workers are specified. jmasa parents: 1779 diff changeset	1558 if (G1CollectedHeap::use_parallel_gc_threads()) {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1559 const uint OverpartitionFactor = 4;
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1560 uint WorkUnit;
4095 bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1561 // The use of MinChunkSize = 8 in the original code
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1562 // causes some assertion failures when the total number of
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1563 // region is less than 8. The code here tries to fix that.
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1564 // Should the original code also be fixed?
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1565 if (no_of_gc_threads > 0) {
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1566 const uint MinWorkUnit = MAX2(region_num / no_of_gc_threads, 1U);
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1567 WorkUnit = MAX2(region_num / (no_of_gc_threads * OverpartitionFactor),
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1568 MinWorkUnit);
4095 bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1569 } else {
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1570 assert(no_of_gc_threads > 0,
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1571 "The active gc workers should be greater than 0");
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1572 // In a product build do something reasonable to avoid a crash.
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1573 const uint MinWorkUnit = MAX2(region_num / (uint) ParallelGCThreads, 1U);
4095 bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1574 WorkUnit =
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1575 MAX2(region_num / (uint) (ParallelGCThreads * OverpartitionFactor),
4095 bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1576 MinWorkUnit);
bca17e38de00 6593758: RFE: Enhance GC ergonomics to dynamically choose ParallelGCThreads jmasa parents: 4090 diff changeset	1577 }
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1578 _collectionSetChooser->prepare_for_par_region_addition(_g1->n_regions(),
f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1579 WorkUnit);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1580 ParKnownGarbageTask parKnownGarbageTask(_collectionSetChooser,
1571 2d127394260e 6916623: Align object to 16 bytes to use Compressed Oops with java heap up to 64Gb kvn parents: 1394 diff changeset	1581 (int) WorkUnit);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1582 _g1->workers()->run_task(&parKnownGarbageTask);
355 0edda524b58c 6722565: G1: assert !r->is_on_unclean_list() fires tonyp parents: 342 diff changeset	1583
0edda524b58c 6722565: G1: assert !r->is_on_unclean_list() fires tonyp parents: 342 diff changeset	1584 assert(_g1->check_heap_region_claim_values(HeapRegion::InitialClaimValue),
0edda524b58c 6722565: G1: assert !r->is_on_unclean_list() fires tonyp parents: 342 diff changeset	1585 "sanity check");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1586 } else {
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1587 KnownGarbageClosure knownGarbagecl(_collectionSetChooser);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1588 _g1->heap_region_iterate(&knownGarbagecl);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1589 }
4013 074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1590
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1591 _collectionSetChooser->sort_regions();
f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1592
4013 074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1593 double end_sec = os::elapsedTime();
074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1594 double elapsed_time_ms = (end_sec - _mark_cleanup_start_sec) * 1000.0;
074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1595 _concurrent_mark_cleanup_times_ms->add(elapsed_time_ms);
074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1596 _cur_mark_stop_world_time_ms += elapsed_time_ms;
074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1597 _prev_collection_pause_end_ms += elapsed_time_ms;
074f0252cc13 7088680: G1: Cleanup in the G1CollectorPolicy class tonyp parents: 3986 diff changeset	1598 _mmu_tracker->add_pause(_mark_cleanup_start_sec, end_sec, true);
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1599 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1600
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1601 // Add the heap region at the head of the non-incremental collection set
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1602 void G1CollectorPolicy::add_old_region_to_cset(HeapRegion* hr) {
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1603 assert(_inc_cset_build_state == Active, "Precondition");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1604 assert(!hr->is_young(), "non-incremental add of young region");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1605
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1606 assert(!hr->in_collection_set(), "should not already be in the CSet");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1607 hr->set_in_collection_set(true);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1608 hr->set_next_in_collection_set(_collection_set);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1609 _collection_set = hr;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1610 _collection_set_bytes_used_before += hr->used();
526 818efdefcc99 6484956: G1: improve evacuation pause efficiency tonyp parents: 470 diff changeset	1611 _g1->register_region_with_in_cset_fast_test(hr);
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1612 size_t rs_length = hr->rem_set()->occupied();
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1613 _recorded_rs_lengths += rs_length;
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1614 _old_cset_region_length += 1;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1615 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1616
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1617 // Initialize the per-collection-set information
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1618 void G1CollectorPolicy::start_incremental_cset_building() {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1619 assert(_inc_cset_build_state == Inactive, "Precondition");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1620
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1621 _inc_cset_head = NULL;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1622 _inc_cset_tail = NULL;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1623 _inc_cset_bytes_used_before = 0;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1624
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1625 _inc_cset_max_finger = 0;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1626 _inc_cset_recorded_rs_lengths = 0;
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1627 _inc_cset_recorded_rs_lengths_diffs = 0;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1628 _inc_cset_predicted_elapsed_time_ms = 0.0;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1629 _inc_cset_predicted_elapsed_time_ms_diffs = 0.0;
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1630 _inc_cset_build_state = Active;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1631 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1632
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1633 void G1CollectorPolicy::finalize_incremental_cset_building() {
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1634 assert(_inc_cset_build_state == Active, "Precondition");
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1635 assert(SafepointSynchronize::is_at_safepoint(), "should be at a safepoint");
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1636
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1637 // The two "main" fields, _inc_cset_recorded_rs_lengths and
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1638 // _inc_cset_predicted_elapsed_time_ms, are updated by the thread
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1639 // that adds a new region to the CSet. Further updates by the
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1640 // concurrent refinement thread that samples the young RSet lengths
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1641 // are accumulated in the *_diffs fields. Here we add the diffs to
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1642 // the "main" fields.
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1643
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1644 if (_inc_cset_recorded_rs_lengths_diffs >= 0) {
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1645 _inc_cset_recorded_rs_lengths += _inc_cset_recorded_rs_lengths_diffs;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1646 } else {
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1647 // This is defensive. The diff should in theory be always positive
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1648 // as RSets can only grow between GCs. However, given that we
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1649 // sample their size concurrently with other threads updating them
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1650 // it's possible that we might get the wrong size back, which
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1651 // could make the calculations somewhat inaccurate.
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1652 size_t diffs = (size_t) (-_inc_cset_recorded_rs_lengths_diffs);
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1653 if (_inc_cset_recorded_rs_lengths >= diffs) {
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1654 _inc_cset_recorded_rs_lengths -= diffs;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1655 } else {
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1656 _inc_cset_recorded_rs_lengths = 0;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1657 }
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1658 }
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1659 _inc_cset_predicted_elapsed_time_ms +=
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1660 _inc_cset_predicted_elapsed_time_ms_diffs;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1661
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1662 _inc_cset_recorded_rs_lengths_diffs = 0;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1663 _inc_cset_predicted_elapsed_time_ms_diffs = 0.0;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1664 }
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1665
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1666 void G1CollectorPolicy::add_to_incremental_cset_info(HeapRegion* hr, size_t rs_length) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1667 // This routine is used when:
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1668 // * adding survivor regions to the incremental cset at the end of an
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1669 // evacuation pause,
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1670 // * adding the current allocation region to the incremental cset
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1671 // when it is retired, and
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1672 // * updating existing policy information for a region in the
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1673 // incremental cset via young list RSet sampling.
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1674 // Therefore this routine may be called at a safepoint by the
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1675 // VM thread, or in-between safepoints by mutator threads (when
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1676 // retiring the current allocation region) or a concurrent
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1677 // refine thread (RSet sampling).
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1678
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1679 double region_elapsed_time_ms = predict_region_elapsed_time_ms(hr, gcs_are_young());
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1680 size_t used_bytes = hr->used();
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1681 _inc_cset_recorded_rs_lengths += rs_length;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1682 _inc_cset_predicted_elapsed_time_ms += region_elapsed_time_ms;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1683 _inc_cset_bytes_used_before += used_bytes;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1684
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1685 // Cache the values we have added to the aggregated informtion
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1686 // in the heap region in case we have to remove this region from
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1687 // the incremental collection set, or it is updated by the
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1688 // rset sampling code
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1689 hr->set_recorded_rs_length(rs_length);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1690 hr->set_predicted_elapsed_time_ms(region_elapsed_time_ms);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1691 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1692
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1693 void G1CollectorPolicy::update_incremental_cset_info(HeapRegion* hr,
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1694 size_t new_rs_length) {
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1695 // Update the CSet information that is dependent on the new RS length
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1696 assert(hr->is_young(), "Precondition");
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1697 assert(!SafepointSynchronize::is_at_safepoint(),
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1698 "should not be at a safepoint");
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1699
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1700 // We could have updated _inc_cset_recorded_rs_lengths and
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1701 // _inc_cset_predicted_elapsed_time_ms directly but we'd need to do
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1702 // that atomically, as this code is executed by a concurrent
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1703 // refinement thread, potentially concurrently with a mutator thread
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1704 // allocating a new region and also updating the same fields. To
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1705 // avoid the atomic operations we accumulate these updates on two
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1706 // separate fields (*_diffs) and we'll just add them to the "main"
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1707 // fields at the start of a GC.
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1708
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1709 ssize_t old_rs_length = (ssize_t) hr->recorded_rs_length();
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1710 ssize_t rs_lengths_diff = (ssize_t) new_rs_length - old_rs_length;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1711 _inc_cset_recorded_rs_lengths_diffs += rs_lengths_diff;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1712
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1713 double old_elapsed_time_ms = hr->predicted_elapsed_time_ms();
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1714 double new_region_elapsed_time_ms = predict_region_elapsed_time_ms(hr, gcs_are_young());
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1715 double elapsed_ms_diff = new_region_elapsed_time_ms - old_elapsed_time_ms;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1716 _inc_cset_predicted_elapsed_time_ms_diffs += elapsed_ms_diff;
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1717
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1718 hr->set_recorded_rs_length(new_rs_length);
67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1719 hr->set_predicted_elapsed_time_ms(new_region_elapsed_time_ms);
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1720 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1721
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1722 void G1CollectorPolicy::add_region_to_incremental_cset_common(HeapRegion* hr) {
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1723 assert(hr->is_young(), "invariant");
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1724 assert(hr->young_index_in_cset() > -1, "should have already been set");
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1725 assert(_inc_cset_build_state == Active, "Precondition");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1726
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1727 // We need to clear and set the cached recorded/cached collection set
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1728 // information in the heap region here (before the region gets added
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1729 // to the collection set). An individual heap region's cached values
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1730 // are calculated, aggregated with the policy collection set info,
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1731 // and cached in the heap region here (initially) and (subsequently)
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1732 // by the Young List sampling code.
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1733
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1734 size_t rs_length = hr->rem_set()->occupied();
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1735 add_to_incremental_cset_info(hr, rs_length);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1736
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1737 HeapWord* hr_end = hr->end();
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1738 _inc_cset_max_finger = MAX2(_inc_cset_max_finger, hr_end);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1739
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1740 assert(!hr->in_collection_set(), "invariant");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1741 hr->set_in_collection_set(true);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1742 assert( hr->next_in_collection_set() == NULL, "invariant");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1743
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1744 _g1->register_region_with_in_cset_fast_test(hr);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1745 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1746
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1747 // Add the region at the RHS of the incremental cset
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1748 void G1CollectorPolicy::add_region_to_incremental_cset_rhs(HeapRegion* hr) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1749 // We should only ever be appending survivors at the end of a pause
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1750 assert( hr->is_survivor(), "Logic");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1751
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1752 // Do the 'common' stuff
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1753 add_region_to_incremental_cset_common(hr);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1754
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1755 // Now add the region at the right hand side
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1756 if (_inc_cset_tail == NULL) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1757 assert(_inc_cset_head == NULL, "invariant");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1758 _inc_cset_head = hr;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1759 } else {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1760 _inc_cset_tail->set_next_in_collection_set(hr);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1761 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1762 _inc_cset_tail = hr;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1763 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1764
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1765 // Add the region to the LHS of the incremental cset
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1766 void G1CollectorPolicy::add_region_to_incremental_cset_lhs(HeapRegion* hr) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1767 // Survivors should be added to the RHS at the end of a pause
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1768 assert(!hr->is_survivor(), "Logic");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1769
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1770 // Do the 'common' stuff
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1771 add_region_to_incremental_cset_common(hr);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1772
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1773 // Add the region at the left hand side
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1774 hr->set_next_in_collection_set(_inc_cset_head);
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1775 if (_inc_cset_head == NULL) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1776 assert(_inc_cset_tail == NULL, "Invariant");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1777 _inc_cset_tail = hr;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1778 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1779 _inc_cset_head = hr;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1780 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1781
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1782 #ifndef PRODUCT
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1783 void G1CollectorPolicy::print_collection_set(HeapRegion* list_head, outputStream* st) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1784 assert(list_head == inc_cset_head() \|\| list_head == collection_set(), "must be");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1785
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1786 st->print_cr("\nCollection_set:");
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1787 HeapRegion* csr = list_head;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1788 while (csr != NULL) {
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1789 HeapRegion* next = csr->next_in_collection_set();
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1790 assert(csr->in_collection_set(), "bad CS");
6027 8a2e5a6a19a4 7143490: G1: Remove HeapRegion::_top_at_conc_mark_count johnc parents: 6011 diff changeset	1791 st->print_cr(" "HR_FORMAT", P: "PTR_FORMAT "N: "PTR_FORMAT", age: %4d",
8a2e5a6a19a4 7143490: G1: Remove HeapRegion::_top_at_conc_mark_count johnc parents: 6011 diff changeset	1792 HR_FORMAT_PARAMS(csr),
8a2e5a6a19a4 7143490: G1: Remove HeapRegion::_top_at_conc_mark_count johnc parents: 6011 diff changeset	1793 csr->prev_top_at_mark_start(), csr->next_top_at_mark_start(),
8a2e5a6a19a4 7143490: G1: Remove HeapRegion::_top_at_conc_mark_count johnc parents: 6011 diff changeset	1794 csr->age_in_surv_rate_group_cond());
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1795 csr = next;
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1796 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1797 }
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1798 #endif // !PRODUCT
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1799
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1800 bool G1CollectorPolicy::next_gc_should_be_mixed(const char* true_action_str,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1801 const char* false_action_str) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1802 CollectionSetChooser* cset_chooser = _collectionSetChooser;
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1803 if (cset_chooser->is_empty()) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1804 ergo_verbose0(ErgoMixedGCs,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1805 false_action_str,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1806 ergo_format_reason("candidate old regions not available"));
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1807 return false;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1808 }
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1809 size_t reclaimable_bytes = cset_chooser->remaining_reclaimable_bytes();
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1810 size_t capacity_bytes = _g1->capacity();
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1811 double perc = (double) reclaimable_bytes * 100.0 / (double) capacity_bytes;
5964 21595f05bc93 7146246: G1: expose some of the -XX flags that drive which old regions to collect during mixed GCs tonyp parents: 4912 diff changeset	1812 double threshold = (double) G1HeapWastePercent;
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1813 if (perc < threshold) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1814 ergo_verbose4(ErgoMixedGCs,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1815 false_action_str,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1816 ergo_format_reason("reclaimable percentage lower than threshold")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1817 ergo_format_region("candidate old regions")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1818 ergo_format_byte_perc("reclaimable")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1819 ergo_format_perc("threshold"),
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1820 cset_chooser->remaining_regions(),
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1821 reclaimable_bytes, perc, threshold);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1822 return false;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1823 }
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1824
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1825 ergo_verbose4(ErgoMixedGCs,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1826 true_action_str,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1827 ergo_format_reason("candidate old regions available")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1828 ergo_format_region("candidate old regions")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1829 ergo_format_byte_perc("reclaimable")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1830 ergo_format_perc("threshold"),
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1831 cset_chooser->remaining_regions(),
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1832 reclaimable_bytes, perc, threshold);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1833 return true;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1834 }
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1835
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1836 void G1CollectorPolicy::finalize_cset(double target_pause_time_ms) {
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1837 double young_start_time_sec = os::elapsedTime();
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	1838
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1839 YoungList* young_list = _g1->young_list();
4727 67fdcb391461 7119027: G1: use atomics to update RS length / predict time of inc CSet tonyp parents: 4710 diff changeset	1840 finalize_incremental_cset_building();
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1841
1656 4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1842 guarantee(target_pause_time_ms > 0.0,
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1843 err_msg("target_pause_time_ms = %1.6lf should be positive",
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1844 target_pause_time_ms));
4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1845 guarantee(_collection_set == NULL, "Precondition");
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1846
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1847 double base_time_ms = predict_base_elapsed_time_ms(_pending_cards);
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1848 double predicted_pause_time_ms = base_time_ms;
1656 4e5661ba9d98 6944166: G1: explicit GCs are not always handled correctly tonyp parents: 1611 diff changeset	1849 double time_remaining_ms = target_pause_time_ms - base_time_ms;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1850
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1851 ergo_verbose4(ErgoCSetConstruction \| ErgoHigh,
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1852 "start choosing CSet",
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1853 ergo_format_size("_pending_cards")
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1854 ergo_format_ms("predicted base time")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1855 ergo_format_ms("remaining time")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1856 ergo_format_ms("target pause time"),
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1857 _pending_cards, base_time_ms, time_remaining_ms, target_pause_time_ms);
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1858
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1859 _last_gc_was_young = gcs_are_young() ? true : false;
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1860
41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1861 if (_last_gc_was_young) {
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	1862 _trace_gen0_time_data.increment_young_collection_count();
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1863 } else {
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	1864 _trace_gen0_time_data.increment_mixed_collection_count();
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1865 }
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1866
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1867 // The young list is laid with the survivor regions from the previous
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1868 // pause are appended to the RHS of the young list, i.e.
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1869 // [Newly Young Regions ++ Survivors from last pause].
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1870
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1871 uint survivor_region_length = young_list->survivor_length();
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1872 uint eden_region_length = young_list->length() - survivor_region_length;
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1873 init_cset_region_lengths(eden_region_length, survivor_region_length);
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1874
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1875 HeapRegion* hr = young_list->first_survivor_region();
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1876 while (hr != NULL) {
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1877 assert(hr->is_survivor(), "badly formed young list");
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1878 hr->set_young();
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1879 hr = hr->get_next_young_region();
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1880 }
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1881
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1882 // Clear the fields that point to the survivor list - they are all young now.
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1883 young_list->clear_survivors();
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1884
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1885 _collection_set = _inc_cset_head;
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1886 _collection_set_bytes_used_before = _inc_cset_bytes_used_before;
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1887 time_remaining_ms -= _inc_cset_predicted_elapsed_time_ms;
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1888 predicted_pause_time_ms += _inc_cset_predicted_elapsed_time_ms;
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1889
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1890 ergo_verbose3(ErgoCSetConstruction \| ErgoHigh,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1891 "add young regions to CSet",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1892 ergo_format_region("eden")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1893 ergo_format_region("survivors")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1894 ergo_format_ms("predicted young region time"),
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	1895 eden_region_length, survivor_region_length,
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1896 _inc_cset_predicted_elapsed_time_ms);
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1897
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1898 // The number of recorded young regions is the incremental
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1899 // collection set's current size
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1900 set_recorded_rs_lengths(_inc_cset_recorded_rs_lengths);
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1901
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1902 double young_end_time_sec = os::elapsedTime();
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	1903 phase_times()->_recorded_young_cset_choice_time_ms =
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1904 (young_end_time_sec - young_start_time_sec) * 1000.0;
ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1905
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1906 // Set the start of the non-young choice time.
7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1907 double non_young_start_time_sec = young_end_time_sec;
3867 ff53346271fe 6814390: G1: remove the concept of non-generational G1 brutisso parents: 3830 diff changeset	1908
4710 41406797186b 7113012: G1: rename not-fully-young GCs as "mixed" tonyp parents: 4130 diff changeset	1909 if (!gcs_are_young()) {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1910 CollectionSetChooser* cset_chooser = _collectionSetChooser;
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1911 cset_chooser->verify();
f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1912 const uint min_old_cset_length = cset_chooser->calc_min_old_cset_length();
f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	1913 const uint max_old_cset_length = cset_chooser->calc_max_old_cset_length();
6010 720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1914
720b6a76dd9d 7157073: G1: type change size_t -> uint for region counts / indexes tonyp parents: 6007 diff changeset	1915 uint expensive_region_num = 0;
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1916 bool check_time_remaining = adaptive_young_list_length();
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1917
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1918 HeapRegion* hr = cset_chooser->peek();
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1919 while (hr != NULL) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1920 if (old_cset_region_length() >= max_old_cset_length) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1921 // Added maximum number of old regions to the CSet.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1922 ergo_verbose2(ErgoCSetConstruction,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1923 "finish adding old regions to CSet",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1924 ergo_format_reason("old CSet region num reached max")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1925 ergo_format_region("old")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1926 ergo_format_region("max"),
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1927 old_cset_region_length(), max_old_cset_length);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1928 break;
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	1929 }
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1930
6611 7383557659bd 7185699: G1: Prediction model discrepancies johnc parents: 6254 diff changeset	1931 double predicted_time_ms = predict_region_elapsed_time_ms(hr, gcs_are_young());
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1932 if (check_time_remaining) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1933 if (predicted_time_ms > time_remaining_ms) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1934 // Too expensive for the current CSet.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1935
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1936 if (old_cset_region_length() >= min_old_cset_length) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1937 // We have added the minimum number of old regions to the CSet,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1938 // we are done with this CSet.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1939 ergo_verbose4(ErgoCSetConstruction,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1940 "finish adding old regions to CSet",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1941 ergo_format_reason("predicted time is too high")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1942 ergo_format_ms("predicted time")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1943 ergo_format_ms("remaining time")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1944 ergo_format_region("old")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1945 ergo_format_region("min"),
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1946 predicted_time_ms, time_remaining_ms,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1947 old_cset_region_length(), min_old_cset_length);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1948 break;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1949 }
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1950
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1951 // We'll add it anyway given that we haven't reached the
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1952 // minimum number of old regions.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1953 expensive_region_num += 1;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1954 }
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1955 } else {
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1956 if (old_cset_region_length() >= min_old_cset_length) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1957 // In the non-auto-tuning case, we'll finish adding regions
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1958 // to the CSet if we reach the minimum.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1959 ergo_verbose2(ErgoCSetConstruction,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1960 "finish adding old regions to CSet",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1961 ergo_format_reason("old CSet region num reached min")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1962 ergo_format_region("old")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1963 ergo_format_region("min"),
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1964 old_cset_region_length(), min_old_cset_length);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1965 break;
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1966 }
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1967 }
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1968
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1969 // We will add this region to the CSet.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1970 time_remaining_ms -= predicted_time_ms;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1971 predicted_pause_time_ms += predicted_time_ms;
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1972 cset_chooser->remove_and_move_to_next(hr);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1973 _g1->old_set_remove(hr);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1974 add_old_region_to_cset(hr);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1975
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1976 hr = cset_chooser->peek();
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1977 }
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1978 if (hr == NULL) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1979 ergo_verbose0(ErgoCSetConstruction,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1980 "finish adding old regions to CSet",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1981 ergo_format_reason("candidate old regions not available"));
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1982 }
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	1983
4912 a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1984 if (expensive_region_num > 0) {
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1985 // We print the information once here at the end, predicated on
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1986 // whether we added any apparently expensive regions or not, to
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1987 // avoid generating output per region.
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1988 ergo_verbose4(ErgoCSetConstruction,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1989 "added expensive regions to CSet",
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1990 ergo_format_reason("old CSet region num not reached min")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1991 ergo_format_region("old")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1992 ergo_format_region("expensive")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1993 ergo_format_region("min")
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1994 ergo_format_ms("remaining time"),
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1995 old_cset_region_length(),
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1996 expensive_region_num,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1997 min_old_cset_length,
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1998 time_remaining_ms);
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	1999 }
a9647476d1a4 7132029: G1: mixed GC phase lasts for longer than it should tonyp parents: 4837 diff changeset	2000
6011 f7a8920427a6 7145441: G1: collection set chooser-related cleanup tonyp parents: 6010 diff changeset	2001 cset_chooser->verify();
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	2002 }
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	2003
1394 1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	2004 stop_incremental_cset_building();
1316cec51b4d 6819061: G1: eliminate serial Other times that are proportional to the collection set length johnc parents: 1391 diff changeset	2005
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2006 ergo_verbose5(ErgoCSetConstruction,
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2007 "finish choosing CSet",
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2008 ergo_format_region("eden")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2009 ergo_format_region("survivors")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2010 ergo_format_region("old")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2011 ergo_format_ms("predicted pause time")
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2012 ergo_format_ms("target pause time"),
4090 a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	2013 eden_region_length, survivor_region_length,
a88de71c4e3a 7097002: G1: remove a lot of unused / redundant code from the G1CollectorPolicy class tonyp parents: 4072 diff changeset	2014 old_cset_region_length(),
3914 20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2015 predicted_pause_time_ms, target_pause_time_ms);
20213c8a3c40 7050392: G1: Introduce flag to generate a log of the G1 ergonomic decisions tonyp parents: 3868 diff changeset	2016
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	2017 double non_young_end_time_sec = os::elapsedTime();
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2018 phase_times()->_recorded_non_young_cset_choice_time_ms =
342 37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	2019 (non_young_end_time_sec - non_young_start_time_sec) * 1000.0;
37f87013dfd8 6711316: Open source the Garbage-First garbage collector ysr parents: diff changeset	2020 }
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2021
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2022 void TraceGen0TimeData::record_start_collection(double time_to_stop_the_world_ms) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2023 if(TraceGen0Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2024 _all_stop_world_times_ms.add(time_to_stop_the_world_ms);
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2025 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2026 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2027
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2028 void TraceGen0TimeData::record_yield_time(double yield_time_ms) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2029 if(TraceGen0Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2030 _all_yield_times_ms.add(yield_time_ms);
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2031 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2032 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2033
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2034 void TraceGen0TimeData::record_end_collection(double pause_time_ms, G1GCPhaseTimes* phase_times) {
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2035 if(TraceGen0Time) {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2036 _total.add(pause_time_ms);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2037 _other.add(pause_time_ms - phase_times->accounted_time_ms());
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2038 _root_region_scan_wait.add(phase_times->_root_region_scan_wait_time_ms);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2039 _parallel.add(phase_times->_cur_collection_par_time_ms);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2040 _ext_root_scan.add(phase_times->_ext_root_scan_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2041 _satb_filtering.add(phase_times->_satb_filtering_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2042 _update_rs.add(phase_times->_update_rs_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2043 _scan_rs.add(phase_times->_scan_rs_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2044 _obj_copy.add(phase_times->_obj_copy_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2045 _termination.add(phase_times->_termination_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2046
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2047 double parallel_known_time = phase_times->_ext_root_scan_time +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2048 phase_times->_satb_filtering_time +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2049 phase_times->_update_rs_time +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2050 phase_times->_scan_rs_time +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2051 phase_times->_obj_copy_time +
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2052 + phase_times->_termination_time;
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2053
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2054 double parallel_other_time = phase_times->_cur_collection_par_time_ms - parallel_known_time;
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2055 _parallel_other.add(parallel_other_time);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2056 _clear_ct.add(phase_times->_cur_clear_ct_time_ms);
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2057 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2058 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2059
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2060 void TraceGen0TimeData::increment_young_collection_count() {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2061 if(TraceGen0Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2062 ++_young_pause_num;
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2063 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2064 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2065
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2066 void TraceGen0TimeData::increment_mixed_collection_count() {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2067 if(TraceGen0Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2068 ++_mixed_pause_num;
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2069 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2070 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2071
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2072 void TraceGen0TimeData::print_summary(const char* str,
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2073 const NumberSeq* seq) const {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2074 double sum = seq->sum();
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2075 gclog_or_tty->print_cr("%-27s = %8.2lf s (avg = %8.2lf ms)",
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2076 str, sum / 1000.0, seq->avg());
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2077 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2078
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2079 void TraceGen0TimeData::print_summary_sd(const char* str,
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2080 const NumberSeq* seq) const {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2081 print_summary(str, seq);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2082 gclog_or_tty->print_cr("%+45s = %5d, std dev = %8.2lf ms, max = %8.2lf ms)",
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2083 "(num", seq->num(), seq->sd(), seq->maximum());
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2084 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2085
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2086 void TraceGen0TimeData::print() const {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2087 if (!TraceGen0Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2088 return;
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2089 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2090
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2091 gclog_or_tty->print_cr("ALL PAUSES");
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2092 print_summary_sd(" Total", &_total);
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2093 gclog_or_tty->print_cr("");
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2094 gclog_or_tty->print_cr("");
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2095 gclog_or_tty->print_cr(" Young GC Pauses: %8d", _young_pause_num);
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2096 gclog_or_tty->print_cr(" Mixed GC Pauses: %8d", _mixed_pause_num);
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2097 gclog_or_tty->print_cr("");
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2098
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2099 gclog_or_tty->print_cr("EVACUATION PAUSES");
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2100
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2101 if (_young_pause_num == 0 && _mixed_pause_num == 0) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2102 gclog_or_tty->print_cr("none");
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2103 } else {
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2104 print_summary_sd(" Evacuation Pauses", &_total);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2105 print_summary(" Root Region Scan Wait", &_root_region_scan_wait);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2106 print_summary(" Parallel Time", &_parallel);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2107 print_summary(" Ext Root Scanning", &_ext_root_scan);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2108 print_summary(" SATB Filtering", &_satb_filtering);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2109 print_summary(" Update RS", &_update_rs);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2110 print_summary(" Scan RS", &_scan_rs);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2111 print_summary(" Object Copy", &_obj_copy);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2112 print_summary(" Termination", &_termination);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2113 print_summary(" Parallel Other", &_parallel_other);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2114 print_summary(" Clear CT", &_clear_ct);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2115 print_summary(" Other", &_other);
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2116 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2117 gclog_or_tty->print_cr("");
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2118
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2119 gclog_or_tty->print_cr("MISC");
6219 922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2120 print_summary_sd(" Stop World", &_all_stop_world_times_ms);
922993931b3d 7178361: G1: Make sure that PrintGC and PrintGCDetails use the same timing for the GC pause brutisso parents: 6109 diff changeset	2121 print_summary_sd(" Yields", &_all_yield_times_ms);
6109 bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2122 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2123
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2124 void TraceGen1TimeData::record_full_collection(double full_gc_time_ms) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2125 if (TraceGen1Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2126 _all_full_gc_times.add(full_gc_time_ms);
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2127 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2128 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2129
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2130 void TraceGen1TimeData::print() const {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2131 if (!TraceGen1Time) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2132 return;
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2133 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2134
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2135 if (_all_full_gc_times.num() > 0) {
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2136 gclog_or_tty->print("\n%4d full_gcs: total time = %8.2f s",
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2137 _all_full_gc_times.num(),
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2138 _all_full_gc_times.sum() / 1000.0);
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2139 gclog_or_tty->print_cr(" (avg = %8.2fms).", _all_full_gc_times.avg());
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2140 gclog_or_tty->print_cr(" [std. dev = %8.2f ms, max = %8.2f ms]",
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2141 _all_full_gc_times.sd(),
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2142 _all_full_gc_times.maximum());
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2143 }
bbc900c2482a 7172279: G1: Clean up TraceGen0Time and TraceGen1Time data gathering brutisso parents: 6064 diff changeset	2144 }

Mercurial > hg > truffle

annotate src/share/vm/gc_implementation/g1/g1CollectorPolicy.cpp @ 6611:7383557659bd