truffle: graal/com.oracle.graal.phases.common/src/com/oracle/graal/phases/common/InliningUtil.java annotate

annotate graal/com.oracle.graal.phases.common/src/com/oracle/graal/phases/common/InliningUtil.java @ 9864:063a712fe8d8

converted remaining options in GraalOptions to new system (GRAAL-27)

author	Doug Simon <doug.simon@oracle.com>
date	Tue, 04 Jun 2013 17:33:14 +0200
parents	59d799c965c9
children	5ba11d51fe80

rev	line source
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1 /*
4233 fa53d5e4aa35 Remove lock information from frame states, and compute it instead when LIR is generated. Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4205 diff changeset	2 * Copyright (c) 2012, Oracle and/or its affiliates. All rights reserved.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	4 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	7 * published by the Free Software Foundation.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	8 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	13 * accompanied this code).
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	14 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	18 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	21 * questions.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	22 */
6526 ee651c726397 split phases out of graal.phases project into graal.phases.common project Doug Simon <doug.simon@oracle.com> parents: 6525 diff changeset	23 package com.oracle.graal.phases.common;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	24
9864 063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	25 import static com.oracle.graal.phases.GraalOptions.*;
063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	26
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	27 import java.lang.reflect.*;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	28 import java.util.*;
4363 7462c3600c3a Draft changes to the graph plotting. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 4312 diff changeset	29 import java.util.concurrent.*;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	30
5510 426c605c9d3c Move cri.ci to api.code. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5507 diff changeset	31 import com.oracle.graal.api.code.*;
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	32 import com.oracle.graal.api.code.Assumptions.Assumption;
5507 dc71b06d09f8 Moving classes from cri.ri to api.meta. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5506 diff changeset	33 import com.oracle.graal.api.meta.*;
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	34 import com.oracle.graal.api.meta.JavaTypeProfile.ProfiledType;
6539 2463eb24b644 Cleanup of Graal API: Rename methods so that it follows the getXxx naming convention and so that they are similar to the names of the java.lang.reflect classes. Remove unused methods. Christian Wimmer <christian.wimmer@oracle.com> parents: 6526 diff changeset	35 import com.oracle.graal.api.meta.ResolvedJavaType.Representation;
5060 4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	36 import com.oracle.graal.debug.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	37 import com.oracle.graal.graph.*;
9684 35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	38 import com.oracle.graal.graph.Node.*;
5060 4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	39 import com.oracle.graal.nodes.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	40 import com.oracle.graal.nodes.calc.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	41 import com.oracle.graal.nodes.extended.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	42 import com.oracle.graal.nodes.java.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	43 import com.oracle.graal.nodes.java.MethodCallTargetNode.InvokeKind;
8637 ce5750014c3d moved Replacements and MacroSubstitution from the graal.api.replacements project to graal.nodes project and reversed the dependency between these two projects (the latter now/again depends on the former) Doug Simon <doug.simon@oracle.com> parents: 8636 diff changeset	44 import com.oracle.graal.nodes.spi.*;
5339 e8f80481326d use PiNodes instead of CheckCastNodes to pin inlining receivers, remove emitCode flag Lukas Stadler <lukas.stadler@jku.at> parents: 5316 diff changeset	45 import com.oracle.graal.nodes.type.*;
5060 4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	46 import com.oracle.graal.nodes.util.*;
6525 2c913b643422 rename packages in graal.phases to match project name Doug Simon <doug.simon@oracle.com> parents: 6522 diff changeset	47 import com.oracle.graal.phases.*;
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	48 import com.oracle.graal.phases.common.InliningPhase.InliningData;
9329 fa188fbfe3fe Perform only targeted canonicalization after tail duplication. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9310 diff changeset	49 import com.oracle.graal.phases.tiers.*;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	50
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	51 public class InliningUtil {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	52
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	53 private static final DebugMetric metricInliningTailDuplication = Debug.metric("InliningTailDuplication");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	54 private static final String inliningDecisionsScopeString = "InliningDecisions";
7558 223f645acb9b added compilation rate measurements on top of existing metric/timer facility - enabled with -Dgraal.benchmark.compilation=true Doug Simon <doug.simon@oracle.com> parents: 7540 diff changeset	55 /**
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	56 * Meters the size (in bytecodes) of all methods processed during compilation (i.e., top level
0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	57 * and all inlined methods), irrespective of how many bytecodes in each method are actually
0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	58 * parsed (which may be none for methods whose IR is retrieved from a cache).
7558 223f645acb9b added compilation rate measurements on top of existing metric/timer facility - enabled with -Dgraal.benchmark.compilation=true Doug Simon <doug.simon@oracle.com> parents: 7540 diff changeset	59 */
223f645acb9b added compilation rate measurements on top of existing metric/timer facility - enabled with -Dgraal.benchmark.compilation=true Doug Simon <doug.simon@oracle.com> parents: 7540 diff changeset	60 public static final DebugMetric InlinedBytecodes = Debug.metric("InlinedBytecodes");
223f645acb9b added compilation rate measurements on top of existing metric/timer facility - enabled with -Dgraal.benchmark.compilation=true Doug Simon <doug.simon@oracle.com> parents: 7540 diff changeset	61
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	62 public interface InliningPolicy {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	63
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	64 boolean continueInlining(StructuredGraph graph);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	65
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	66 boolean isWorthInlining(InlineInfo info, int inliningDepth, double probability, double relevance, boolean fullyProcessed);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	67 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	68
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	69 public static class InlineableMacroNode implements InlineableElement {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	70
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	71 private final Class<? extends FixedWithNextNode> macroNodeClass;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	72
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	73 public InlineableMacroNode(Class<? extends FixedWithNextNode> macroNodeClass) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	74 this.macroNodeClass = macroNodeClass;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	75 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	76
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	77 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	78 public int getNodeCount() {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	79 return 1;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	80 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	81
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	82 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	83 public Iterable<Invoke> getInvokes() {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	84 return Collections.emptyList();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	85 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	86
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	87 public Class<? extends FixedWithNextNode> getMacroNodeClass() {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	88 return macroNodeClass;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	89 }
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	90 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	91
8996 6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	92 /**
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	93 * Print a HotSpot-style inlining message to the console.
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	94 */
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	95 private static void printInlining(final InlineInfo info, final int inliningDepth, final boolean success, final String msg, final Object... args) {
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	96 printInlining(info.methodAt(0), info.invoke(), inliningDepth, success, msg, args);
8996 6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	97 }
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	98
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	99 /**
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	100 * Print a HotSpot-style inlining message to the console.
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	101 */
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	102 private static void printInlining(final ResolvedJavaMethod method, final Invoke invoke, final int inliningDepth, final boolean success, final String msg, final Object... args) {
9864 063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	103 if (HotSpotPrintInlining.getValue()) {
8996 6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	104 final int mod = method.getModifiers();
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	105 // 1234567
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	106 TTY.print(" "); // print timestamp
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	107 // 1234
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	108 TTY.print(" "); // print compilation number
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	109 // % s ! b n
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	110 TTY.print("%c%c%c%c%c ", ' ', Modifier.isSynchronized(mod) ? 's' : ' ', ' ', ' ', Modifier.isNative(mod) ? 'n' : ' ');
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	111 TTY.print(" "); // more indent
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	112 TTY.print(" "); // initial inlining indent
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	113 for (int i = 0; i < inliningDepth; i++) {
8996 6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	114 TTY.print(" ");
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	115 }
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	116 TTY.println(String.format("@ %d %s %s%s", invoke.bci(), methodName(method, null), success ? "" : "not inlining ", String.format(msg, args)));
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	117 }
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	118 }
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	119
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	120 public static boolean logInlinedMethod(InlineInfo info, int inliningDepth, boolean allowLogging, String msg, Object... args) {
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	121 return logInliningDecision(info, inliningDepth, allowLogging, true, msg, args);
8996 6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	122 }
6d86ce1297bc GRAAL-213: add HotSpot-style PrintCompilation and PrintInlining twisti parents: 8649 diff changeset	123
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	124 public static boolean logNotInlinedMethod(InlineInfo info, int inliningDepth, String msg, Object... args) {
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	125 return logInliningDecision(info, inliningDepth, true, false, msg, args);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	126 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	127
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	128 public static boolean logInliningDecision(InlineInfo info, int inliningDepth, boolean allowLogging, boolean success, String msg, final Object... args) {
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	129 if (allowLogging) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	130 printInlining(info, inliningDepth, success, msg, args);
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	131 if (shouldLogInliningDecision()) {
e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	132 logInliningDecision(methodName(info), success, msg, args);
e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	133 }
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	134 }
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	135 return success;
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	136 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	137
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	138 public static void logInliningDecision(final String msg, final Object... args) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	139 Debug.scope(inliningDecisionsScopeString, new Runnable() {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	140
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	141 public void run() {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	142 Debug.log(msg, args);
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	143 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	144 });
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	145 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	146
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	147 private static boolean logNotInlinedMethod(Invoke invoke, String msg) {
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	148 if (shouldLogInliningDecision()) {
7391 36dafe48bc38 added relevance-based inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7388 diff changeset	149 String methodString = invoke.toString() + (invoke.callTarget() == null ? " callTarget=null" : invoke.callTarget().targetName());
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	150 logInliningDecision(methodString, false, msg, new Object[0]);
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	151 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	152 return false;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	153 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	154
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	155 private static InlineInfo logNotInlinedMethodAndReturnNull(Invoke invoke, int inliningDepth, ResolvedJavaMethod method, String msg) {
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	156 return logNotInlinedMethodAndReturnNull(invoke, inliningDepth, method, msg, new Object[0]);
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	157 }
ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	158
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	159 private static InlineInfo logNotInlinedMethodAndReturnNull(Invoke invoke, int inliningDepth, ResolvedJavaMethod method, String msg, Object... args) {
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	160 printInlining(method, invoke, inliningDepth, false, msg, args);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	161 if (shouldLogInliningDecision()) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	162 String methodString = methodName(method, invoke);
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	163 logInliningDecision(methodString, false, msg, args);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	164 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	165 return null;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	166 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	167
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	168 private static boolean logNotInlinedMethodAndReturnFalse(Invoke invoke, int inliningDepth, ResolvedJavaMethod method, String msg) {
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	169 printInlining(method, invoke, inliningDepth, false, msg, new Object[0]);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	170 if (shouldLogInliningDecision()) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	171 String methodString = methodName(method, invoke);
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	172 logInliningDecision(methodString, false, msg, new Object[0]);
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	173 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	174 return false;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	175 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	176
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	177 private static void logInliningDecision(final String methodString, final boolean success, final String msg, final Object... args) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	178 String inliningMsg = "inlining " + methodString + ": " + msg;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	179 if (!success) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	180 inliningMsg = "not " + inliningMsg;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	181 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	182 logInliningDecision(inliningMsg, args);
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	183 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	184
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	185 public static boolean shouldLogInliningDecision() {
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	186 return Debug.scope(inliningDecisionsScopeString, new Callable<Boolean>() {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	187
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	188 public Boolean call() {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	189 return Debug.isLogEnabled();
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	190 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	191 });
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	192 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	193
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	194 private static String methodName(ResolvedJavaMethod method, Invoke invoke) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	195 if (invoke != null && invoke.stateAfter() != null) {
6539 2463eb24b644 Cleanup of Graal API: Rename methods so that it follows the getXxx naming convention and so that they are similar to the names of the java.lang.reflect classes. Remove unused methods. Christian Wimmer <christian.wimmer@oracle.com> parents: 6526 diff changeset	196 return methodName(invoke.stateAfter(), invoke.bci()) + ": " + MetaUtil.format("%H.%n(%p):%r", method) + " (" + method.getCodeSize() + " bytes)";
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	197 } else {
6539 2463eb24b644 Cleanup of Graal API: Rename methods so that it follows the getXxx naming convention and so that they are similar to the names of the java.lang.reflect classes. Remove unused methods. Christian Wimmer <christian.wimmer@oracle.com> parents: 6526 diff changeset	198 return MetaUtil.format("%H.%n(%p):%r", method) + " (" + method.getCodeSize() + " bytes)";
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	199 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	200 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	201
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	202 private static String methodName(InlineInfo info) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	203 if (info == null) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	204 return "null";
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	205 } else if (info.invoke() != null && info.invoke().stateAfter() != null) {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	206 return methodName(info.invoke().stateAfter(), info.invoke().bci()) + ": " + info.toString();
5316 8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	207 } else {
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	208 return info.toString();
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	209 }
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	210 }
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	211
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	212 private static String methodName(FrameState frameState, int bci) {
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	213 StringBuilder sb = new StringBuilder();
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	214 if (frameState.outerFrameState() != null) {
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	215 sb.append(methodName(frameState.outerFrameState(), frameState.outerFrameState().bci));
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	216 sb.append("->");
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	217 }
5719 429accae15aa moved some methods from CodeUtil to MetaUtil Doug Simon <doug.simon@oracle.com> parents: 5718 diff changeset	218 sb.append(MetaUtil.format("%h.%n", frameState.method()));
5316 8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	219 sb.append("@").append(bci);
8ac40aed34bf Consistent output of inlining decisions. Make all inlining decisions be printable using -G:Log=InliningDecisions Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 5210 diff changeset	220 return sb.toString();
5127 7b2efb5ff2ea better inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5114 diff changeset	221 }
7b2efb5ff2ea better inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5114 diff changeset	222
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	223 /**
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	224 * Represents an opportunity for inlining at the given invoke, with the given weight and level.
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	225 * The weight is the amortized weight of the additional code - so smaller is better. The level
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	226 * is the number of nested inlinings that lead to this invoke.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	227 */
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	228 public interface InlineInfo {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	229
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	230 StructuredGraph graph();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	231
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	232 Invoke invoke();
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	233
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	234 /**
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	235 * Returns the number of invoked methods.
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	236 */
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	237 int numberOfMethods();
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	238
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	239 ResolvedJavaMethod methodAt(int index);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	240
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	241 InlineableElement inlineableElementAt(int index);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	242
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	243 double probabilityAt(int index);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	244
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	245 double relevanceAt(int index);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	246
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	247 void setInlinableElement(int index, InlineableElement inlineableElement);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	248
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	249 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	250 * Performs the inlining described by this object and returns the node that represents the
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	251 * return value of the inlined method (or null for void methods and methods that have no
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	252 * non-exceptional exit).
7685 7d66682cc901 Merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 7684 7558 diff changeset	253 **/
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	254 void inline(MetaAccessProvider runtime, Assumptions assumptions, Replacements replacements);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	255
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	256 /**
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	257 * Try to make the call static bindable to avoid interface and virtual method calls.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	258 */
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	259 void tryToDevirtualizeInvoke(MetaAccessProvider runtime, Assumptions assumptions);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	260 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	261
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	262 public abstract static class AbstractInlineInfo implements InlineInfo {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	263
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	264 protected final Invoke invoke;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	265
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	266 public AbstractInlineInfo(Invoke invoke) {
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	267 this.invoke = invoke;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	268 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	269
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	270 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	271 public StructuredGraph graph() {
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	272 return invoke.asNode().graph();
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	273 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	274
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	275 @Override
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	276 public Invoke invoke() {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	277 return invoke;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	278 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	279
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	280 protected static void inline(Invoke invoke, ResolvedJavaMethod concrete, InlineableElement inlineable, Assumptions assumptions, boolean receiverNullCheck) {
9704 f9a65a0e626b Merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9701 9610 diff changeset	281 StructuredGraph graph = invoke.asNode().graph();
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	282 if (inlineable instanceof StructuredGraph) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	283 StructuredGraph calleeGraph = (StructuredGraph) inlineable;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	284 InliningUtil.inline(invoke, calleeGraph, receiverNullCheck);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	285
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	286 graph.getLeafGraphIds().add(calleeGraph.graphId());
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	287 // we might at some point cache already-inlined graphs, so add recursively:
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	288 graph.getLeafGraphIds().addAll(calleeGraph.getLeafGraphIds());
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	289 } else {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	290 assert inlineable instanceof InlineableMacroNode;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	291
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	292 Class<? extends FixedWithNextNode> macroNodeClass = ((InlineableMacroNode) inlineable).getMacroNodeClass();
9310 b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	293 if (((MethodCallTargetNode) invoke.callTarget()).targetMethod() != concrete) {
b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	294 assert ((MethodCallTargetNode) invoke.callTarget()).invokeKind() != InvokeKind.Static;
b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	295 InliningUtil.replaceInvokeCallTarget(invoke, graph, InvokeKind.Special, concrete);
b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	296 }
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	297
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	298 FixedWithNextNode macroNode;
225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	299 try {
7534 417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	300 macroNode = macroNodeClass.getConstructor(Invoke.class).newInstance(invoke);
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	301 } catch (ReflectiveOperationException \| IllegalArgumentException \| SecurityException e) {
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	302 throw new GraalInternalError(e).addContext(invoke.asNode()).addContext("macroSubstitution", macroNodeClass);
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	303 }
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	304
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	305 CallTargetNode callTarget = invoke.callTarget();
7534 417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	306 if (invoke instanceof InvokeNode) {
417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	307 graph.replaceFixedWithFixed((InvokeNode) invoke, graph.add(macroNode));
417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	308 } else {
417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	309 InvokeWithExceptionNode invokeWithException = (InvokeWithExceptionNode) invoke;
417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	310 invokeWithException.killExceptionEdge();
417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	311 graph.replaceSplitWithFixed(invokeWithException, graph.add(macroNode), invokeWithException.next());
417bd4ca6e4a handle InvokeWithExceptionNode when inlining macro nodes Lukas Stadler <lukas.stadler@jku.at> parents: 7510 diff changeset	312 }
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	313 GraphUtil.killWithUnusedFloatingInputs(callTarget);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	314 }
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	315
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	316 InlinedBytecodes.add(concrete.getCodeSize());
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	317 assumptions.recordMethodContents(concrete);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	318 }
9310 b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	319 }
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	320
9310 b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	321 public static void replaceInvokeCallTarget(Invoke invoke, StructuredGraph graph, InvokeKind invokeKind, ResolvedJavaMethod targetMethod) {
b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	322 MethodCallTargetNode oldCallTarget = (MethodCallTargetNode) invoke.callTarget();
b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	323 MethodCallTargetNode newCallTarget = graph.add(new MethodCallTargetNode(invokeKind, targetMethod, oldCallTarget.arguments().toArray(new ValueNode[0]), oldCallTarget.returnType()));
b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	324 invoke.asNode().replaceFirstInput(oldCallTarget, newCallTarget);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	325 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	326
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	327 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	328 * Represents an inlining opportunity where the compiler can statically determine a monomorphic
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	329 * target method and therefore is able to determine the called method exactly.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	330 */
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	331 private static class ExactInlineInfo extends AbstractInlineInfo {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	332
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	333 protected final ResolvedJavaMethod concrete;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	334 private InlineableElement inlineableElement;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	335
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	336 public ExactInlineInfo(Invoke invoke, ResolvedJavaMethod concrete) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	337 super(invoke);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	338 this.concrete = concrete;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	339 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	340
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	341 @Override
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	342 public void inline(MetaAccessProvider runtime, Assumptions assumptions, Replacements replacements) {
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	343 inline(invoke, concrete, inlineableElement, assumptions, true);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	344 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	345
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	346 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	347 public void tryToDevirtualizeInvoke(MetaAccessProvider runtime, Assumptions assumptions) {
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	348 // nothing todo, can already be bound statically
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	349 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	350
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	351 @Override
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	352 public int numberOfMethods() {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	353 return 1;
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	354 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	355
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	356 @Override
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	357 public ResolvedJavaMethod methodAt(int index) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	358 assert index == 0;
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	359 return concrete;
4528 e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	360 }
e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	361
e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	362 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	363 public double probabilityAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	364 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	365 return 1.0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	366 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	367
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	368 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	369 public double relevanceAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	370 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	371 return 1.0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	372 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	373
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	374 @Override
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	375 public String toString() {
5719 429accae15aa moved some methods from CodeUtil to MetaUtil Doug Simon <doug.simon@oracle.com> parents: 5718 diff changeset	376 return "exact " + MetaUtil.format("%H.%n(%p):%r", concrete);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	377 }
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	378
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	379 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	380 public InlineableElement inlineableElementAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	381 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	382 return inlineableElement;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	383 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	384
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	385 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	386 public void setInlinableElement(int index, InlineableElement inlineableElement) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	387 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	388 this.inlineableElement = inlineableElement;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	389 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	390 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	391
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	392 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	393 * Represents an inlining opportunity for which profiling information suggests a monomorphic
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	394 * receiver, but for which the receiver type cannot be proven. A type check guard will be
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	395 * generated if this inlining is performed.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	396 */
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	397 private static class TypeGuardInlineInfo extends AbstractInlineInfo {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	398
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	399 private final ResolvedJavaMethod concrete;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	400 private final ResolvedJavaType type;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	401 private InlineableElement inlineableElement;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	402
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	403 public TypeGuardInlineInfo(Invoke invoke, ResolvedJavaMethod concrete, ResolvedJavaType type) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	404 super(invoke);
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	405 this.concrete = concrete;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	406 this.type = type;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	407 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	408
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	409 @Override
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	410 public int numberOfMethods() {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	411 return 1;
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	412 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	413
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	414 @Override
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	415 public ResolvedJavaMethod methodAt(int index) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	416 assert index == 0;
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	417 return concrete;
4528 e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	418 }
e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	419
e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	420 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	421 public InlineableElement inlineableElementAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	422 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	423 return inlineableElement;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	424 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	425
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	426 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	427 public double probabilityAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	428 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	429 return 1.0;
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	430 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	431
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	432 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	433 public double relevanceAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	434 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	435 return 1.0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	436 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	437
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	438 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	439 public void setInlinableElement(int index, InlineableElement inlineableElement) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	440 assert index == 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	441 this.inlineableElement = inlineableElement;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	442 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	443
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	444 @Override
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	445 public void inline(MetaAccessProvider runtime, Assumptions assumptions, Replacements replacements) {
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	446 createGuard(graph(), runtime);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	447 inline(invoke, concrete, inlineableElement, assumptions, false);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	448 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	449
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	450 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	451 public void tryToDevirtualizeInvoke(MetaAccessProvider runtime, Assumptions assumptions) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	452 createGuard(graph(), runtime);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	453 replaceInvokeCallTarget(invoke, graph(), InvokeKind.Special, concrete);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	454 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	455
8608 056966f39a36 changed parameters of InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 8469 diff changeset	456 private void createGuard(StructuredGraph graph, MetaAccessProvider runtime) {
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	457 InliningUtil.receiverNullCheck(invoke);
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	458 ValueNode receiver = ((MethodCallTargetNode) invoke.callTarget()).receiver();
6457 03a1a0c5ee84 removed IsTypeNode and replaced its usage with an ObjectEqualsNode Doug Simon <doug.simon@oracle.com> parents: 6456 diff changeset	459 ConstantNode typeHub = ConstantNode.forConstant(type.getEncoding(Representation.ObjectHub), runtime, graph);
6950 41938af2b3d8 modifications to support non-perm-gen changes in HotSpot Doug Simon <doug.simon@oracle.com> parents: 6683 diff changeset	460 LoadHubNode receiverHub = graph.add(new LoadHubNode(receiver, typeHub.kind()));
41938af2b3d8 modifications to support non-perm-gen changes in HotSpot Doug Simon <doug.simon@oracle.com> parents: 6683 diff changeset	461 CompareNode typeCheck = CompareNode.createCompareNode(Condition.EQ, receiverHub, typeHub);
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	462 FixedGuardNode guard = graph.add(new FixedGuardNode(typeCheck, DeoptimizationReason.TypeCheckedInliningViolated, DeoptimizationAction.InvalidateReprofile));
5642 6c3a5ccec483 Merge AnchorNode and ValueAnchorNode Gilles Duboscq <duboscq@ssw.jku.at> parents: 5547 diff changeset	463 ValueAnchorNode anchor = graph.add(new ValueAnchorNode());
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	464 assert invoke.predecessor() != null;
4453 c0430421d43d bugfixes for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4452 diff changeset	465
6289 72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	466 ValueNode anchoredReceiver = createAnchoredReceiver(graph, anchor, type, receiver, true);
5339 e8f80481326d use PiNodes instead of CheckCastNodes to pin inlining receivers, remove emitCode flag Lukas Stadler <lukas.stadler@jku.at> parents: 5316 diff changeset	467 invoke.callTarget().replaceFirstInput(receiver, anchoredReceiver);
4622 00e01f401c03 Add checkcast for type-guarded inlining Gilles Duboscq <duboscq@ssw.jku.at> parents: 4618 diff changeset	468
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	469 graph.addBeforeFixed(invoke.asNode(), receiverHub);
5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	470 graph.addBeforeFixed(invoke.asNode(), guard);
5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	471 graph.addBeforeFixed(invoke.asNode(), anchor);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	472 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	473
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	474 @Override
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	475 public String toString() {
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	476 return "type-checked with type " + type.getName() + " and method " + MetaUtil.format("%H.%n(%p):%r", concrete);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	477 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	478 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	479
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	480 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	481 * Polymorphic inlining of m methods with n type checks (n >= m) in case that the profiling
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	482 * information suggests a reasonable amounts of different receiver types and different methods.
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	483 * If an unknown type is encountered a deoptimization is triggered.
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	484 */
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	485 private static class MultiTypeGuardInlineInfo extends AbstractInlineInfo {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	486
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	487 private final List<ResolvedJavaMethod> concretes;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	488 private final double[] methodProbabilities;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	489 private final double maximumMethodProbability;
9704 f9a65a0e626b Merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9701 9610 diff changeset	490 private final ArrayList<Integer> typesToConcretes;
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	491 private final ArrayList<ProfiledType> ptypes;
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	492 private final ArrayList<Double> concretesProbabilities;
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	493 private final double notRecordedTypeProbability;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	494 private final InlineableElement[] inlineableElements;
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	495
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	496 public MultiTypeGuardInlineInfo(Invoke invoke, ArrayList<ResolvedJavaMethod> concretes, ArrayList<Double> concretesProbabilities, ArrayList<ProfiledType> ptypes,
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	497 ArrayList<Integer> typesToConcretes, double notRecordedTypeProbability) {
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	498 super(invoke);
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	499 assert concretes.size() > 0 : "must have at least one method";
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	500 assert ptypes.size() == typesToConcretes.size() : "array lengths must match";
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	501
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	502 this.concretesProbabilities = concretesProbabilities;
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	503 this.concretes = concretes;
5335 439ca5ecc7dc types profiles are now sorted in descending order of each profiled type's probability Doug Simon <doug.simon@oracle.com> parents: 5316 diff changeset	504 this.ptypes = ptypes;
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	505 this.typesToConcretes = typesToConcretes;
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	506 this.notRecordedTypeProbability = notRecordedTypeProbability;
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	507 this.inlineableElements = new InlineableElement[concretes.size()];
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	508 this.methodProbabilities = computeMethodProbabilities();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	509 this.maximumMethodProbability = maximumMethodProbability();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	510 assert maximumMethodProbability > 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	511 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	512
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	513 private double[] computeMethodProbabilities() {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	514 double[] result = new double[concretes.size()];
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	515 for (int i = 0; i < typesToConcretes.size(); i++) {
de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	516 int concrete = typesToConcretes.get(i);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	517 double probability = ptypes.get(i).getProbability();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	518 result[concrete] += probability;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	519 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	520 return result;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	521 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	522
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	523 private double maximumMethodProbability() {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	524 double max = 0;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	525 for (int i = 0; i < methodProbabilities.length; i++) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	526 max = Math.max(max, methodProbabilities[i]);
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	527 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	528 return max;
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	529 }
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	530
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	531 @Override
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	532 public int numberOfMethods() {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	533 return concretes.size();
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	534 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	535
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	536 @Override
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	537 public ResolvedJavaMethod methodAt(int index) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	538 assert index >= 0 && index < concretes.size();
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	539 return concretes.get(index);
4528 e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	540 }
e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	541
e6e14d25e608 added two inlining policies for comparison Christian Haeubl <christian.haeubl@oracle.com> parents: 4473 diff changeset	542 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	543 public InlineableElement inlineableElementAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	544 assert index >= 0 && index < concretes.size();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	545 return inlineableElements[index];
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	546 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	547
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	548 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	549 public double probabilityAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	550 return methodProbabilities[index];
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	551 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	552
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	553 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	554 public double relevanceAt(int index) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	555 return probabilityAt(index) / maximumMethodProbability;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	556 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	557
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	558 @Override
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	559 public void setInlinableElement(int index, InlineableElement inlineableElement) {
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	560 assert index >= 0 && index < concretes.size();
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	561 inlineableElements[index] = inlineableElement;
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	562 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	563
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	564 @Override
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	565 public void inline(MetaAccessProvider runtime, Assumptions assumptions, Replacements replacements) {
4452 b225da954a32 inlining of multiple trival methods at one call site works Christian Haeubl <christian.haeubl@oracle.com> parents: 4451 diff changeset	566 // receiver null check must be the first node
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	567 InliningUtil.receiverNullCheck(invoke);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	568 if (hasSingleMethod()) {
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	569 inlineSingleMethod(graph(), runtime, assumptions);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	570 } else {
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	571 inlineMultipleMethods(graph(), runtime, assumptions, replacements);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	572 }
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	573 }
63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	574
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	575 private boolean hasSingleMethod() {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	576 return concretes.size() == 1 && !shouldFallbackToInvoke();
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	577 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	578
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	579 private boolean shouldFallbackToInvoke() {
63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	580 return notRecordedTypeProbability > 0;
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	581 }
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	582
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	583 private void inlineMultipleMethods(StructuredGraph graph, MetaAccessProvider runtime, Assumptions assumptions, Replacements replacements) {
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	584 int numberOfMethods = concretes.size();
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	585 FixedNode continuation = invoke.next();
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	586
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	587 ValueNode originalReceiver = ((MethodCallTargetNode) invoke.callTarget()).receiver();
4456 f4c82dd4619e inlining bugfixes and cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4455 diff changeset	588 // setup merge and phi nodes for results and exceptions
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	589 MergeNode returnMerge = graph.add(new MergeNode());
4622 00e01f401c03 Add checkcast for type-guarded inlining Gilles Duboscq <duboscq@ssw.jku.at> parents: 4618 diff changeset	590 returnMerge.setStateAfter(invoke.stateAfter().duplicate(invoke.stateAfter().bci));
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	591
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	592 PhiNode returnValuePhi = null;
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	593 if (invoke.asNode().kind() != Kind.Void) {
5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	594 returnValuePhi = graph.unique(new PhiNode(invoke.asNode().kind(), returnMerge));
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	595 }
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	596
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	597 MergeNode exceptionMerge = null;
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	598 PhiNode exceptionObjectPhi = null;
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	599 if (invoke instanceof InvokeWithExceptionNode) {
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	600 InvokeWithExceptionNode invokeWithException = (InvokeWithExceptionNode) invoke;
8461 6a8ad083746e The exception edge for invokes should still be a DispatchBeginNode to allow lowering of ExceptionObjectNode after guard lowering Gilles Duboscq <duboscq@ssw.jku.at> parents: 8441 diff changeset	601 ExceptionObjectNode exceptionEdge = (ExceptionObjectNode) invokeWithException.exceptionEdge();
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	602
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	603 exceptionMerge = graph.add(new MergeNode());
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	604
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	605 FixedNode exceptionSux = exceptionEdge.next();
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	606 graph.addBeforeFixed(exceptionSux, exceptionMerge);
5540 a891c53a295b Renaming RiKind => Kind. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5510 diff changeset	607 exceptionObjectPhi = graph.unique(new PhiNode(Kind.Object, exceptionMerge));
8469 718c0304ffeb Fix for polymorphic inlining after fusing exception obecjt and the distaptch begin Gilles Duboscq <duboscq@ssw.jku.at> parents: 8461 diff changeset	608 exceptionMerge.setStateAfter(exceptionEdge.stateAfter().duplicateModified(invoke.stateAfter().bci, true, Kind.Object, exceptionObjectPhi));
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	609 }
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	610
4456 f4c82dd4619e inlining bugfixes and cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4455 diff changeset	611 // create one separate block for each invoked method
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	612 AbstractBeginNode[] successors = new AbstractBeginNode[numberOfMethods + 1];
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	613 for (int i = 0; i < numberOfMethods; i++) {
9234 b9cf7d0b598e removal of FixedNode.probability (draft) Christian Haeubl <haeubl@ssw.jku.at> parents: 9147 diff changeset	614 successors[i] = createInvocationBlock(graph, invoke, returnMerge, returnValuePhi, exceptionMerge, exceptionObjectPhi, true);
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	615 }
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	616
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	617 // create the successor for an unknown type
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	618 FixedNode unknownTypeSux;
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	619 if (shouldFallbackToInvoke()) {
9234 b9cf7d0b598e removal of FixedNode.probability (draft) Christian Haeubl <haeubl@ssw.jku.at> parents: 9147 diff changeset	620 unknownTypeSux = createInvocationBlock(graph, invoke, returnMerge, returnValuePhi, exceptionMerge, exceptionObjectPhi, false);
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	621 } else {
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	622 unknownTypeSux = graph.add(new DeoptimizeNode(DeoptimizationAction.InvalidateReprofile, DeoptimizationReason.TypeCheckedInliningViolated));
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	623 }
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	624 successors[successors.length - 1] = AbstractBeginNode.begin(unknownTypeSux);
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	625
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	626 // replace the invoke exception edge
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	627 if (invoke instanceof InvokeWithExceptionNode) {
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	628 InvokeWithExceptionNode invokeWithExceptionNode = (InvokeWithExceptionNode) invoke;
8461 6a8ad083746e The exception edge for invokes should still be a DispatchBeginNode to allow lowering of ExceptionObjectNode after guard lowering Gilles Duboscq <duboscq@ssw.jku.at> parents: 8441 diff changeset	629 ExceptionObjectNode exceptionEdge = (ExceptionObjectNode) invokeWithExceptionNode.exceptionEdge();
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	630 exceptionEdge.replaceAtUsages(exceptionObjectPhi);
21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	631 exceptionEdge.setNext(null);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	632 GraphUtil.killCFG(invokeWithExceptionNode.exceptionEdge());
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	633 }
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	634
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	635 assert invoke.asNode().isAlive();
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	636
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	637 // replace the invoke with a switch on the type of the actual receiver
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	638 boolean methodDispatch = createDispatchOnTypeBeforeInvoke(graph, successors, false, runtime);
4458 cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	639
cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	640 assert invoke.next() == continuation;
cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	641 invoke.setNext(null);
cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	642 returnMerge.setNext(continuation);
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	643 invoke.asNode().replaceAtUsages(returnValuePhi);
5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	644 invoke.asNode().replaceAndDelete(null);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	645
8636 ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	646 ArrayList<PiNode> replacementNodes = new ArrayList<>();
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	647
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	648 // do the actual inlining for every invoke
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	649 for (int i = 0; i < numberOfMethods; i++) {
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	650 AbstractBeginNode node = successors[i];
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	651 Invoke invokeForInlining = (Invoke) node.next();
4636 495a81cd6969 avoid code generation for typechecks that are only used for anchoring Christian Haeubl <christian.haeubl@oracle.com> parents: 4635 diff changeset	652
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	653 ResolvedJavaType commonType;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	654 if (methodDispatch) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	655 commonType = concretes.get(i).getDeclaringClass();
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	656 } else {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	657 commonType = getLeastCommonType(i);
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	658 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	659
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	660 ValueNode receiver = ((MethodCallTargetNode) invokeForInlining.callTarget()).receiver();
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	661 boolean exact = (getTypeCount(i) == 1 && !methodDispatch);
6289 72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	662 PiNode anchoredReceiver = createAnchoredReceiver(graph, node, commonType, receiver, exact);
5339 e8f80481326d use PiNodes instead of CheckCastNodes to pin inlining receivers, remove emitCode flag Lukas Stadler <lukas.stadler@jku.at> parents: 5316 diff changeset	663 invokeForInlining.callTarget().replaceFirstInput(receiver, anchoredReceiver);
4622 00e01f401c03 Add checkcast for type-guarded inlining Gilles Duboscq <duboscq@ssw.jku.at> parents: 4618 diff changeset	664
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	665 inline(invokeForInlining, methodAt(i), inlineableElementAt(i), assumptions, false);
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	666
8636 ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	667 replacementNodes.add(anchoredReceiver);
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	668 }
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	669 if (shouldFallbackToInvoke()) {
8636 ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	670 replacementNodes.add(null);
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	671 }
9374 8649dbda7d25 New experiment with megamorphic inlining. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9329 diff changeset	672
9864 063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	673 if (OptTailDuplication.getValue()) {
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	674 /*
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	675 * We might want to perform tail duplication at the merge after a type switch, if
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	676 * there are invokes that would benefit from the improvement in type information.
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	677 */
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	678 FixedNode current = returnMerge;
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	679 int opportunities = 0;
5791 506e76281145 (symptomatic) fix for NPE in InliningUtil Lukas Stadler <lukas.stadler@jku.at> parents: 5786 diff changeset	680 do {
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	681 if (current instanceof InvokeNode && ((InvokeNode) current).callTarget() instanceof MethodCallTargetNode &&
07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	682 ((MethodCallTargetNode) ((InvokeNode) current).callTarget()).receiver() == originalReceiver) {
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	683 opportunities++;
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	684 } else if (current.inputs().contains(originalReceiver)) {
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	685 opportunities++;
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	686 }
5791 506e76281145 (symptomatic) fix for NPE in InliningUtil Lukas Stadler <lukas.stadler@jku.at> parents: 5786 diff changeset	687 current = ((FixedWithNextNode) current).next();
506e76281145 (symptomatic) fix for NPE in InliningUtil Lukas Stadler <lukas.stadler@jku.at> parents: 5786 diff changeset	688 } while (current instanceof FixedWithNextNode);
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	689
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	690 if (opportunities > 0) {
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	691 metricInliningTailDuplication.increment();
f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	692 Debug.log("MultiTypeGuardInlineInfo starting tail duplication (%d opportunities)", opportunities);
9329 fa188fbfe3fe Perform only targeted canonicalization after tail duplication. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9310 diff changeset	693 TailDuplicationPhase.tailDuplicate(returnMerge, TailDuplicationPhase.TRUE_DECISION, replacementNodes, new HighTierContext(runtime, assumptions, replacements));
5786 f69a406355b2 new tail duplication phase Lukas Stadler <lukas.stadler@jku.at> parents: 5720 diff changeset	694 }
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	695 }
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	696 }
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	697
6289 72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	698 private int getTypeCount(int concreteMethodIndex) {
72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	699 int count = 0;
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	700 for (int i = 0; i < typesToConcretes.size(); i++) {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	701 if (typesToConcretes.get(i) == concreteMethodIndex) {
6289 72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	702 count++;
72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	703 }
72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	704 }
72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	705 return count;
72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	706 }
72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	707
5541 b4c406861c33 More renamings to drop Ri* prefix completely. Deleted graph.BitMap class and replaced with java.util.BitSet. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5540 diff changeset	708 private ResolvedJavaType getLeastCommonType(int concreteMethodIndex) {
b4c406861c33 More renamings to drop Ri* prefix completely. Deleted graph.BitMap class and replaced with java.util.BitSet. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5540 diff changeset	709 ResolvedJavaType commonType = null;
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	710 for (int i = 0; i < typesToConcretes.size(); i++) {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	711 if (typesToConcretes.get(i) == concreteMethodIndex) {
4635 f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	712 if (commonType == null) {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	713 commonType = ptypes.get(i).getType();
4635 f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	714 } else {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	715 commonType = commonType.findLeastCommonAncestor(ptypes.get(i).getType());
4635 f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	716 }
f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	717 }
f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	718 }
f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	719 assert commonType != null;
f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	720 return commonType;
f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	721 }
f35c183f33ce fixed checkcast when inlining more than one method Christian Haeubl <christian.haeubl@oracle.com> parents: 4627 diff changeset	722
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	723 private ResolvedJavaType getLeastCommonType() {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	724 ResolvedJavaType result = getLeastCommonType(0);
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	725 for (int i = 1; i < concretes.size(); i++) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	726 result = result.findLeastCommonAncestor(getLeastCommonType(i));
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	727 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	728 return result;
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	729 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	730
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	731 private void inlineSingleMethod(StructuredGraph graph, MetaAccessProvider runtime, Assumptions assumptions) {
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	732 assert concretes.size() == 1 && inlineableElements.length == 1 && ptypes.size() > 1 && !shouldFallbackToInvoke() && notRecordedTypeProbability == 0;
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	733
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	734 AbstractBeginNode calleeEntryNode = graph.add(new BeginNode());
4459 d389f4b5bdd6 fixed typecheck branch probability Christian Haeubl <christian.haeubl@oracle.com> parents: 4458 diff changeset	735
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	736 AbstractBeginNode unknownTypeSux = createUnknownTypeSuccessor(graph);
ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	737 AbstractBeginNode[] successors = new AbstractBeginNode[]{calleeEntryNode, unknownTypeSux};
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	738 createDispatchOnTypeBeforeInvoke(graph, successors, false, runtime);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	739
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	740 calleeEntryNode.setNext(invoke.asNode());
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	741
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	742 inline(invoke, methodAt(0), inlineableElementAt(0), assumptions, false);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	743 }
b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	744
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	745 private boolean createDispatchOnTypeBeforeInvoke(StructuredGraph graph, AbstractBeginNode[] successors, boolean invokeIsOnlySuccessor, MetaAccessProvider runtime) {
9374 8649dbda7d25 New experiment with megamorphic inlining. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9329 diff changeset	746 assert ptypes.size() >= 1;
4459 d389f4b5bdd6 fixed typecheck branch probability Christian Haeubl <christian.haeubl@oracle.com> parents: 4458 diff changeset	747
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	748 Kind hubKind = ((MethodCallTargetNode) invoke.callTarget()).targetMethod().getDeclaringClass().getEncoding(Representation.ObjectHub).getKind();
07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	749 LoadHubNode hub = graph.add(new LoadHubNode(((MethodCallTargetNode) invoke.callTarget()).receiver(), hubKind));
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	750 graph.addBeforeFixed(invoke.asNode(), hub);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	751
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	752 if (!invokeIsOnlySuccessor && chooseMethodDispatch()) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	753 assert successors.length == concretes.size() + 1;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	754 assert concretes.size() > 0;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	755 Debug.log("Method check cascade with %d methods", concretes.size());
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	756
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	757 ValueNode[] constantMethods = new ValueNode[concretes.size()];
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	758 double[] probability = new double[concretes.size()];
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	759 for (int i = 0; i < concretes.size(); ++i) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	760 ResolvedJavaMethod firstMethod = concretes.get(i);
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	761 Constant firstMethodConstant = firstMethod.getEncoding();
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	762
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	763 ValueNode firstMethodConstantNode = ConstantNode.forConstant(firstMethodConstant, runtime, graph);
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	764 constantMethods[i] = firstMethodConstantNode;
9467 3531cdfddff6 Ensure probabilities are never negative. Add additional assertions. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9436 diff changeset	765 double concretesProbability = concretesProbabilities.get(i);
3531cdfddff6 Ensure probabilities are never negative. Add additional assertions. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9436 diff changeset	766 assert concretesProbability >= 0.0;
3531cdfddff6 Ensure probabilities are never negative. Add additional assertions. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9436 diff changeset	767 probability[i] = concretesProbability;
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	768 if (i > 0) {
9469 8c37649cbb62 Fixes for probability calculation. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9467 diff changeset	769 double prevProbability = probability[i - 1];
8c37649cbb62 Fixes for probability calculation. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9467 diff changeset	770 if (prevProbability == 1.0) {
8c37649cbb62 Fixes for probability calculation. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9467 diff changeset	771 probability[i] = 1.0;
8c37649cbb62 Fixes for probability calculation. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9467 diff changeset	772 } else {
9470 225fc5463430 Make sure if trueSuccessor probability is always <= 1.0. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9469 diff changeset	773 probability[i] = Math.min(1.0, Math.max(0.0, probability[i] / (1.0 - prevProbability)));
9469 8c37649cbb62 Fixes for probability calculation. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9467 diff changeset	774 }
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	775 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	776 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	777
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	778 FixedNode lastSucc = successors[concretes.size()];
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	779 for (int i = concretes.size() - 1; i >= 0; --i) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	780 LoadMethodNode method = graph.add(new LoadMethodNode(concretes.get(i), hub, constantMethods[i].kind()));
9610 ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	781 CompareNode methodCheck = CompareNode.createCompareNode(Condition.EQ, method, constantMethods[i]);
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	782 IfNode ifNode = graph.add(new IfNode(methodCheck, successors[i], lastSucc, probability[i]));
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	783 method.setNext(ifNode);
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	784 lastSucc = method;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	785 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	786
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	787 FixedWithNextNode pred = (FixedWithNextNode) invoke.asNode().predecessor();
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	788 pred.setNext(lastSucc);
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	789 return true;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	790 } else {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	791 Debug.log("Type switch with %d types", concretes.size());
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	792 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	793
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	794 ResolvedJavaType[] keys = new ResolvedJavaType[ptypes.size()];
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	795 double[] keyProbabilities = new double[ptypes.size() + 1];
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	796 int[] keySuccessors = new int[ptypes.size() + 1];
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	797 for (int i = 0; i < ptypes.size(); i++) {
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	798 keys[i] = ptypes.get(i).getType();
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	799 keyProbabilities[i] = ptypes.get(i).getProbability();
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	800 keySuccessors[i] = invokeIsOnlySuccessor ? 0 : typesToConcretes.get(i);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	801 assert keySuccessors[i] < successors.length - 1 : "last successor is the unknownTypeSux";
4459 d389f4b5bdd6 fixed typecheck branch probability Christian Haeubl <christian.haeubl@oracle.com> parents: 4458 diff changeset	802 }
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	803 keyProbabilities[keyProbabilities.length - 1] = notRecordedTypeProbability;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	804 keySuccessors[keySuccessors.length - 1] = successors.length - 1;
4459 d389f4b5bdd6 fixed typecheck branch probability Christian Haeubl <christian.haeubl@oracle.com> parents: 4458 diff changeset	805
7705 96a596d751ab remove successorProbabilities from SwitchNode Lukas Stadler <lukas.stadler@jku.at> parents: 7660 diff changeset	806 TypeSwitchNode typeSwitch = graph.add(new TypeSwitchNode(hub, successors, keys, keyProbabilities, keySuccessors));
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	807 FixedWithNextNode pred = (FixedWithNextNode) invoke.asNode().predecessor();
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	808 pred.setNext(typeSwitch);
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	809 return false;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	810 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	811
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	812 private boolean chooseMethodDispatch() {
9610 ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	813 for (ResolvedJavaMethod concrete : concretes) {
ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	814 if (!concrete.isInVirtualMethodTable()) {
ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	815 return false;
ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	816 }
ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	817 }
ae17e540c5d2 More asserts while getting vtable offsets Gilles Duboscq <duboscq@ssw.jku.at> parents: 9602 diff changeset	818
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	819 if (concretes.size() == 1 && this.notRecordedTypeProbability > 0) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	820 // Always chose method dispatch if there is a single concrete method and the call
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	821 // site is megamorphic.
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	822 return true;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	823 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	824
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	825 if (concretes.size() == ptypes.size()) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	826 // Always prefer types over methods if the number of types is smaller than the
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	827 // number of methods.
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	828 return false;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	829 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	830
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	831 return chooseMethodDispatchCostBased();
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	832 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	833
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	834 private boolean chooseMethodDispatchCostBased() {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	835 double remainder = 1.0 - this.notRecordedTypeProbability;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	836 double costEstimateMethodDispatch = remainder;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	837 for (int i = 0; i < concretes.size(); ++i) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	838 if (i != 0) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	839 costEstimateMethodDispatch += remainder;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	840 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	841 remainder -= concretesProbabilities.get(i);
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	842 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	843
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	844 double costEstimateTypeDispatch = 0.0;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	845 remainder = 1.0;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	846 for (int i = 0; i < ptypes.size(); ++i) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	847 if (i != 0) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	848 costEstimateTypeDispatch += remainder;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	849 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	850 remainder -= ptypes.get(i).getProbability();
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	851 }
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	852 costEstimateTypeDispatch += notRecordedTypeProbability;
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	853 return costEstimateMethodDispatch < costEstimateTypeDispatch;
4454 008a5ea590ca fixed merge control flow for inlining Christian Haeubl <christian.haeubl@oracle.com> parents: 4453 diff changeset	854 }
008a5ea590ca fixed merge control flow for inlining Christian Haeubl <christian.haeubl@oracle.com> parents: 4453 diff changeset	855
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	856 private static AbstractBeginNode createInvocationBlock(StructuredGraph graph, Invoke invoke, MergeNode returnMerge, PhiNode returnValuePhi, MergeNode exceptionMerge,
ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	857 PhiNode exceptionObjectPhi, boolean useForInlining) {
9234 b9cf7d0b598e removal of FixedNode.probability (draft) Christian Haeubl <haeubl@ssw.jku.at> parents: 9147 diff changeset	858 Invoke duplicatedInvoke = duplicateInvokeForInlining(graph, invoke, exceptionMerge, exceptionObjectPhi, useForInlining);
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	859 AbstractBeginNode calleeEntryNode = graph.add(new BeginNode());
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	860 calleeEntryNode.setNext(duplicatedInvoke.asNode());
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	861
9434 50f02c7d1cec Rename EndNode => AbstractEndNode and make abstract class. Introduce concrete EndNode subclass. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9392 diff changeset	862 AbstractEndNode endNode = graph.add(new EndNode());
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	863 duplicatedInvoke.setNext(endNode);
4614 a3882fd1ae61 Make it possible to have multiple LoopEnds per LoopBegin Gilles Duboscq <duboscq@ssw.jku.at> parents: 4571 diff changeset	864 returnMerge.addForwardEnd(endNode);
5005 c2ebd3d559f7 fixed probabilities when polymorphic inlining is used Christian Haeubl <christian.haeubl@oracle.com> parents: 5003 diff changeset	865
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	866 if (returnValuePhi != null) {
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	867 returnValuePhi.addInput(duplicatedInvoke.asNode());
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	868 }
63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	869 return calleeEntryNode;
63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	870 }
63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	871
9234 b9cf7d0b598e removal of FixedNode.probability (draft) Christian Haeubl <haeubl@ssw.jku.at> parents: 9147 diff changeset	872 private static Invoke duplicateInvokeForInlining(StructuredGraph graph, Invoke invoke, MergeNode exceptionMerge, PhiNode exceptionObjectPhi, boolean useForInlining) {
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	873 Invoke result = (Invoke) invoke.asNode().copyWithInputs();
4622 00e01f401c03 Add checkcast for type-guarded inlining Gilles Duboscq <duboscq@ssw.jku.at> parents: 4618 diff changeset	874 Node callTarget = result.callTarget().copyWithInputs();
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	875 result.asNode().replaceFirstInput(result.callTarget(), callTarget);
4472 63cd21fda79b hotspot gc bugfix, added possibility to fallback to invocation if type check is violated Christian Haeubl <christian.haeubl@oracle.com> parents: 4467 diff changeset	876 result.setUseForInlining(useForInlining);
4539 98b3b255913c Fix stateAfter for multiple type inline Gilles Duboscq <duboscq@ssw.jku.at> parents: 4530 diff changeset	877
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	878 Kind kind = invoke.asNode().kind();
7098 e23980f4a890 Cleanup of Kind class: remove isXxx methods Christian Wimmer <christian.wimmer@oracle.com> parents: 7097 diff changeset	879 if (kind != Kind.Void) {
4539 98b3b255913c Fix stateAfter for multiple type inline Gilles Duboscq <duboscq@ssw.jku.at> parents: 4530 diff changeset	880 FrameState stateAfter = invoke.stateAfter();
98b3b255913c Fix stateAfter for multiple type inline Gilles Duboscq <duboscq@ssw.jku.at> parents: 4530 diff changeset	881 stateAfter = stateAfter.duplicate(stateAfter.bci);
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	882 stateAfter.replaceFirstInput(invoke.asNode(), result.asNode());
4539 98b3b255913c Fix stateAfter for multiple type inline Gilles Duboscq <duboscq@ssw.jku.at> parents: 4530 diff changeset	883 result.setStateAfter(stateAfter);
98b3b255913c Fix stateAfter for multiple type inline Gilles Duboscq <duboscq@ssw.jku.at> parents: 4530 diff changeset	884 }
98b3b255913c Fix stateAfter for multiple type inline Gilles Duboscq <duboscq@ssw.jku.at> parents: 4530 diff changeset	885
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	886 if (invoke instanceof InvokeWithExceptionNode) {
4458 cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	887 assert exceptionMerge != null && exceptionObjectPhi != null;
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	888
4458 cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	889 InvokeWithExceptionNode invokeWithException = (InvokeWithExceptionNode) invoke;
8461 6a8ad083746e The exception edge for invokes should still be a DispatchBeginNode to allow lowering of ExceptionObjectNode after guard lowering Gilles Duboscq <duboscq@ssw.jku.at> parents: 8441 diff changeset	890 ExceptionObjectNode exceptionEdge = (ExceptionObjectNode) invokeWithException.exceptionEdge();
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	891 FrameState stateAfterException = exceptionEdge.stateAfter();
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	892
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	893 ExceptionObjectNode newExceptionEdge = (ExceptionObjectNode) exceptionEdge.copyWithInputs();
4529 fc78ad20ec38 fixed exception framestate Christian Haeubl <christian.haeubl@oracle.com> parents: 4528 diff changeset	894 // set new state (pop old exception object, push new one)
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	895 newExceptionEdge.setStateAfter(stateAfterException.duplicateModified(stateAfterException.bci, stateAfterException.rethrowException(), Kind.Object, newExceptionEdge));
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	896
9434 50f02c7d1cec Rename EndNode => AbstractEndNode and make abstract class. Introduce concrete EndNode subclass. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9392 diff changeset	897 AbstractEndNode endNode = graph.add(new EndNode());
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	898 newExceptionEdge.setNext(endNode);
4614 a3882fd1ae61 Make it possible to have multiple LoopEnds per LoopBegin Gilles Duboscq <duboscq@ssw.jku.at> parents: 4571 diff changeset	899 exceptionMerge.addForwardEnd(endNode);
8441 21bf57680185 Fuse the ExceptionObject its DispatchBegin into a single node since it has to be atomic while gurads are floating Gilles Duboscq <duboscq@ssw.jku.at> parents: 8421 diff changeset	900 exceptionObjectPhi.addInput(newExceptionEdge);
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	901
4458 cdf13998f705 inlining of multiple methods survives bootstrapping Christian Haeubl <christian.haeubl@oracle.com> parents: 4457 diff changeset	902 ((InvokeWithExceptionNode) result).setExceptionEdge(newExceptionEdge);
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	903 }
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	904 return result;
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	905 }
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	906
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	907 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	908 public void tryToDevirtualizeInvoke(MetaAccessProvider runtime, Assumptions assumptions) {
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	909 if (hasSingleMethod()) {
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	910 tryToDevirtualizeSingleMethod(graph(), runtime);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	911 } else {
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	912 tryToDevirtualizeMultipleMethods(graph(), runtime);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	913 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	914 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	915
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	916 private void tryToDevirtualizeSingleMethod(StructuredGraph graph, MetaAccessProvider runtime) {
ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	917 devirtualizeWithTypeSwitch(graph, InvokeKind.Special, concretes.get(0), runtime);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	918 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	919
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	920 private void tryToDevirtualizeMultipleMethods(StructuredGraph graph, MetaAccessProvider runtime) {
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	921 MethodCallTargetNode methodCallTarget = (MethodCallTargetNode) invoke.callTarget();
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	922 if (methodCallTarget.invokeKind() == InvokeKind.Interface) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	923 ResolvedJavaMethod targetMethod = methodCallTarget.targetMethod();
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	924 ResolvedJavaType leastCommonType = getLeastCommonType();
7686 149092d59dd0 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7685 diff changeset	925 // check if we have a common base type that implements the interface -> in that case
7825 c6c3515bea8e New formatter settings for enum values (every value on a new line). Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 7818 diff changeset	926 // we have a vtable entry for the interface method and can use a less expensive
c6c3515bea8e New formatter settings for enum values (every value on a new line). Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 7818 diff changeset	927 // virtual call
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	928 if (!leastCommonType.isInterface() && targetMethod.getDeclaringClass().isAssignableFrom(leastCommonType)) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	929 ResolvedJavaMethod baseClassTargetMethod = leastCommonType.resolveMethod(targetMethod);
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	930 if (baseClassTargetMethod != null) {
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	931 devirtualizeWithTypeSwitch(graph, InvokeKind.Virtual, leastCommonType.resolveMethod(targetMethod), runtime);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	932 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	933 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	934 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	935 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	936
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	937 private void devirtualizeWithTypeSwitch(StructuredGraph graph, InvokeKind kind, ResolvedJavaMethod target, MetaAccessProvider runtime) {
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	938 InliningUtil.receiverNullCheck(invoke);
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	939
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	940 AbstractBeginNode invocationEntry = graph.add(new BeginNode());
ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	941 AbstractBeginNode unknownTypeSux = createUnknownTypeSuccessor(graph);
ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	942 AbstractBeginNode[] successors = new AbstractBeginNode[]{invocationEntry, unknownTypeSux};
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	943 createDispatchOnTypeBeforeInvoke(graph, successors, true, runtime);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	944
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	945 invocationEntry.setNext(invoke.asNode());
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	946 ValueNode receiver = ((MethodCallTargetNode) invoke.callTarget()).receiver();
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	947 PiNode anchoredReceiver = createAnchoredReceiver(graph, invocationEntry, target.getDeclaringClass(), receiver, false);
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	948 invoke.callTarget().replaceFirstInput(receiver, anchoredReceiver);
9310 b0f9ab5a185b Devirtualize invoke before handing it to the macro node. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9238 diff changeset	949 replaceInvokeCallTarget(invoke, graph, kind, target);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	950 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	951
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	952 private static AbstractBeginNode createUnknownTypeSuccessor(StructuredGraph graph) {
ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	953 return AbstractBeginNode.begin(graph.add(new DeoptimizeNode(DeoptimizationAction.InvalidateReprofile, DeoptimizationReason.TypeCheckedInliningViolated)));
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	954 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	955
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	956 @Override
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	957 public String toString() {
5019 836e4fce33ab changed inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5005 diff changeset	958 StringBuilder builder = new StringBuilder(shouldFallbackToInvoke() ? "megamorphic" : "polymorphic");
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	959 builder.append(", ");
ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	960 builder.append(concretes.size());
ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	961 builder.append(" methods [ ");
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	962 for (int i = 0; i < concretes.size(); i++) {
5719 429accae15aa moved some methods from CodeUtil to MetaUtil Doug Simon <doug.simon@oracle.com> parents: 5718 diff changeset	963 builder.append(MetaUtil.format(" %H.%n(%p):%r", concretes.get(i)));
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	964 }
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	965 builder.append(" ], ");
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	966 builder.append(ptypes.size());
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	967 builder.append(" type checks [ ");
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	968 for (int i = 0; i < ptypes.size(); i++) {
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	969 builder.append(" ");
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	970 builder.append(ptypes.get(i).getType().getName());
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	971 builder.append(ptypes.get(i).getProbability());
7213 ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	972 }
ceb8c5b29419 print more details when -XX:+PrintDeoptimizationDetails is enabled Christian Haeubl <haeubl@ssw.jku.at> parents: 7098 diff changeset	973 builder.append(" ]");
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	974 return builder.toString();
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	975 }
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	976 }
d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	977
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	978 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	979 * Represents an inlining opportunity where the current class hierarchy leads to a monomorphic
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	980 * target method, but for which an assumption has to be registered because of non-final classes.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	981 */
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	982 private static class AssumptionInlineInfo extends ExactInlineInfo {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	983
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	984 private final Assumption takenAssumption;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	985
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	986 public AssumptionInlineInfo(Invoke invoke, ResolvedJavaMethod concrete, Assumption takenAssumption) {
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	987 super(invoke, concrete);
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	988 this.takenAssumption = takenAssumption;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	989 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	990
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	991 @Override
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	992 public void inline(MetaAccessProvider runtime, Assumptions assumptions, Replacements replacements) {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	993 assumptions.record(takenAssumption);
9706 f44d7e24cebd Fixes for the merge and inlining cleanups. Christian Haeubl <haeubl@ssw.jku.at> parents: 9705 diff changeset	994 super.inline(runtime, assumptions, replacements);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	995 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	996
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	997 @Override
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	998 public void tryToDevirtualizeInvoke(MetaAccessProvider runtime, Assumptions assumptions) {
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	999 assumptions.record(takenAssumption);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1000 replaceInvokeCallTarget(invoke, graph(), InvokeKind.Special, concrete);
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	1001 }
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	1002
bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	1003 @Override
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1004 public String toString() {
5719 429accae15aa moved some methods from CodeUtil to MetaUtil Doug Simon <doug.simon@oracle.com> parents: 5718 diff changeset	1005 return "assumption " + MetaUtil.format("%H.%n(%p):%r", concrete);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1006 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1007 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1008
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1009 /**
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1010 * Determines if inlining is possible at the given invoke node.
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1011 *
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1012 * @param invoke the invoke that should be inlined
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1013 * @return an instance of InlineInfo, or null if no inlining is possible at the given invoke
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1014 */
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1015 public static InlineInfo getInlineInfo(InliningData data, Invoke invoke, int maxNumberOfMethods, Replacements replacements, Assumptions assumptions, OptimisticOptimizations optimisticOpts) {
5127 7b2efb5ff2ea better inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5114 diff changeset	1016 if (!checkInvokeConditions(invoke)) {
7b2efb5ff2ea better inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5114 diff changeset	1017 return null;
7b2efb5ff2ea better inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5114 diff changeset	1018 }
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	1019 MethodCallTargetNode callTarget = (MethodCallTargetNode) invoke.callTarget();
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1020 ResolvedJavaMethod targetMethod = callTarget.targetMethod();
5127 7b2efb5ff2ea better inlining debug output Christian Haeubl <christian.haeubl@oracle.com> parents: 5114 diff changeset	1021
4571 ac6e494d048a bugfix Christian Haeubl <christian.haeubl@oracle.com> parents: 4564 diff changeset	1022 if (callTarget.invokeKind() == InvokeKind.Special \|\| targetMethod.canBeStaticallyBound()) {
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1023 return getExactInlineInfo(data, invoke, replacements, optimisticOpts, targetMethod);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1024 }
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1025
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1026 assert callTarget.invokeKind() == InvokeKind.Virtual \|\| callTarget.invokeKind() == InvokeKind.Interface;
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1027
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1028 ResolvedJavaType holder = targetMethod.getDeclaringClass();
5443 141817e206d4 changes to the dependencies and stamp system: Lukas Stadler <lukas.stadler@jku.at> parents: 5426 diff changeset	1029 ObjectStamp receiverStamp = callTarget.receiver().objectStamp();
141817e206d4 changes to the dependencies and stamp system: Lukas Stadler <lukas.stadler@jku.at> parents: 5426 diff changeset	1030 if (receiverStamp.type() != null) {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1031 // the invoke target might be more specific than the holder (happens after inlining:
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1032 // locals lose their declared type...)
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1033 ResolvedJavaType receiverType = receiverStamp.type();
7097 6644cecbd3a7 Replace ResolvedJavaType.isAssignableTo with isAssignableFrom to be consistent with java.lang.Class Christian Wimmer <christian.wimmer@oracle.com> parents: 7079 diff changeset	1034 if (receiverType != null && holder.isAssignableFrom(receiverType)) {
5443 141817e206d4 changes to the dependencies and stamp system: Lukas Stadler <lukas.stadler@jku.at> parents: 5426 diff changeset	1035 holder = receiverType;
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1036 if (receiverStamp.isExactType()) {
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1037 assert targetMethod.getDeclaringClass().isAssignableFrom(holder) : holder + " subtype of " + targetMethod.getDeclaringClass() + " for " + targetMethod;
9837 59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1038 ResolvedJavaMethod resolvedMethod = holder.resolveMethod(targetMethod);
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1039 if (resolvedMethod != null) {
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1040 return getExactInlineInfo(data, invoke, replacements, optimisticOpts, resolvedMethod);
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1041 }
4457 5acf4a974e4a fixed framestate for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4456 diff changeset	1042 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1043 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1044 }
4440 271220b49abc profiling info fixes Christian Haeubl <christian.haeubl@oracle.com> parents: 4249 diff changeset	1045
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1046 if (holder.isArray()) {
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1047 // arrays can be treated as Objects
9837 59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1048 ResolvedJavaMethod resolvedMethod = holder.resolveMethod(targetMethod);
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1049 if (resolvedMethod != null) {
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1050 return getExactInlineInfo(data, invoke, replacements, optimisticOpts, resolvedMethod);
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1051 }
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1052 }
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1053
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1054 if (assumptions.useOptimisticAssumptions()) {
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1055 ResolvedJavaType uniqueSubtype = holder.findUniqueConcreteSubtype();
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1056 if (uniqueSubtype != null) {
9837 59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1057 ResolvedJavaMethod resolvedMethod = uniqueSubtype.resolveMethod(targetMethod);
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1058 if (resolvedMethod != null) {
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1059 return getAssumptionInlineInfo(data, invoke, replacements, optimisticOpts, resolvedMethod, new Assumptions.ConcreteSubtype(holder, uniqueSubtype));
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1060 }
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1061 }
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1062
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1063 ResolvedJavaMethod concrete = holder.findUniqueConcreteMethod(targetMethod);
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1064 if (concrete != null) {
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1065 return getAssumptionInlineInfo(data, invoke, replacements, optimisticOpts, concrete, new Assumptions.ConcreteMethod(targetMethod, holder, concrete));
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1066 }
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1067 }
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1068
4459 d389f4b5bdd6 fixed typecheck branch probability Christian Haeubl <christian.haeubl@oracle.com> parents: 4458 diff changeset	1069 // type check based inlining
9704 f9a65a0e626b Merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9701 9610 diff changeset	1070 return getTypeCheckedInlineInfo(data, invoke, maxNumberOfMethods, replacements, targetMethod, optimisticOpts);
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1071 }
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1072
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1073 private static InlineInfo getAssumptionInlineInfo(InliningData data, Invoke invoke, Replacements replacements, OptimisticOptimizations optimisticOpts, ResolvedJavaMethod concrete,
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1074 Assumption takenAssumption) {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1075 assert !Modifier.isAbstract(concrete.getModifiers());
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1076 if (!checkTargetConditions(data, replacements, invoke, concrete, optimisticOpts)) {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1077 return null;
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1078 }
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	1079 return new AssumptionInlineInfo(invoke, concrete, takenAssumption);
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1080 }
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1081
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1082 private static InlineInfo getExactInlineInfo(InliningData data, Invoke invoke, Replacements replacements, OptimisticOptimizations optimisticOpts, ResolvedJavaMethod targetMethod) {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1083 assert !Modifier.isAbstract(targetMethod.getModifiers());
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1084 if (!checkTargetConditions(data, replacements, invoke, targetMethod, optimisticOpts)) {
7223 e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1085 return null;
e2ea829fafd9 use CHA more frequently for inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7221 diff changeset	1086 }
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	1087 return new ExactInlineInfo(invoke, targetMethod);
5109 6766253384bf more preparations for disabling runtime feedback selectively based on deoptimization history Christian Haeubl <christian.haeubl@oracle.com> parents: 5105 diff changeset	1088 }
6766253384bf more preparations for disabling runtime feedback selectively based on deoptimization history Christian Haeubl <christian.haeubl@oracle.com> parents: 5105 diff changeset	1089
9705 de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	1090 private static InlineInfo getTypeCheckedInlineInfo(InliningData data, Invoke invoke, int maxNumberOfMethods, Replacements replacements, ResolvedJavaMethod targetMethod,
de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	1091 OptimisticOptimizations optimisticOpts) {
de7319e48e48 Temporary fixes for the merge. Christian Haeubl <haeubl@ssw.jku.at> parents: 9704 diff changeset	1092 JavaTypeProfile typeProfile;
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1093 ValueNode receiver = invoke.callTarget().arguments().get(0);
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1094 if (receiver instanceof TypeProfileProxyNode) {
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1095 TypeProfileProxyNode typeProfileProxyNode = (TypeProfileProxyNode) receiver;
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1096 typeProfile = typeProfileProxyNode.getProfile();
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1097 } else {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1098 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "no type profile exists");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1099 }
4456 f4c82dd4619e inlining bugfixes and cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4455 diff changeset	1100
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1101 ProfiledType[] ptypes = typeProfile.getTypes();
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1102 if (ptypes == null \|\| ptypes.length <= 0) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1103 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "no types in profile");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1104 }
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	1105
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1106 double notRecordedTypeProbability = typeProfile.getNotRecordedProbability();
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1107 if (ptypes.length == 1 && notRecordedTypeProbability == 0) {
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1108 if (!optimisticOpts.inlineMonomorphicCalls()) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1109 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "inlining monomorphic calls is disabled");
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1110 }
4459 d389f4b5bdd6 fixed typecheck branch probability Christian Haeubl <christian.haeubl@oracle.com> parents: 4458 diff changeset	1111
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1112 ResolvedJavaType type = ptypes[0].getType();
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1113 ResolvedJavaMethod concrete = type.resolveMethod(targetMethod);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1114 if (!checkTargetConditions(data, replacements, invoke, concrete, optimisticOpts)) {
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1115 return null;
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1116 }
7684 bbf97d6688d3 cleanup for the inlining policies Christian Haeubl <haeubl@ssw.jku.at> parents: 7392 diff changeset	1117 return new TypeGuardInlineInfo(invoke, concrete, type);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1118 } else {
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1119 invoke.setPolymorphic(true);
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1120
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1121 if (!optimisticOpts.inlinePolymorphicCalls() && notRecordedTypeProbability == 0) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1122 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "inlining polymorphic calls is disabled (%d types)", ptypes.length);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1123 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1124 if (!optimisticOpts.inlineMegamorphicCalls() && notRecordedTypeProbability > 0) {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1125 // due to filtering impossible types, notRecordedTypeProbability can be > 0 although
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1126 // the number of types is lower than what can be recorded in a type profile
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1127 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "inlining megamorphic calls is disabled (%d types, %f %% not recorded types)", ptypes.length,
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1128 notRecordedTypeProbability * 100);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1129 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1130
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1131 // Find unique methods and their probabilities.
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1132 ArrayList<ResolvedJavaMethod> concreteMethods = new ArrayList<>();
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1133 ArrayList<Double> concreteMethodsProbabilities = new ArrayList<>();
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1134 for (int i = 0; i < ptypes.length; i++) {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1135 ResolvedJavaMethod concrete = ptypes[i].getType().resolveMethod(targetMethod);
9837 59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1136 if (concrete == null) {
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1137 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "could not resolve method");
59d799c965c9 Allow ResolvedJavaType.resolveMethod to return null Christian Wimmer <christian.wimmer@oracle.com> parents: 9722 diff changeset	1138 }
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1139 int index = concreteMethods.indexOf(concrete);
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1140 double curProbability = ptypes[i].getProbability();
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1141 if (index < 0) {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1142 index = concreteMethods.size();
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1143 concreteMethods.add(concrete);
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1144 concreteMethodsProbabilities.add(curProbability);
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1145 } else {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1146 concreteMethodsProbabilities.set(index, concreteMethodsProbabilities.get(index) + curProbability);
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1147 }
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1148 }
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1149
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1150 if (concreteMethods.size() > maxNumberOfMethods) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1151 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "polymorphic call with more than %d target methods", maxNumberOfMethods);
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1152 }
9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1153
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1154 // Clear methods that fall below the threshold.
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1155 if (notRecordedTypeProbability > 0) {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1156 ArrayList<ResolvedJavaMethod> newConcreteMethods = new ArrayList<>();
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1157 ArrayList<Double> newConcreteMethodsProbabilities = new ArrayList<>();
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1158 for (int i = 0; i < concreteMethods.size(); ++i) {
9864 063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	1159 if (concreteMethodsProbabilities.get(i) >= GraalOptions.MegamorphicInliningMinMethodProbability.getValue()) {
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1160 newConcreteMethods.add(concreteMethods.get(i));
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1161 newConcreteMethodsProbabilities.add(concreteMethodsProbabilities.get(i));
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1162 }
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1163 }
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1164
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1165 if (newConcreteMethods.size() == 0) {
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1166 // No method left that is worth inlining.
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1167 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "no methods remaining after filtering less frequent methods (%d methods previously)",
b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1168 concreteMethods.size());
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1169 }
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1170
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1171 concreteMethods = newConcreteMethods;
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1172 concreteMethodsProbabilities = newConcreteMethodsProbabilities;
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1173 }
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1174
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1175 // Clean out types whose methods are no longer available.
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1176 ArrayList<ProfiledType> usedTypes = new ArrayList<>();
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1177 ArrayList<Integer> typesToConcretes = new ArrayList<>();
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1178 for (ProfiledType type : ptypes) {
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1179 ResolvedJavaMethod concrete = type.getType().resolveMethod(targetMethod);
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1180 int index = concreteMethods.indexOf(concrete);
5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1181 if (index == -1) {
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1182 notRecordedTypeProbability += type.getProbability();
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1183 } else {
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1184 usedTypes.add(type);
9392 5a74cbafe5b9 Adjustment to the megamorphic inlining strategy such that it focuses on concrete methods. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9389 diff changeset	1185 typesToConcretes.add(index);
9374 8649dbda7d25 New experiment with megamorphic inlining. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9329 diff changeset	1186 }
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1187 }
9374 8649dbda7d25 New experiment with megamorphic inlining. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9329 diff changeset	1188
9389 708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1189 if (usedTypes.size() == 0) {
708aea0e5a25 Introduce proxy nodes for propagating profiling information. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9380 diff changeset	1190 // No type left that is worth checking for.
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1191 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "no types remaining after filtering less frequent types (%d types previously)", ptypes.length);
9374 8649dbda7d25 New experiment with megamorphic inlining. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9329 diff changeset	1192 }
8649dbda7d25 New experiment with megamorphic inlining. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9329 diff changeset	1193
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1194 for (ResolvedJavaMethod concrete : concreteMethods) {
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1195 if (!checkTargetConditions(data, replacements, invoke, concrete, optimisticOpts)) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1196 return logNotInlinedMethodAndReturnNull(invoke, data.inliningDepth(), targetMethod, "it is a polymorphic method call and at least one invoked method cannot be inlined");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1197 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1198 }
9380 ee8cd087a731 Dispatch based on method instead of type if it seems more beneficial. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9379 diff changeset	1199 return new MultiTypeGuardInlineInfo(invoke, concreteMethods, concreteMethodsProbabilities, usedTypes, typesToConcretes, notRecordedTypeProbability);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1200 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1201 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1202
6289 72eb3a1a20c4 create PiNodes with exact types during inlining Lukas Stadler <lukas.stadler@jku.at> parents: 5792 diff changeset	1203 private static PiNode createAnchoredReceiver(StructuredGraph graph, FixedNode anchor, ResolvedJavaType commonType, ValueNode receiver, boolean exact) {
4636 495a81cd6969 avoid code generation for typechecks that are only used for anchoring Christian Haeubl <christian.haeubl@oracle.com> parents: 4635 diff changeset	1204 // to avoid that floating reads on receiver fields float above the type check
8649 39fc99302250 PiNode: use existing dependencies array for anchor Bernhard Urban <bernhard.urban@jku.at> parents: 8637 diff changeset	1205 return graph.unique(new PiNode(receiver, exact ? StampFactory.exactNonNull(commonType) : StampFactory.declaredNonNull(commonType), anchor));
4636 495a81cd6969 avoid code generation for typechecks that are only used for anchoring Christian Haeubl <christian.haeubl@oracle.com> parents: 4635 diff changeset	1206 }
495a81cd6969 avoid code generation for typechecks that are only used for anchoring Christian Haeubl <christian.haeubl@oracle.com> parents: 4635 diff changeset	1207
9234 b9cf7d0b598e removal of FixedNode.probability (draft) Christian Haeubl <haeubl@ssw.jku.at> parents: 9147 diff changeset	1208 // TODO (chaeubl): cleanup this method
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1209 private static boolean checkInvokeConditions(Invoke invoke) {
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1210 if (invoke.predecessor() == null \|\| !invoke.asNode().isAlive()) {
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	1211 return logNotInlinedMethod(invoke, "the invoke is dead code");
7391 36dafe48bc38 added relevance-based inlining Christian Haeubl <haeubl@ssw.jku.at> parents: 7388 diff changeset	1212 } else if (!(invoke.callTarget() instanceof MethodCallTargetNode)) {
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	1213 return logNotInlinedMethod(invoke, "the invoke has already been lowered, or has been created as a low-level node");
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	1214 } else if (((MethodCallTargetNode) invoke.callTarget()).targetMethod() == null) {
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	1215 return logNotInlinedMethod(invoke, "target method is null");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1216 } else if (invoke.stateAfter() == null) {
9234 b9cf7d0b598e removal of FixedNode.probability (draft) Christian Haeubl <haeubl@ssw.jku.at> parents: 9147 diff changeset	1217 // TODO (chaeubl): why should an invoke not have a state after?
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	1218 return logNotInlinedMethod(invoke, "the invoke has no after state");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1219 } else if (!invoke.useForInlining()) {
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	1220 return logNotInlinedMethod(invoke, "the invoke is marked to be not used for inlining");
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	1221 } else if (((MethodCallTargetNode) invoke.callTarget()).receiver() != null && ((MethodCallTargetNode) invoke.callTarget()).receiver().isConstant() &&
07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	1222 ((MethodCallTargetNode) invoke.callTarget()).receiver().asConstant().isNull()) {
9701 e538498d6eae some refactorings and cleanups for the InliningPhase Christian Haeubl <haeubl@ssw.jku.at> parents: 9699 diff changeset	1223 return logNotInlinedMethod(invoke, "receiver is null");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1224 } else {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1225 return true;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1226 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1227 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1228
9699 9529ab567367 Drafted version of an inlining policy that uses the callee graph size as its metric. Christian Haeubl <haeubl@ssw.jku.at> parents: 9310 diff changeset	1229 private static boolean checkTargetConditions(InliningData data, Replacements replacements, Invoke invoke, ResolvedJavaMethod method, OptimisticOptimizations optimisticOpts) {
4530 6c6cb7be1324 bugfix Christian Haeubl <christian.haeubl@oracle.com> parents: 4529 diff changeset	1230 if (method == null) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1231 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "the method is not resolved");
9864 063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	1232 } else if (Modifier.isNative(method.getModifiers()) && (!GraalOptions.Intrinsify.getValue() \|\| !InliningUtil.canIntrinsify(replacements, method))) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1233 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "it is a non-intrinsic native method");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1234 } else if (Modifier.isAbstract(method.getModifiers())) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1235 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "it is an abstract method");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1236 } else if (!method.getDeclaringClass().isInitialized()) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1237 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "the method's class is not initialized");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1238 } else if (!method.canBeInlined()) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1239 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "it is marked non-inlinable");
9864 063a712fe8d8 converted remaining options in GraalOptions to new system (GRAAL-27) Doug Simon <doug.simon@oracle.com> parents: 9837 diff changeset	1240 } else if (data.countRecursiveInlining(method) > MaximumRecursiveInlining.getValue()) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1241 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "it exceeds the maximum recursive inlining depth");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1242 } else if (new OptimisticOptimizations(method).lessOptimisticThan(optimisticOpts)) {
9722 b5dd7e3c8c80 Bugfixes for the inlining phase and for -XX:+PrintInlining. Christian Haeubl <haeubl@ssw.jku.at> parents: 9711 diff changeset	1243 return logNotInlinedMethodAndReturnFalse(invoke, data.inliningDepth(), method, "the callee uses less optimistic optimizations than caller");
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1244 } else {
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1245 return true;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1246 }
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1247 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1248
8229 3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1249 static MonitorExitNode findPrecedingMonitorExit(UnwindNode unwind) {
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1250 Node pred = unwind.predecessor();
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1251 while (pred != null) {
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1252 if (pred instanceof MonitorExitNode) {
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1253 return (MonitorExitNode) pred;
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1254 }
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1255 pred = pred.predecessor();
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1256 }
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1257 return null;
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1258 }
3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1259
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1260 /**
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1261 * Performs an actual inlining, thereby replacing the given invoke with the given inlineGraph.
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1262 *
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1263 * @param invoke the invoke that will be replaced
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1264 * @param inlineGraph the graph that the invoke will be replaced with
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1265 * @param receiverNullCheck true if a null check needs to be generated for non-static inlinings,
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1266 * false if no such check is required
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1267 */
7309 75c18356504d Added capability to return the map of dupblicates when inlining a graph. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 7257 diff changeset	1268 public static Map<Node, Node> inline(Invoke invoke, StructuredGraph inlineGraph, boolean receiverNullCheck) {
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1269 NodeInputList<ValueNode> parameters = invoke.callTarget().arguments();
9602 19c5a07c7843 Introduce a graph() method that returns a StructuredGraph, to make many explicit casts unnecessary Christian Wimmer <christian.wimmer@oracle.com> parents: 9470 diff changeset	1270 StructuredGraph graph = invoke.asNode().graph();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1271
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1272 FrameState stateAfter = invoke.stateAfter();
9672 67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1273 assert stateAfter == null \|\| stateAfter.isAlive();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1274
4142 bc8527f3071c Adjust code base to new level of warnings. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 3733 diff changeset	1275 IdentityHashMap<Node, Node> replacements = new IdentityHashMap<>();
bc8527f3071c Adjust code base to new level of warnings. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 3733 diff changeset	1276 ArrayList<Node> nodes = new ArrayList<>();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1277 ReturnNode returnNode = null;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1278 UnwindNode unwindNode = null;
5373 53cc37c27b04 used more specific BeginNode subclass where appropriate Doug Simon <doug.simon@oracle.com> parents: 5365 diff changeset	1279 StartNode entryPointNode = inlineGraph.start();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1280 FixedNode firstCFGNode = entryPointNode.next();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1281 for (Node node : inlineGraph.getNodes()) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1282 if (node == entryPointNode \|\| node == entryPointNode.stateAfter()) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1283 // Do nothing.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1284 } else if (node instanceof LocalNode) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1285 replacements.put(node, parameters.get(((LocalNode) node).index()));
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1286 } else {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1287 nodes.add(node);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1288 if (node instanceof ReturnNode) {
5693 0356d95f01ba While inlining, ensure proper anchoring of things that where anchored to the StartNode Gilles Duboscq <duboscq@ssw.jku.at> parents: 5662 diff changeset	1289 assert returnNode == null;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1290 returnNode = (ReturnNode) node;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1291 } else if (node instanceof UnwindNode) {
5693 0356d95f01ba While inlining, ensure proper anchoring of things that where anchored to the StartNode Gilles Duboscq <duboscq@ssw.jku.at> parents: 5662 diff changeset	1292 assert unwindNode == null;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1293 unwindNode = (UnwindNode) node;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1294 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1295 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1296 }
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	1297 // ensure proper anchoring of things that were anchored to the StartNode
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9434 diff changeset	1298 replacements.put(entryPointNode, AbstractBeginNode.prevBegin(invoke.asNode()));
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1299
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1300 assert invoke.asNode().successors().first() != null : invoke;
5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1301 assert invoke.asNode().predecessor() != null;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1302
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1303 Map<Node, Node> duplicates = graph.addDuplicates(nodes, replacements);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1304 FixedNode firstCFGNodeDuplicate = (FixedNode) duplicates.get(firstCFGNode);
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1305 if (receiverNullCheck) {
defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1306 receiverNullCheck(invoke);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1307 }
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1308 invoke.asNode().replaceAtPredecessor(firstCFGNodeDuplicate);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1309
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1310 FrameState stateAtExceptionEdge = null;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1311 if (invoke instanceof InvokeWithExceptionNode) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1312 InvokeWithExceptionNode invokeWithException = ((InvokeWithExceptionNode) invoke);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1313 if (unwindNode != null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1314 assert unwindNode.predecessor() != null;
4411 cd2b68ef8e23 cleanup around filter and predicates : Gilles Duboscq <duboscq@ssw.jku.at> parents: 4312 diff changeset	1315 assert invokeWithException.exceptionEdge().successors().count() == 1;
8461 6a8ad083746e The exception edge for invokes should still be a DispatchBeginNode to allow lowering of ExceptionObjectNode after guard lowering Gilles Duboscq <duboscq@ssw.jku.at> parents: 8441 diff changeset	1316 ExceptionObjectNode obj = (ExceptionObjectNode) invokeWithException.exceptionEdge();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1317 stateAtExceptionEdge = obj.stateAfter();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1318 UnwindNode unwindDuplicate = (UnwindNode) duplicates.get(unwindNode);
4455 b788ebbb7ef8 cleanup Christian Haeubl <christian.haeubl@oracle.com> parents: 4454 diff changeset	1319 obj.replaceAtUsages(unwindDuplicate.exception());
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1320 unwindDuplicate.clearInputs();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1321 Node n = obj.next();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1322 obj.setNext(null);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1323 unwindDuplicate.replaceAndDelete(n);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1324 } else {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1325 invokeWithException.killExceptionEdge();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1326 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1327 } else {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1328 if (unwindNode != null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1329 UnwindNode unwindDuplicate = (UnwindNode) duplicates.get(unwindNode);
8229 3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1330 MonitorExitNode monitorExit = findPrecedingMonitorExit(unwindDuplicate);
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	1331 DeoptimizeNode deoptimizeNode = new DeoptimizeNode(DeoptimizationAction.InvalidateRecompile, DeoptimizationReason.NotCompiledExceptionHandler);
4339 15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1332 unwindDuplicate.replaceAndDelete(graph.add(deoptimizeNode));
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1333 // move the deopt upwards if there is a monitor exit that tries to use the
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7510 diff changeset	1334 // "after exception" frame state
4339 15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1335 // (because there is no "after exception" frame state!)
8229 3d33975f6497 move test for null exception object passed to unwind operation from stub code to extra HIR Doug Simon <doug.simon@oracle.com> parents: 7901 diff changeset	1336 if (monitorExit != null) {
4339 15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1337 if (monitorExit.stateAfter() != null && monitorExit.stateAfter().bci == FrameState.AFTER_EXCEPTION_BCI) {
15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1338 FrameState monitorFrameState = monitorExit.stateAfter();
15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1339 graph.removeFixed(monitorExit);
15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1340 monitorFrameState.safeDelete();
15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1341 }
15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1342 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1343 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1344 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1345
9672 67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1346 if (stateAfter != null) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1347 FrameState outerFrameState = null;
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1348 int callerLockDepth = stateAfter.nestedLockDepth();
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1349 for (Node node : duplicates.values()) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1350 if (node instanceof FrameState) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1351 FrameState frameState = (FrameState) node;
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1352 assert frameState.bci != FrameState.BEFORE_BCI : frameState;
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1353 if (frameState.bci == FrameState.AFTER_BCI) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1354 frameState.replaceAndDelete(stateAfter);
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1355 } else if (frameState.bci == FrameState.AFTER_EXCEPTION_BCI) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1356 if (frameState.isAlive()) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1357 assert stateAtExceptionEdge != null;
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1358 frameState.replaceAndDelete(stateAtExceptionEdge);
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1359 } else {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1360 assert stateAtExceptionEdge == null;
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1361 }
4339 15ec30809d0f enable UseExceptionProbability by default and fix the InliningUtil to correctly handle FrameState.AFTER_EXCEPTION_BCI for Invokes without an exception edge Lukas Stadler <lukas.stadler@jku.at> parents: 4312 diff changeset	1362 } else {
9672 67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1363 // only handle the outermost frame states
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1364 if (frameState.outerFrameState() == null) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1365 assert frameState.bci == FrameState.INVALID_FRAMESTATE_BCI \|\| frameState.method() == inlineGraph.method();
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1366 if (outerFrameState == null) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1367 outerFrameState = stateAfter.duplicateModified(invoke.bci(), stateAfter.rethrowException(), invoke.asNode().kind());
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1368 outerFrameState.setDuringCall(true);
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1369 }
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1370 frameState.setOuterFrameState(outerFrameState);
6435 9ce24a27f035 fix for InliningUtil (dropped outer frame states while inlining) Lukas Stadler <lukas.stadler@jku.at> parents: 6411 diff changeset	1371 }
4449 d84ccb0cc897 some parts for inlining multiple methods Christian Haeubl <christian.haeubl@oracle.com> parents: 4442 diff changeset	1372 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1373 }
9672 67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1374 if (callerLockDepth != 0 && node instanceof MonitorReference) {
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1375 MonitorReference monitor = (MonitorReference) node;
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1376 monitor.setLockDepth(monitor.getLockDepth() + callerLockDepth);
67804a97c1ce allow inlining of invokes with a null stateAfter Doug Simon <doug.simon@oracle.com> parents: 9610 diff changeset	1377 }
8586 82f6a25321b8 modeling of lock state removed from LIR and runtime specific debug info for locks moved into runtime specific classes Doug Simon <doug.simon@oracle.com> parents: 8469 diff changeset	1378 }
9684 35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1379 } else {
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1380 assert checkContainsOnlyInvalidOrAfterFrameState(duplicates);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1381 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1382 Node returnValue = null;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1383 if (returnNode != null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1384 if (returnNode.result() instanceof LocalNode) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1385 returnValue = replacements.get(returnNode.result());
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1386 } else {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1387 returnValue = duplicates.get(returnNode.result());
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1388 }
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1389 invoke.asNode().replaceAtUsages(returnValue);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1390 Node returnDuplicate = duplicates.get(returnNode);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1391 returnDuplicate.clearInputs();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1392 Node n = invoke.next();
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1393 invoke.setNext(null);
5210 e3e7542d78b7 Loop-closed form GraphBuidling Gilles Duboscq <duboscq@ssw.jku.at> parents: 5160 diff changeset	1394 returnDuplicate.replaceAndDelete(n);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1395 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1396
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1397 invoke.asNode().replaceAtUsages(null);
5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1398 GraphUtil.killCFG(invoke.asNode());
7309 75c18356504d Added capability to return the map of dupblicates when inlining a graph. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 7257 diff changeset	1399
75c18356504d Added capability to return the map of dupblicates when inlining a graph. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 7257 diff changeset	1400 return duplicates;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1401 }
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1402
9684 35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1403 private static boolean checkContainsOnlyInvalidOrAfterFrameState(Map<Node, Node> duplicates) {
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1404 for (Node node : duplicates.values()) {
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1405 if (node instanceof FrameState) {
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1406 FrameState frameState = (FrameState) node;
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1407 assert frameState.bci == FrameState.AFTER_BCI \|\| frameState.bci == FrameState.INVALID_FRAMESTATE_BCI : node.toString(Verbosity.Debugger);
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1408 }
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1409 }
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1410 return true;
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1411 }
35212baf46e5 added check that the graph inlined for an invoke with a null stateAfter contains only frame states whose bci is AFTER_BCI or INVALID_FRAMESTATE_BCI Doug Simon <doug.simon@oracle.com> parents: 9672 diff changeset	1412
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1413 public static void receiverNullCheck(Invoke invoke) {
9147 07f05f2a8149 Remove methodCallTarget() method from the Invoke interface. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 9089 diff changeset	1414 MethodCallTargetNode callTarget = (MethodCallTargetNode) invoke.callTarget();
9602 19c5a07c7843 Introduce a graph() method that returns a StructuredGraph, to make many explicit casts unnecessary Christian Wimmer <christian.wimmer@oracle.com> parents: 9470 diff changeset	1415 StructuredGraph graph = callTarget.graph();
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1416 NodeInputList<ValueNode> parameters = callTarget.arguments();
defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1417 ValueNode firstParam = parameters.size() <= 0 ? null : parameters.get(0);
5540 a891c53a295b Renaming RiKind => Kind. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5510 diff changeset	1418 if (!callTarget.isStatic() && firstParam.kind() == Kind.Object && !firstParam.objectStamp().nonNull()) {
9089 5ab06146e985 Rename "node()" methods in interfaces to "asNode" Gilles Duboscq <duboscq@ssw.jku.at> parents: 9004 diff changeset	1419 graph.addBeforeFixed(invoke.asNode(),
7660 0b646334c5f7 keep track of leafGraphIds only at the StructuredGraph level (see GRAAL-60) Lukas Stadler <lukas.stadler@jku.at> parents: 7558 diff changeset	1420 graph.add(new FixedGuardNode(graph.unique(new IsNullNode(firstParam)), DeoptimizationReason.NullCheckException, DeoptimizationAction.InvalidateReprofile, true)));
4451 defa1b705f14 NullCheck and IsTypeNode were in wrong order Christian Haeubl <christian.haeubl@oracle.com> parents: 4449 diff changeset	1421 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1422 }
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1423
8636 ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	1424 public static boolean canIntrinsify(Replacements replacements, ResolvedJavaMethod target) {
ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	1425 return getIntrinsicGraph(replacements, target) != null \|\| getMacroNodeClass(replacements, target) != null;
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1426 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1427
8636 ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	1428 public static StructuredGraph getIntrinsicGraph(Replacements replacements, ResolvedJavaMethod target) {
8627 75db7afee829 implemented lazy installation of replacements (GRAAL-137) Doug Simon <doug.simon@oracle.com> parents: 8617 diff changeset	1429 return replacements.getMethodSubstitution(target);
7071 b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1430 }
b7da4418a7c3 fixes after merge Christian Haeubl <haeubl@ssw.jku.at> parents: 7070 diff changeset	1431
8636 ac4dbfecec8f passed a Replacements object to inlining utility methods that need one instead of the GraalRuntime API Doug Simon <doug.simon@oracle.com> parents: 8627 diff changeset	1432 public static Class<? extends FixedWithNextNode> getMacroNodeClass(Replacements replacements, ResolvedJavaMethod target) {
8627 75db7afee829 implemented lazy installation of replacements (GRAAL-137) Doug Simon <doug.simon@oracle.com> parents: 8617 diff changeset	1433 return replacements.getMacroSubstitution(target);
7510 225002aba5a5 added new macro node facility, removed ArrayCopyIntrinsificationPhase Lukas Stadler <lukas.stadler@jku.at> parents: 7392 diff changeset	1434 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1435 }

Mercurial > hg > truffle

annotate graal/com.oracle.graal.phases.common/src/com/oracle/graal/phases/common/InliningUtil.java @ 9864:063a712fe8d8