truffle: graal/com.oracle.graal.phases/src/com/oracle/graal/phases/schedule/SchedulePhase.java annotate

annotate graal/com.oracle.graal.phases/src/com/oracle/graal/phases/schedule/SchedulePhase.java @ 9792:06dc2d2324d6

pulled LocationIdentity into a top level class and moved it to the api.meta project

author	Doug Simon <doug.simon@oracle.com>
date	Tue, 21 May 2013 21:46:26 +0200
parents	222461d02a72
children	b4f12c603be5

rev	line source
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	1 /*
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	2 * Copyright (c) 2011, 2011, Oracle and/or its affiliates. All rights reserved.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	4 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	7 * published by the Free Software Foundation.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	8 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	13 * accompanied this code).
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	14 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	18 *
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	21 * questions.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	22 */
6525 2c913b643422 rename packages in graal.phases to match project name Doug Simon <doug.simon@oracle.com> parents: 6522 diff changeset	23 package com.oracle.graal.phases.schedule;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	24
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	25 import java.util.*;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	26
9792 06dc2d2324d6 pulled LocationIdentity into a top level class and moved it to the api.meta project Doug Simon <doug.simon@oracle.com> parents: 9725 diff changeset	27 import com.oracle.graal.api.meta.*;
6500 8fd4201ce98c moved TTY and LogStream to com.oracle.graal.debug Doug Simon <doug.simon@oracle.com> parents: 6411 diff changeset	28 import com.oracle.graal.debug.*;
5060 4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	29 import com.oracle.graal.graph.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	30 import com.oracle.graal.graph.Node.Verbosity;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	31 import com.oracle.graal.nodes.*;
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	32 import com.oracle.graal.nodes.calc.*;
6529 2e96dc4eb8e2 renamed package: com.oracle.graal.lir.cfg -> com.oracle.graal.nodes.cfg Doug Simon <doug.simon@oracle.com> parents: 6526 diff changeset	33 import com.oracle.graal.nodes.cfg.*;
5060 4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	34 import com.oracle.graal.nodes.extended.*;
4ed4295ce15f Update import statements. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 5059 diff changeset	35 import com.oracle.graal.nodes.virtual.*;
6525 2c913b643422 rename packages in graal.phases to match project name Doug Simon <doug.simon@oracle.com> parents: 6522 diff changeset	36 import com.oracle.graal.phases.*;
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	37 import com.oracle.graal.phases.graph.*;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	38 import com.oracle.graal.phases.graph.ReentrantBlockIterator.BlockIteratorClosure;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	39 import com.oracle.graal.phases.graph.ReentrantBlockIterator.LoopInfo;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	40
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	41 public final class SchedulePhase extends Phase {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	42
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	43 /**
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	44 * Error thrown when a graph cannot be scheduled.
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	45 */
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	46 public static class SchedulingError extends Error {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	47
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	48 private static final long serialVersionUID = 1621001069476473145L;
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	49
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	50 public SchedulingError() {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	51 super();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	52 }
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	53
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	54 /**
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	55 * This constructor creates a {@link SchedulingError} with a message assembled via
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	56 * {@link String#format(String, Object...)}.
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	57 *
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	58 * @param format a {@linkplain Formatter format} string
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	59 * @param args parameters to {@link String#format(String, Object...)}
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	60 */
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	61 public SchedulingError(String format, Object... args) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	62 super(String.format(format, args));
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	63 }
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	64
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	65 }
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	66
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	67 public static enum SchedulingStrategy {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	68 EARLIEST, LATEST, LATEST_OUT_OF_LOOPS
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	69 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	70
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	71 /**
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	72 * This closure iterates over all nodes of a scheduled graph (it expects a
8207 ed880b9992b4 Add GuardLoweringPhase which transforms floating guards into fixed if+deopt Gilles Duboscq <duboscq@ssw.jku.at> parents: 7897 diff changeset	73 * {@link SchedulingStrategy#EARLIEST} schedule) and keeps a list of "active" reads. Whenever it
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	74 * encounters a read, it adds it to the active reads. Whenever it encounters a memory
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	75 * checkpoint, it adds all reads that need to be committed before this checkpoint to the
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	76 * "phantom" usages and inputs, so that the read is scheduled before the checkpoint afterwards.
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	77 *
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	78 * At merges, the intersection of all sets of active reads is calculated. A read that was
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	79 * committed within one predecessor branch cannot be scheduled after the merge anyway.
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	80 *
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	81 * Similarly for loops, all reads that are killed somewhere within the loop are removed from the
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	82 * exits' active reads, since they cannot be scheduled after the exit anyway.
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	83 */
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	84 private class MemoryScheduleClosure extends BlockIteratorClosure<HashSet<FloatingReadNode>> {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	85
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	86 @Override
9624 87eafaddf9d9 let ReentrantBlockIterator.processBlock return the next state Lukas Stadler <lukas.stadler@jku.at> parents: 9526 diff changeset	87 protected HashSet<FloatingReadNode> processBlock(Block block, HashSet<FloatingReadNode> currentState) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	88 for (Node node : getBlockToNodesMap().get(block)) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	89 if (node instanceof FloatingReadNode) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	90 currentState.add((FloatingReadNode) node);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	91 } else if (node instanceof MemoryCheckpoint) {
9526 ae5cd887e67c Use a LocationIdentity interface instead of just Object for the location identity of a LocationNode Christian Wimmer <christian.wimmer@oracle.com> parents: 9525 diff changeset	92 for (LocationIdentity identity : ((MemoryCheckpoint) node).getLocationIdentities()) {
8394 7aefc149c471 allow multiple identities in MemoryCheckpoint interface Lukas Stadler <lukas.stadler@jku.at> parents: 8330 diff changeset	93 for (Iterator<FloatingReadNode> iter = currentState.iterator(); iter.hasNext();) {
7aefc149c471 allow multiple identities in MemoryCheckpoint interface Lukas Stadler <lukas.stadler@jku.at> parents: 8330 diff changeset	94 FloatingReadNode read = iter.next();
7aefc149c471 allow multiple identities in MemoryCheckpoint interface Lukas Stadler <lukas.stadler@jku.at> parents: 8330 diff changeset	95 FixedNode fixed = (FixedNode) node;
9792 06dc2d2324d6 pulled LocationIdentity into a top level class and moved it to the api.meta project Doug Simon <doug.simon@oracle.com> parents: 9725 diff changeset	96 if (identity == LocationIdentity.ANY_LOCATION \|\| read.location().getLocationIdentity() == identity) {
8394 7aefc149c471 allow multiple identities in MemoryCheckpoint interface Lukas Stadler <lukas.stadler@jku.at> parents: 8330 diff changeset	97 addPhantomReference(read, fixed);
9725 222461d02a72 removed killed reads from list in memory aware scheduling Lukas Stadler <lukas.stadler@jku.at> parents: 9624 diff changeset	98 iter.remove();
8394 7aefc149c471 allow multiple identities in MemoryCheckpoint interface Lukas Stadler <lukas.stadler@jku.at> parents: 8330 diff changeset	99 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	100 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	101 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	102 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	103 }
9624 87eafaddf9d9 let ReentrantBlockIterator.processBlock return the next state Lukas Stadler <lukas.stadler@jku.at> parents: 9526 diff changeset	104 return currentState;
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	105 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	106
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	107 public void addPhantomReference(FloatingReadNode read, FixedNode fixed) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	108 List<FixedNode> usageList = phantomUsages.get(read);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	109 if (usageList == null) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	110 phantomUsages.put(read, usageList = new ArrayList<>());
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	111 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	112 usageList.add(fixed);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	113 List<FloatingNode> inputList = phantomInputs.get(fixed);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	114 if (inputList == null) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	115 phantomInputs.put(fixed, inputList = new ArrayList<>());
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	116 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	117 inputList.add(read);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	118 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	119
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	120 @Override
8920 4aa5f76a0579 small change to ReentrantBlockIterator interface Lukas Stadler <lukas.stadler@jku.at> parents: 8542 diff changeset	121 protected HashSet<FloatingReadNode> merge(Block merge, List<HashSet<FloatingReadNode>> states) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	122 HashSet<FloatingReadNode> state = new HashSet<>(states.get(0));
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	123 for (int i = 1; i < states.size(); i++) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	124 state.retainAll(states.get(i));
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	125 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	126 return state;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	127 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	128
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	129 @Override
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	130 protected HashSet<FloatingReadNode> cloneState(HashSet<FloatingReadNode> oldState) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	131 return new HashSet<>(oldState);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	132 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	133
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	134 @Override
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	135 protected List<HashSet<FloatingReadNode>> processLoop(Loop loop, HashSet<FloatingReadNode> state) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	136 LoopInfo<HashSet<FloatingReadNode>> info = ReentrantBlockIterator.processLoop(this, loop, new HashSet<>(state));
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	137
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	138 List<HashSet<FloatingReadNode>> loopEndStates = info.endStates;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	139
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	140 // collect all reads that were killed in some branch within the loop
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	141 Set<FloatingReadNode> killedReads = new HashSet<>(state);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	142 Set<FloatingReadNode> survivingReads = new HashSet<>(loopEndStates.get(0));
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	143 for (int i = 1; i < loopEndStates.size(); i++) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	144 survivingReads.retainAll(loopEndStates.get(i));
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	145 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	146 killedReads.removeAll(survivingReads);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	147
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	148 // reads that were killed within the loop cannot be scheduled after the loop anyway
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	149 for (HashSet<FloatingReadNode> exitState : info.exitStates) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	150 exitState.removeAll(killedReads);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	151 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	152 return info.exitStates;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	153 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	154 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	155
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	156 private ControlFlowGraph cfg;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	157 private NodeMap<Block> earliestCache;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	158
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	159 /**
066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	160 * Map from blocks to the nodes in each block.
066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	161 */
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	162 private BlockMap<List<ScheduledNode>> blockToNodesMap;
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	163 private final Map<FloatingNode, List<FixedNode>> phantomUsages = new IdentityHashMap<>();
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	164 private final Map<FixedNode, List<FloatingNode>> phantomInputs = new IdentityHashMap<>();
8330 022ae20329fb Rename field. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8325 diff changeset	165 private final SchedulingStrategy selectedStrategy;
8325 330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	166
330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	167 public SchedulePhase() {
330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	168 this(GraalOptions.OptScheduleOutOfLoops ? SchedulingStrategy.LATEST_OUT_OF_LOOPS : SchedulingStrategy.LATEST);
330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	169 }
330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	170
330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	171 public SchedulePhase(SchedulingStrategy strategy) {
8330 022ae20329fb Rename field. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8325 diff changeset	172 this.selectedStrategy = strategy;
8325 330b455f18be Make scheduling phase customizable. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8323 diff changeset	173 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	174
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	175 @Override
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	176 protected void run(StructuredGraph graph) {
9413 4f8b7dc2766d SchedulePhase: compute post-dominators in CFG-graph Bernhard Urban <bernhard.urban@jku.at> parents: 8957 diff changeset	177 cfg = ControlFlowGraph.compute(graph, true, true, true, true);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	178 earliestCache = graph.createNodeMap();
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	179 blockToNodesMap = new BlockMap<>(cfg);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	180
8330 022ae20329fb Rename field. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8325 diff changeset	181 if (GraalOptions.MemoryAwareScheduling && selectedStrategy != SchedulingStrategy.EARLIEST && graph.getNodes(FloatingReadNode.class).isNotEmpty()) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	182
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	183 assignBlockToNodes(graph, SchedulingStrategy.EARLIEST);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	184 sortNodesWithinBlocks(graph, SchedulingStrategy.EARLIEST);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	185
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	186 MemoryScheduleClosure closure = new MemoryScheduleClosure();
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	187 ReentrantBlockIterator.apply(closure, getCFG().getStartBlock(), new HashSet<FloatingReadNode>(), null);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	188
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	189 cfg.clearNodeToBlock();
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	190 blockToNodesMap = new BlockMap<>(cfg);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	191 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	192
8330 022ae20329fb Rename field. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8325 diff changeset	193 assignBlockToNodes(graph, selectedStrategy);
022ae20329fb Rename field. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8325 diff changeset	194 sortNodesWithinBlocks(graph, selectedStrategy);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	195 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	196
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	197 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	198 * Sets {@link ScheduledNode#scheduledNext} on all scheduled nodes in all blocks using the
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	199 * scheduling built by {@link #run(StructuredGraph)}. This method should thus only be called
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	200 * when run has been successfully executed.
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	201 */
4647 b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	202 public void scheduleGraph() {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	203 assert blockToNodesMap != null : "cannot set scheduledNext before run has been executed";
4647 b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	204 for (Block block : cfg.getBlocks()) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	205 List<ScheduledNode> nodeList = blockToNodesMap.get(block);
4647 b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	206 ScheduledNode last = null;
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	207 for (ScheduledNode node : nodeList) {
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	208 if (last != null) {
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	209 last.setScheduledNext(node);
4647 b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	210 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	211 last = node;
4647 b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	212 }
b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	213 }
b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	214 }
b32ccf2376d2 experimental: scheduling and unscheduling of the whole graph Lukas Stadler <lukas.stadler@jku.at> parents: 4629 diff changeset	215
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	216 public ControlFlowGraph getCFG() {
57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	217 return cfg;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	218 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	219
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	220 /**
066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	221 * Gets the map from each block to the nodes in the block.
066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	222 */
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	223 public BlockMap<List<ScheduledNode>> getBlockToNodesMap() {
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	224 return blockToNodesMap;
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	225 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	226
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	227 /**
066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	228 * Gets the nodes in a given block.
066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	229 */
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	230 public List<ScheduledNode> nodesFor(Block block) {
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	231 return blockToNodesMap.get(block);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	232 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	233
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	234 private void assignBlockToNodes(StructuredGraph graph, SchedulingStrategy strategy) {
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	235 for (Block block : cfg.getBlocks()) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	236 List<ScheduledNode> nodes = new ArrayList<>();
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	237 if (blockToNodesMap.get(block) != null) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	238 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	239 }
5248 066f1687ba24 rename: nodesFor -> blockToNodesMap Doug Simon <doug.simon@oracle.com> parents: 5210 diff changeset	240 blockToNodesMap.put(block, nodes);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	241 for (FixedNode node : block.getNodes()) {
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	242 nodes.add(node);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	243 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	244 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	245
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	246 for (Node n : graph.getNodes()) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	247 if (n instanceof ScheduledNode) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	248 assignBlockToNode((ScheduledNode) n, strategy);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	249 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	250 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	251 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	252
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	253 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	254 * Assigns a block to the given node. This method expects that PhiNodes and FixedNodes are
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	255 * already assigned to a block.
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	256 */
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	257 private void assignBlockToNode(ScheduledNode node, SchedulingStrategy strategy) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	258 assert !node.isDeleted();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	259
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	260 Block prevBlock = cfg.getNodeToBlock().get(node);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	261 if (prevBlock != null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	262 return;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	263 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	264 // PhiNodes and FixedNodes should already have been placed in blocks by
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	265 // ControlFlowGraph.identifyBlocks
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	266 if (node instanceof PhiNode \|\| node instanceof FixedNode) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	267 throw new SchedulingError("%s should already have been placed in a block", node);
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	268 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	269
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	270 Block block;
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	271 switch (strategy) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	272 case EARLIEST:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	273 block = earliestBlock(node);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	274 break;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	275 case LATEST:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	276 case LATEST_OUT_OF_LOOPS:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	277 block = latestBlock(node, strategy);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	278 if (block == null) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	279 block = earliestBlock(node);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	280 } else if (strategy == SchedulingStrategy.LATEST_OUT_OF_LOOPS && !(node instanceof VirtualObjectNode)) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	281 // schedule at the latest position possible in the outermost loop possible
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	282 Block earliestBlock = earliestBlock(node);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	283 block = scheduleOutOfLoops(node, block, earliestBlock);
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	284 if (!earliestBlock.dominates(block)) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	285 throw new SchedulingError("%s: Graph cannot be scheduled : inconsistent for %s, %d usages, (%s needs to dominate %s)", node.graph(), node, node.usages().count(),
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	286 earliestBlock, block);
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	287 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	288 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	289 break;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	290 default:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	291 throw new GraalInternalError("unknown scheduling strategy");
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	292 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	293 cfg.getNodeToBlock().set(node, block);
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	294 blockToNodesMap.get(block).add(node);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	295 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	296
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	297 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	298 * Calculates the last block that the given node could be scheduled in, i.e., the common
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	299 * dominator of all usages. To do so all usages are also assigned to blocks.
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	300 *
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	301 * @param strategy
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	302 */
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	303 private Block latestBlock(ScheduledNode node, SchedulingStrategy strategy) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	304 CommonDominatorBlockClosure cdbc = new CommonDominatorBlockClosure(null);
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	305 for (Node succ : node.successors().nonNull()) {
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	306 if (cfg.getNodeToBlock().get(succ) == null) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	307 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	308 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	309 cdbc.apply(cfg.getNodeToBlock().get(succ));
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	310 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	311 ensureScheduledUsages(node, strategy);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	312 for (Node usage : node.usages()) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	313 blocksForUsage(node, usage, cdbc, strategy);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	314 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	315 List<FixedNode> usages = phantomUsages.get(node);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	316 if (usages != null) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	317 for (FixedNode usage : usages) {
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	318 if (cfg.getNodeToBlock().get(usage) == null) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	319 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	320 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	321 cdbc.apply(cfg.getNodeToBlock().get(usage));
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	322 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	323 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	324
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	325 return cdbc.block;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	326 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	327
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	328 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	329 * A closure that will calculate the common dominator of all blocks passed to its
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	330 * {@link #apply(Block)} method.
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	331 */
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	332 private static class CommonDominatorBlockClosure implements BlockClosure {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	333
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	334 public Block block;
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	335
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	336 public CommonDominatorBlockClosure(Block block) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	337 this.block = block;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	338 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	339
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	340 @Override
4142 bc8527f3071c Adjust code base to new level of warnings. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 3733 diff changeset	341 public void apply(Block newBlock) {
bc8527f3071c Adjust code base to new level of warnings. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 3733 diff changeset	342 this.block = getCommonDominator(this.block, newBlock);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	343 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	344 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	345
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	346 /**
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	347 * Determines the earliest block in which the given node can be scheduled.
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	348 */
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	349 private Block earliestBlock(Node node) {
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	350 Block earliest = cfg.getNodeToBlock().get(node);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	351 if (earliest != null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	352 return earliest;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	353 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	354 earliest = earliestCache.get(node);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	355 if (earliest != null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	356 return earliest;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	357 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	358 /*
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	359 * All inputs must be in a dominating block, otherwise the graph cannot be scheduled. This
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	360 * implies that the inputs' blocks have a total ordering via their dominance relation. So in
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	361 * order to find the earliest block placement for this node we need to find the input block
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	362 * that is dominated by all other input blocks.
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	363 *
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	364 * While iterating over the inputs a set of dominator blocks of the current earliest
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	365 * placement is maintained. When the block of an input is not within this set, it becomes
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	366 * the current earliest placement and the list of dominator blocks is updated.
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	367 */
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	368 BitSet dominators = new BitSet(cfg.getBlocks().length);
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	369
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	370 if (node.predecessor() != null) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	371 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	372 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	373 for (Node input : node.inputs().nonNull()) {
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	374 assert input instanceof ValueNode;
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	375 Block inputEarliest;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	376 if (input instanceof InvokeWithExceptionNode) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	377 inputEarliest = cfg.getNodeToBlock().get(((InvokeWithExceptionNode) input).next());
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	378 } else {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	379 inputEarliest = earliestBlock(input);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	380 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	381 if (!dominators.get(inputEarliest.getId())) {
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	382 earliest = inputEarliest;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	383 do {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	384 dominators.set(inputEarliest.getId());
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	385 inputEarliest = inputEarliest.getDominator();
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	386 } while (inputEarliest != null && !dominators.get(inputEarliest.getId()));
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	387 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	388 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	389 if (earliest == null) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	390 earliest = cfg.getStartBlock();
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	391 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	392 earliestCache.set(node, earliest);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	393 return earliest;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	394 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	395
4142 bc8527f3071c Adjust code base to new level of warnings. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 3733 diff changeset	396 private static Block scheduleOutOfLoops(Node n, Block latestBlock, Block earliest) {
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	397 if (latestBlock == null) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	398 throw new SchedulingError("no latest : %s", n);
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	399 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	400 Block cur = latestBlock;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	401 Block result = latestBlock;
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	402 while (cur.getLoop() != null && cur != earliest && cur.getDominator() != null) {
57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	403 Block dom = cur.getDominator();
57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	404 if (dom.getLoopDepth() < result.getLoopDepth()) {
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	405 result = dom;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	406 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	407 cur = dom;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	408 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	409 return result;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	410 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	411
5583 8f529640e430 fix to SchedulePhase: correctly handle outer frame states that take a phi from the Lukas Stadler <lukas.stadler@jku.at> parents: 5541 diff changeset	412 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	413 * Passes all blocks that a specific usage of a node is in to a given closure. This is more
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	414 * complex than just taking the usage's block because of of PhiNodes and FrameStates.
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	415 *
5583 8f529640e430 fix to SchedulePhase: correctly handle outer frame states that take a phi from the Lukas Stadler <lukas.stadler@jku.at> parents: 5541 diff changeset	416 * @param node the node that needs to be scheduled
8f529640e430 fix to SchedulePhase: correctly handle outer frame states that take a phi from the Lukas Stadler <lukas.stadler@jku.at> parents: 5541 diff changeset	417 * @param usage the usage whose blocks need to be considered
8f529640e430 fix to SchedulePhase: correctly handle outer frame states that take a phi from the Lukas Stadler <lukas.stadler@jku.at> parents: 5541 diff changeset	418 * @param closure the closure that will be called for each block
8f529640e430 fix to SchedulePhase: correctly handle outer frame states that take a phi from the Lukas Stadler <lukas.stadler@jku.at> parents: 5541 diff changeset	419 */
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	420 private void blocksForUsage(ScheduledNode node, Node usage, BlockClosure closure, SchedulingStrategy strategy) {
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	421 if (node instanceof PhiNode) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	422 throw new SchedulingError(node.toString());
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	423 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	424
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	425 if (usage instanceof PhiNode) {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	426 // An input to a PhiNode is used at the end of the predecessor block that corresponds to
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	427 // the PhiNode input.
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	428 // One PhiNode can use an input multiple times, the closure will be called for each
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	429 // usage.
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	430 PhiNode phi = (PhiNode) usage;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	431 MergeNode merge = phi.merge();
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	432 Block mergeBlock = cfg.getNodeToBlock().get(merge);
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	433 if (mergeBlock == null) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	434 throw new SchedulingError("no block for merge %s", merge.toString(Verbosity.Id));
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	435 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	436 for (int i = 0; i < phi.valueCount(); ++i) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	437 if (phi.valueAt(i) == node) {
7499 ca3e5df0e6cf Small clean up of access to predecessor/successor of blocks. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 6670 diff changeset	438 if (mergeBlock.getPredecessorCount() <= i) {
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	439 TTY.println(merge.toString());
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	440 TTY.println(phi.toString());
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	441 TTY.println(merge.cfgPredecessors().toString());
4614 a3882fd1ae61 Make it possible to have multiple LoopEnds per LoopBegin Gilles Duboscq <duboscq@ssw.jku.at> parents: 4525 diff changeset	442 TTY.println(mergeBlock.getPredecessors().toString());
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	443 TTY.println(phi.inputs().toString());
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	444 TTY.println("value count: " + phi.valueCount());
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	445 }
4614 a3882fd1ae61 Make it possible to have multiple LoopEnds per LoopBegin Gilles Duboscq <duboscq@ssw.jku.at> parents: 4525 diff changeset	446 closure.apply(mergeBlock.getPredecessors().get(i));
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	447 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	448 }
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	449 } else if (usage instanceof VirtualState) {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	450 // The following logic does not work if node is a PhiNode, but this method is never
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	451 // called for PhiNodes.
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	452 for (Node unscheduledUsage : usage.usages()) {
a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	453 if (unscheduledUsage instanceof VirtualState) {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	454 // If a FrameState is an outer FrameState this method behaves as if the inner
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	455 // FrameState was the actual usage, by recursing.
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	456 blocksForUsage(node, unscheduledUsage, closure, strategy);
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	457 } else if (unscheduledUsage instanceof MergeNode) {
a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	458 // Only FrameStates can be connected to MergeNodes.
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	459 if (!(usage instanceof FrameState)) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	460 throw new SchedulingError(usage.toString());
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	461 }
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	462 // If a FrameState belongs to a MergeNode then it's inputs will be placed at the
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	463 // common dominator of all EndNodes.
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	464 for (Node pred : unscheduledUsage.cfgPredecessors()) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	465 closure.apply(cfg.getNodeToBlock().get(pred));
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	466 }
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	467 } else {
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	468 // For the time being, only FrameStates can be connected to StateSplits.
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	469 if (!(usage instanceof FrameState)) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	470 throw new SchedulingError(usage.toString());
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	471 }
8957 1af9b5d75139 Move framestate assignement to the hir Gilles Duboscq <duboscq@ssw.jku.at> parents: 8950 diff changeset	472 if (!(unscheduledUsage instanceof StateSplit \|\| unscheduledUsage instanceof DeoptimizingNode)) {
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	473 throw new SchedulingError(unscheduledUsage.toString());
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	474 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	475 // Otherwise: Put the input into the same block as the usage.
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	476 assignBlockToNode((ScheduledNode) unscheduledUsage, strategy);
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	477 closure.apply(cfg.getNodeToBlock().get(unscheduledUsage));
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	478 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	479 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	480 } else {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	481 // All other types of usages: Put the input into the same block as the usage.
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	482 assignBlockToNode((ScheduledNode) usage, strategy);
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	483 closure.apply(cfg.getNodeToBlock().get(usage));
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	484 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	485 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	486
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	487 private void ensureScheduledUsages(Node node, SchedulingStrategy strategy) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	488 for (Node usage : node.usages().filter(ScheduledNode.class)) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	489 assignBlockToNode((ScheduledNode) usage, strategy);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	490 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	491 // now true usages are ready
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	492 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	493
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	494 private static Block getCommonDominator(Block a, Block b) {
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	495 if (a == null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	496 return b;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	497 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	498 if (b == null) {
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	499 return a;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	500 }
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	501 return ControlFlowGraph.commonDominator(a, b);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	502 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	503
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	504 private void sortNodesWithinBlocks(StructuredGraph graph, SchedulingStrategy strategy) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	505 NodeBitMap visited = graph.createNodeBitMap();
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	506 for (Block b : cfg.getBlocks()) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	507 sortNodesWithinBlock(b, visited, strategy);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	508 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	509 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	510
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	511 private void sortNodesWithinBlock(Block b, NodeBitMap visited, SchedulingStrategy strategy) {
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	512 if (visited.isMarked(b.getBeginNode()) \|\| cfg.blockFor(b.getBeginNode()) != b) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	513 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	514 }
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	515 if (visited.isMarked(b.getEndNode()) \|\| cfg.blockFor(b.getEndNode()) != b) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	516 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	517 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	518
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	519 List<ScheduledNode> sortedInstructions;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	520 switch (strategy) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	521 case EARLIEST:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	522 sortedInstructions = sortNodesWithinBlockEarliest(b, visited);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	523 break;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	524 case LATEST:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	525 case LATEST_OUT_OF_LOOPS:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	526 sortedInstructions = sortNodesWithinBlockLatest(b, visited);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	527 break;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	528 default:
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	529 throw new GraalInternalError("unknown scheduling strategy");
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	530 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	531 blockToNodesMap.put(b, sortedInstructions);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	532 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	533
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	534 /**
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	535 * Sorts the nodes within a block by adding the nodes to a list in a post-order iteration over
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	536 * all inputs. This means that a node is added to the list after all its inputs have been
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	537 * processed.
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	538 */
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	539 private List<ScheduledNode> sortNodesWithinBlockLatest(Block b, NodeBitMap visited) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	540 List<ScheduledNode> instructions = blockToNodesMap.get(b);
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	541 List<ScheduledNode> sortedInstructions = new ArrayList<>(blockToNodesMap.get(b).size() + 2);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	542
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	543 for (ScheduledNode i : instructions) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	544 addToLatestSorting(b, i, sortedInstructions, visited);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	545 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	546
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	547 // Make sure that last node gets really last (i.e. when a frame state successor hangs off
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	548 // it).
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	549 Node lastSorted = sortedInstructions.get(sortedInstructions.size() - 1);
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	550 if (lastSorted != b.getEndNode()) {
57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	551 int idx = sortedInstructions.indexOf(b.getEndNode());
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	552 boolean canNotMove = false;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	553 for (int i = idx + 1; i < sortedInstructions.size(); i++) {
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	554 if (sortedInstructions.get(i).inputs().contains(b.getEndNode())) {
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	555 canNotMove = true;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	556 break;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	557 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	558 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	559 if (canNotMove) {
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	560 if (b.getEndNode() instanceof ControlSplitNode) {
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	561 throw new GraalInternalError("Schedule is not possible : needs to move a node after the last node of the block which can not be move").addContext(lastSorted).addContext(
5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	562 b.getEndNode());
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	563 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	564
7530 5e3d1a68664e applied mx eclipseformat to all Java files Doug Simon <doug.simon@oracle.com> parents: 7499 diff changeset	565 // b.setLastNode(lastSorted);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	566 } else {
4435 57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	567 sortedInstructions.remove(b.getEndNode());
57cb8ec5f6bb Restructure block and control flow graph data structures Christian Wimmer <Christian.Wimmer@Oracle.com> parents: 4413 diff changeset	568 sortedInstructions.add(b.getEndNode());
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	569 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	570 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	571 return sortedInstructions;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	572 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	573
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	574 private void addUnscheduledToLatestSorting(Block b, VirtualState state, List<ScheduledNode> sortedInstructions, NodeBitMap visited) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	575 if (state != null) {
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	576 // UnscheduledNodes should never be marked as visited.
8950 43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	577 if (visited.isMarked(state)) {
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	578 throw new SchedulingError();
43fb04e78250 modified (some) checks in SchedulePhase to raise a SchedulingError instead of an AssertionError Doug Simon <doug.simon@oracle.com> parents: 8920 diff changeset	579 }
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	580
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	581 for (Node input : state.inputs()) {
5598 a9b615da0cba removed delta-encoding of VirtualObjectState Lukas Stadler <lukas.stadler@jku.at> parents: 5591 diff changeset	582 if (input instanceof VirtualState) {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	583 addUnscheduledToLatestSorting(b, (VirtualState) input, sortedInstructions, visited);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	584 } else {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	585 addToLatestSorting(b, (ScheduledNode) input, sortedInstructions, visited);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	586 }
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	587 }
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	588 }
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	589 }
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	590
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	591 private void addToLatestSorting(Block b, ScheduledNode i, List<ScheduledNode> sortedInstructions, NodeBitMap visited) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	592 if (i == null \|\| visited.isMarked(i) \|\| cfg.getNodeToBlock().get(i) != b \|\| i instanceof PhiNode \|\| i instanceof LocalNode) {
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	593 return;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	594 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	595
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	596 FrameState state = null;
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	597 WriteNode write = null;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	598 for (Node input : i.inputs()) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	599 if (input instanceof WriteNode && !visited.isMarked(input) && cfg.getNodeToBlock().get(input) == b) {
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	600 assert write == null;
d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	601 write = (WriteNode) input;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	602 } else if (input instanceof FrameState) {
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	603 assert state == null;
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	604 state = (FrameState) input;
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	605 } else {
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	606 addToLatestSorting(b, (ScheduledNode) input, sortedInstructions, visited);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	607 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	608 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	609 List<FloatingNode> inputs = phantomInputs.get(i);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	610 if (inputs != null) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	611 for (FloatingNode input : inputs) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	612 addToLatestSorting(b, input, sortedInstructions, visited);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	613 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	614 }
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	615
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	616 addToLatestSorting(b, (ScheduledNode) i.predecessor(), sortedInstructions, visited);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	617 visited.mark(i);
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	618 addUnscheduledToLatestSorting(b, state, sortedInstructions, visited);
5591 d52edd1af4c4 SchedulePhase doesn't schedule FrameStates, added documentation, cleanups Lukas Stadler <lukas.stadler@jku.at> parents: 5583 diff changeset	619 assert write == null \|\| !visited.isMarked(write);
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	620 addToLatestSorting(b, write, sortedInstructions, visited);
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	621
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	622 // Now predecessors and inputs are scheduled => we can add this node.
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	623 sortedInstructions.add(i);
e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	624 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	625
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	626 /**
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	627 * Sorts the nodes within a block by adding the nodes to a list in a post-order iteration over
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	628 * all usages. The resulting list is reversed to create an earliest-possible scheduling of
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	629 * nodes.
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	630 */
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	631 private List<ScheduledNode> sortNodesWithinBlockEarliest(Block b, NodeBitMap visited) {
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	632 List<ScheduledNode> sortedInstructions = new ArrayList<>(blockToNodesMap.get(b).size() + 2);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	633 addToEarliestSorting(b, b.getEndNode(), sortedInstructions, visited);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	634 Collections.reverse(sortedInstructions);
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	635 return sortedInstructions;
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	636 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	637
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	638 private void addToEarliestSorting(Block b, ScheduledNode i, List<ScheduledNode> sortedInstructions, NodeBitMap visited) {
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	639 ScheduledNode instruction = i;
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	640 while (true) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	641 if (instruction == null \|\| visited.isMarked(instruction) \|\| cfg.getNodeToBlock().get(instruction) != b \|\| instruction instanceof PhiNode \|\| instruction instanceof LocalNode) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	642 return;
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	643 }
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	644
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	645 visited.mark(instruction);
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	646 for (Node usage : instruction.usages()) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	647 if (usage instanceof VirtualState) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	648 // only fixed nodes can have VirtualState -> no need to schedule them
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	649 } else {
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	650 if (instruction instanceof LoopExitNode && usage instanceof ProxyNode) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	651 // value proxies should be scheduled before the loopexit, not after
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	652 } else {
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	653 addToEarliestSorting(b, (ScheduledNode) usage, sortedInstructions, visited);
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	654 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	655 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	656 }
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	657
9436 ae815a4c112a Rename BeginNode => AbstractBeginNode and make abstract. Introduce concrete subclass BeginNode. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: 8957 diff changeset	658 if (instruction instanceof AbstractBeginNode) {
8542 30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	659 ArrayList<ProxyNode> proxies = (instruction instanceof LoopExitNode) ? new ArrayList<ProxyNode>() : null;
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	660 for (ScheduledNode inBlock : blockToNodesMap.get(b)) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	661 if (!visited.isMarked(inBlock)) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	662 if (inBlock instanceof ProxyNode) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	663 proxies.add((ProxyNode) inBlock);
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	664 } else {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	665 addToEarliestSorting(b, inBlock, sortedInstructions, visited);
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	666 }
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	667 }
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	668 }
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	669 sortedInstructions.add(instruction);
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	670 if (proxies != null) {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	671 sortedInstructions.addAll(proxies);
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	672 }
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	673 break;
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	674 } else {
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	675 sortedInstructions.add(instruction);
30a141944bcb tail recursion for SchedulePhase.addToEarliestSorting (fixes StackOverflowErrors) Lukas Stadler <lukas.stadler@jku.at> parents: 8394 diff changeset	676 instruction = (ScheduledNode) instruction.predecessor();
7871 886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	677 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	678 }
886990f21773 memory-aware scheduling phase Lukas Stadler <lukas.stadler@jku.at> parents: 7530 diff changeset	679 }
3733 e233f5660da4 Added Java files from Maxine project. Thomas Wuerthinger <thomas.wuerthinger@oracle.com> parents: diff changeset	680 }

Mercurial > hg > truffle

annotate graal/com.oracle.graal.phases/src/com/oracle/graal/phases/schedule/SchedulePhase.java @ 9792:06dc2d2324d6