graal-compiler: graal/com.oracle.graal.hotspot/src/com/oracle/graal/hotspot/snippets/MonitorSnippets.java annotate

author	Doug Simon <doug.simon@oracle.com>
date	Thu, 13 Sep 2012 17:43:18 +0200
parents
children	2d84f74e394c

rev	line source
6386 abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	1 /*
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	2 * Copyright (c) 2012, Oracle and/or its affiliates. All rights reserved.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	4 *
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	7 * published by the Free Software Foundation.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	8 *
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	13 * accompanied this code).
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	14 *
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	18 *
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	21 * questions.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	22 */
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	23 package com.oracle.graal.hotspot.snippets;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	24
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	25 import static com.oracle.graal.hotspot.nodes.BeginLockScopeNode.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	26 import static com.oracle.graal.hotspot.nodes.DirectCompareAndSwapNode.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	27 import static com.oracle.graal.hotspot.nodes.EndLockScopeNode.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	28 import static com.oracle.graal.hotspot.nodes.RegisterNode.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	29 import static com.oracle.graal.hotspot.snippets.HotSpotSnippetUtils.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	30 import static com.oracle.graal.nodes.extended.UnsafeLoadNode.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	31 import static com.oracle.graal.snippets.SnippetTemplate.Arguments.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	32 import static com.oracle.graal.snippets.nodes.DirectObjectStoreNode.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	33
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	34 import java.util.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	35
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	36 import com.oracle.graal.api.code.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	37 import com.oracle.graal.api.meta.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	38 import com.oracle.graal.graph.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	39 import com.oracle.graal.hotspot.nodes.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	40 import com.oracle.graal.nodes.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	41 import com.oracle.graal.nodes.java.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	42 import com.oracle.graal.nodes.spi.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	43 import com.oracle.graal.snippets.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	44 import com.oracle.graal.snippets.Snippet.*;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	45 import com.oracle.graal.snippets.SnippetTemplate.AbstractTemplates;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	46 import com.oracle.graal.snippets.SnippetTemplate.Arguments;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	47 import com.oracle.graal.snippets.SnippetTemplate.Key;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	48
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	49 /**
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	50 * Snippets used for implementing the monitorenter and monitorexit instructions.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	51 *
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	52 * The locking algorithm used is described in the paper <a href="http://dl.acm.org/citation.cfm?id=1167515.1167496">
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	53 * Eliminating synchronization-related atomic operations with biased locking and bulk rebiasing</a>
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	54 * by Kenneth Russell and David Detlefs.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	55 */
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	56 public class MonitorSnippets implements SnippetsInterface {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	57
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	58 private static final boolean LOG = Boolean.getBoolean("graal.monitorsnippets.log");
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	59
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	60 private static void log(String action, Object object) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	61 if (LOG) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	62 Log.print(action);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	63 Log.print(' ');
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	64 Log.printlnAddress(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	65 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	66 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	67
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	68 @Snippet
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	69 public static void monitorenter(@Parameter("object") Object object) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	70 verifyOop(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	71
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	72 // Load the mark word - this includes a null-check on object
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	73 final Word mark = asWord(loadObject(object, 0, markOffset(), false));
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	74
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	75 final Word lock = beginLockScope(object, false, wordKind());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	76
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	77 if (useBiasedLocking()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	78 // See whether the lock is currently biased toward our thread and
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	79 // whether the epoch is still valid.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	80 // Note that the runtime guarantees sufficient alignment of JavaThread
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	81 // pointers to allow age to be placed into low bits.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	82 final Word biasedLockMark = mark.and(biasedLockMaskInPlace());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	83
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	84 // First check to see whether biasing is enabled for this object
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	85 if (biasedLockMark.toLong() != biasedLockPattern()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	86 // Biasing not enabled -> fall through to lightweight locking
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	87 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	88 // The bias pattern is present in the object's mark word. Need to check
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	89 // whether the bias owner and the epoch are both still current.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	90 Object hub = loadHub(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	91 final Word prototypeMarkWord = asWord(loadObject(hub, 0, prototypeMarkWordOffset(), true));
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	92 final Word thread = asWord(register(threadReg(), wordKind()));
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	93 final Word tmp = prototypeMarkWord.or(thread).xor(mark).and(~ageMaskInPlace());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	94 if (tmp == Word.zero()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	95 // Object is already biased to current thread -> done
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	96 log("+lock{bias}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	97 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	98 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	99
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	100 // At this point we know that the mark word has the bias pattern and
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	101 // that we are not the bias owner in the current epoch. We need to
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	102 // figure out more details about the state of the mark word in order to
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	103 // know what operations can be legally performed on the object's
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	104 // mark word.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	105 if (tmp.and(biasedLockMaskInPlace()) == Word.zero()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	106 // Biasing is still enabled for object's type. See whether the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	107 // epoch of the current bias is still valid, meaning that the epoch
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	108 // bits of the mark word are equal to the epoch bits of the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	109 // prototype mark word. (Note that the prototype mark word's epoch bits
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	110 // only change at a safepoint.) If not, attempt to rebias the object
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	111 // toward the current thread. Note that we must be absolutely sure
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	112 // that the current epoch is invalid in order to do this because
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	113 // otherwise the manipulations it performs on the mark word are
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	114 // illegal.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	115 if (tmp.and(epochMaskInPlace()) != Word.zero()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	116 // The epoch of the current bias is still valid but we know nothing
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	117 // about the owner; it might be set or it might be clear. Try to
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	118 // acquire the bias of the object using an atomic operation. If this
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	119 // fails we will go in to the runtime to revoke the object's bias.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	120 // Note that we first construct the presumed unbiased header so we
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	121 // don't accidentally blow away another thread's valid bias.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	122 Word unbiasedMark = mark.and(biasedLockMaskInPlace() \| ageMaskInPlace() \| epochMaskInPlace());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	123 Word biasedMark = unbiasedMark.or(thread);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	124 if (compareAndSwap(object, markOffset(), unbiasedMark, biasedMark) == unbiasedMark) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	125 // Object is now biased to current thread -> done
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	126 log("+lock{bias}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	127 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	128 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	129 // If the biasing toward our thread failed, this means that
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	130 // another thread succeeded in biasing it toward itself and we
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	131 // need to revoke that bias. The revocation will occur in the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	132 // interpreter runtime in the slow case.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	133 log("+lock{stub}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	134 MonitorEnterStubCall.call(object, lock);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	135 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	136 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	137 // At this point we know the epoch has expired, meaning that the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	138 // current "bias owner", if any, is actually invalid. Under these
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	139 // circumstances _only_, we are allowed to use the current mark word
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	140 // value as the comparison value when doing the CAS to acquire the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	141 // bias in the current epoch. In other words, we allow transfer of
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	142 // the bias from one thread to another directly in this situation.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	143 Word biasedMark = prototypeMarkWord.or(thread);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	144 if (compareAndSwap(object, markOffset(), mark, biasedMark) == mark) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	145 // Object is now biased to current thread -> done
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	146 log("+lock{bias}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	147 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	148 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	149 // If the biasing toward our thread failed, then another thread
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	150 // succeeded in biasing it toward itself and we need to revoke that
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	151 // bias. The revocation will occur in the runtime in the slow case.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	152 log("+lock{stub}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	153 MonitorEnterStubCall.call(object, lock);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	154 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	155 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	156 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	157 // The prototype mark word doesn't have the bias bit set any
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	158 // more, indicating that objects of this data type are not supposed
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	159 // to be biased any more. We are going to try to reset the mark of
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	160 // this object to the prototype value and fall through to the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	161 // CAS-based locking scheme. Note that if our CAS fails, it means
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	162 // that another thread raced us for the privilege of revoking the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	163 // bias of this particular object, so it's okay to continue in the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	164 // normal locking code.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	165 compareAndSwap(object, markOffset(), mark, tmp);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	166
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	167 // Fall through to the normal CAS-based lock, because no matter what
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	168 // the result of the above CAS, some thread must have succeeded in
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	169 // removing the bias bit from the object's header.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	170 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	171 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	172 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	173
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	174 // Create the unlocked mark word pattern
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	175 Word unlockedMark = mark.or(unlockedMask());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	176
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	177 // Copy this unlocked mark word into the lock slot on the stack
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	178 storeWord(lock, lockDisplacedMarkOffset(), 0, unlockedMark);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	179
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	180 // Test if the object's mark word is unlocked, and if so, store the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	181 // (address of) the lock slot into the object's mark word.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	182 Word currentMark = compareAndSwap(object, markOffset(), unlockedMark, lock);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	183 if (currentMark != unlockedMark) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	184 // The mark word in the object header was not the same.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	185 // Either the object is locked by another thread or is already locked
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	186 // by the current thread. The latter is true if the mark word
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	187 // is a stack pointer into the current thread's stack, i.e.:
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	188 //
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	189 // 1) (currentMark & aligned_mask) == 0
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	190 // 2) rsp <= currentMark
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	191 // 3) currentMark <= rsp + page_size
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	192 //
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	193 // These 3 tests can be done by evaluating the following expression:
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	194 //
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	195 // (currentMark - rsp) & (aligned_mask - page_size)
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	196 //
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	197 // assuming both the stack pointer and page_size have their least
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	198 // significant 2 bits cleared and page_size is a power of 2
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	199 final Word alignedMask = Word.fromInt(wordSize() - 1);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	200 final Word stackPointer = asWord(register(stackPointerReg(), wordKind()));
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	201 if (currentMark.minus(stackPointer).and(alignedMask.minus(pageSize())) != Word.zero()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	202 // Most likely not a recursive lock, go into a slow runtime call
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	203 log("+lock{stub}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	204 MonitorEnterStubCall.call(object, lock);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	205 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	206 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	207 // Recursively locked => write 0 to the lock slot
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	208 storeWord(lock, lockDisplacedMarkOffset(), 0, Word.zero());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	209 log("+lock{recursive}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	210 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	211 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	212 log("+lock{cas}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	213 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	214 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	215
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	216 @Snippet
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	217 public static void monitorenterEliminated(@Parameter("object") Object object) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	218 beginLockScope(object, true, wordKind());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	219 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	220
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	221 /**
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	222 * Calls straight out to the monitorenter stub.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	223 */
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	224 @Snippet
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	225 public static void monitorenterStub(@Parameter("object") Object object, @ConstantParameter("checkNull") boolean checkNull) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	226 verifyOop(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	227 if (checkNull && object == null) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	228 DeoptimizeNode.deopt(DeoptimizationAction.InvalidateReprofile, DeoptimizationReason.NullCheckException);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	229 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	230 // BeginLockScope nodes do not read from object so a use of object
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	231 // cannot float about the null check above
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	232 final Word lock = beginLockScope(object, false, wordKind());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	233 log("+lock{stub}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	234 MonitorEnterStubCall.call(object, lock);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	235 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	236
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	237 @Snippet
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	238 public static void monitorexit(@Parameter("object") Object object) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	239 if (useBiasedLocking()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	240 // Check for biased locking unlock case, which is a no-op
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	241 // Note: we do not have to check the thread ID for two reasons.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	242 // First, the interpreter checks for IllegalMonitorStateException at
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	243 // a higher level. Second, if the bias was revoked while we held the
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	244 // lock, the object could not be rebiased toward another thread, so
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	245 // the bias bit would be clear.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	246 final Word mark = asWord(loadObject(object, 0, markOffset(), true));
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	247 if (mark.and(biasedLockMaskInPlace()).toLong() == biasedLockPattern()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	248 endLockScope(object, false);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	249 log("-lock{bias}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	250 return;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	251 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	252 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	253
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	254 final Word lock = CurrentLockNode.currentLock(wordKind());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	255
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	256 // Load displaced mark
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	257 final Word displacedMark = loadWord(lock, lockDisplacedMarkOffset());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	258
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	259 if (displacedMark == Word.zero()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	260 // Recursive locking => done
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	261 log("-lock{recursive}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	262 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	263 verifyOop(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	264 // Test if object's mark word is pointing to the displaced mark word, and if so, restore
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	265 // the displaced mark in the object - if the object's mark word is not pointing to
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	266 // the displaced mark word, get the object mark word instead
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	267 if (DirectCompareAndSwapNode.compareAndSwap(object, markOffset(), lock, displacedMark) != lock) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	268 // The object's mark word was not pointing to the displaced header,
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	269 // we do unlocking via runtime call
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	270 log("-lock{stub}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	271 MonitorExitStubCall.call(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	272 } else {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	273 log("-lock{cas}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	274 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	275 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	276 endLockScope(object, false);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	277 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	278
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	279 /**
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	280 * Calls straight out to the monitorexit stub.
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	281 */
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	282 @Snippet
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	283 public static void monitorexitStub(@Parameter("object") Object object) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	284 verifyOop(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	285 log("-lock{stub}", object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	286 MonitorExitStubCall.call(object);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	287 endLockScope(object, false);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	288 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	289
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	290 @Snippet
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	291 public static void monitorexitEliminated(@Parameter("object") Object object) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	292 endLockScope(object, true);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	293 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	294
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	295 public static class Templates extends AbstractTemplates<MonitorSnippets> {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	296
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	297 private final ResolvedJavaMethod monitorenter;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	298 private final ResolvedJavaMethod monitorexit;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	299 private final ResolvedJavaMethod monitorenterStub;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	300 private final ResolvedJavaMethod monitorexitStub;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	301 private final ResolvedJavaMethod monitorenterEliminated;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	302 private final ResolvedJavaMethod monitorexitEliminated;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	303 private final boolean useFastLocking;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	304
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	305 public Templates(CodeCacheProvider runtime, boolean useFastLocking) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	306 super(runtime, MonitorSnippets.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	307 monitorenter = snippet("monitorenter", Object.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	308 monitorexit = snippet("monitorexit", Object.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	309 monitorenterStub = snippet("monitorenterStub", Object.class, boolean.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	310 monitorexitStub = snippet("monitorexitStub", Object.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	311 monitorenterEliminated = snippet("monitorenterEliminated", Object.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	312 monitorexitEliminated = snippet("monitorexitEliminated", Object.class);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	313 this.useFastLocking = useFastLocking;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	314 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	315
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	316 public void lower(MonitorEnterNode monitorenterNode, @SuppressWarnings("unused") LoweringTool tool) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	317 FrameState stateAfter = monitorenterNode.stateAfter();
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	318 ResolvedJavaMethod method = monitorenterNode.eliminated() ? monitorenterEliminated : useFastLocking ? monitorenter : monitorenterStub;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	319 boolean checkNull = !monitorenterNode.object().stamp().nonNull();
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	320 Key key = new Key(method);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	321 if (method == monitorenterStub) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	322 key.add("checkNull", checkNull);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	323 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	324 Arguments arguments = arguments("object", monitorenterNode.object());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	325 SnippetTemplate template = cache.get(key);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	326 Map<Node, Node> nodes = template.instantiate(runtime, monitorenterNode, arguments);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	327 for (Node n : nodes.values()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	328 if (n instanceof BeginLockScopeNode) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	329 BeginLockScopeNode begin = (BeginLockScopeNode) n;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	330 begin.setStateAfter(stateAfter);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	331 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	332 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	333 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	334
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	335 public void lower(MonitorExitNode monitorexitNode, @SuppressWarnings("unused") LoweringTool tool) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	336 FrameState stateAfter = monitorexitNode.stateAfter();
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	337 ResolvedJavaMethod method = monitorexitNode.eliminated() ? monitorexitEliminated : useFastLocking ? monitorexit : monitorexitStub;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	338 Key key = new Key(method);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	339 Arguments arguments = arguments("object", monitorexitNode.object());
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	340 SnippetTemplate template = cache.get(key);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	341 Map<Node, Node> nodes = template.instantiate(runtime, monitorexitNode, arguments);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	342 for (Node n : nodes.values()) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	343 if (n instanceof EndLockScopeNode) {
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	344 EndLockScopeNode end = (EndLockScopeNode) n;
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	345 end.setStateAfter(stateAfter);
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	346 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	347 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	348 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	349 }
abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering Doug Simon <doug.simon@oracle.com> parents: diff changeset	350 }

6386

abeeb57b655d added MonitorSnippets which passes MonitorTest but is not yet enabled for general lowering