truffle: truffle/com.oracle.truffle.dsl.processor/src/com/oracle/truffle/dsl/processor/expression/Scanner.java annotate

annotate truffle/com.oracle.truffle.dsl.processor/src/com/oracle/truffle/dsl/processor/expression/Scanner.java @ 22548:6b76a24fffbd default tip

Use all variables: a, b, u,v and x, y

author	Jaroslav Tulach <jaroslav.tulach@oracle.com>
date	Thu, 14 Jan 2016 14:20:57 +0100
parents	dc83cc1f94f2
children

rev	line source
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	1 /*
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	2 * Copyright (c) 2015, Oracle and/or its affiliates. All rights reserved.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	4 *
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	7 * published by the Free Software Foundation.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	8 *
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	13 * accompanied this code).
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	14 *
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	18 *
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	21 * questions.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	22 */
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	23
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	24 // The content of this file is automatically generated. DO NOT EDIT.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	25
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	26 package com.oracle.truffle.dsl.processor.expression;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	27
22157 dc83cc1f94f2 Using fully qualified imports Jaroslav Tulach <jaroslav.tulach@oracle.com> parents: 21951 diff changeset	28 import java.io.IOException;
dc83cc1f94f2 Using fully qualified imports Jaroslav Tulach <jaroslav.tulach@oracle.com> parents: 21951 diff changeset	29 import java.io.InputStream;
dc83cc1f94f2 Using fully qualified imports Jaroslav Tulach <jaroslav.tulach@oracle.com> parents: 21951 diff changeset	30 import java.io.RandomAccessFile;
dc83cc1f94f2 Using fully qualified imports Jaroslav Tulach <jaroslav.tulach@oracle.com> parents: 21951 diff changeset	31 import java.util.HashMap;
dc83cc1f94f2 Using fully qualified imports Jaroslav Tulach <jaroslav.tulach@oracle.com> parents: 21951 diff changeset	32 import java.util.Map;
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	33
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	34 // Checkstyle: stop
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	35 // @formatter:off
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	36 class Token {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	37
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	38 public int kind; // token kind
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	39 public int pos; // token position in bytes in the source text (starting at 0)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	40 public int charPos; // token position in characters in the source text (starting at 0)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	41 public int col; // token column (starting at 1)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	42 public int line; // token line (starting at 1)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	43 public String val; // token value
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	44 public Token next; // ML 2005-03-11 Peek tokens are kept in linked list
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	45 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	46
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	47 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	48 // Buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	49 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	50 class Buffer {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	51
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	52 // This Buffer supports the following cases:
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	53 // 1) seekable stream (file)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	54 // a) whole stream in buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	55 // b) part of stream in buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	56 // 2) non seekable stream (network, console)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	57
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	58 public static final int EOF = Character.MAX_VALUE + 1;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	59 private static final int MIN_BUFFER_LENGTH = 1024; // 1KB
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	60 private static final int MAX_BUFFER_LENGTH = MIN_BUFFER_LENGTH * 64; // 64KB
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	61 private byte[] buf; // input buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	62 private int bufStart; // position of first byte in buffer relative to input stream
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	63 private int bufLen; // length of buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	64 private int fileLen; // length of input stream (may change if stream is no file)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	65 private int bufPos; // current position in buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	66 private RandomAccessFile file; // input stream (seekable)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	67 private InputStream stream; // growing input stream (e.g.: console, network)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	68
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	69 public Buffer(InputStream s) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	70 stream = s;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	71 fileLen = bufLen = bufStart = bufPos = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	72 buf = new byte[MIN_BUFFER_LENGTH];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	73 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	74
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	75 public Buffer(String fileName) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	76 try {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	77 file = new RandomAccessFile(fileName, "r");
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	78 fileLen = (int) file.length();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	79 bufLen = Math.min(fileLen, MAX_BUFFER_LENGTH);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	80 buf = new byte[bufLen];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	81 bufStart = Integer.MAX_VALUE; // nothing in buffer so far
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	82 if (fileLen > 0)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	83 setPos(0); // setup buffer to position 0 (start)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	84 else
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	85 bufPos = 0; // index 0 is already after the file, thus setPos(0) is invalid
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	86 if (bufLen == fileLen)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	87 Close();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	88 } catch (IOException e) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	89 throw new FatalError("Could not open file " + fileName);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	90 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	91 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	92
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	93 // don't use b after this call anymore
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	94 // called in UTF8Buffer constructor
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	95 protected Buffer(Buffer b) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	96 buf = b.buf;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	97 bufStart = b.bufStart;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	98 bufLen = b.bufLen;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	99 fileLen = b.fileLen;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	100 bufPos = b.bufPos;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	101 file = b.file;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	102 stream = b.stream;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	103 // keep finalize from closing the file
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	104 b.file = null;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	105 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	106
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	107 @Override
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	108 protected void finalize() throws Throwable {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	109 super.finalize();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	110 Close();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	111 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	112
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	113 protected void Close() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	114 if (file != null) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	115 try {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	116 file.close();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	117 file = null;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	118 } catch (IOException e) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	119 throw new FatalError(e.getMessage());
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	120 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	121 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	122 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	123
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	124 public int Read() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	125 if (bufPos < bufLen) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	126 return buf[bufPos++] & 0xff; // mask out sign bits
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	127 } else if (getPos() < fileLen) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	128 setPos(getPos()); // shift buffer start to pos
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	129 return buf[bufPos++] & 0xff; // mask out sign bits
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	130 } else if (stream != null && ReadNextStreamChunk() > 0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	131 return buf[bufPos++] & 0xff; // mask out sign bits
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	132 } else {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	133 return EOF;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	134 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	135 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	136
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	137 public int Peek() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	138 int curPos = getPos();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	139 int ch = Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	140 setPos(curPos);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	141 return ch;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	142 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	143
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	144 // beg .. begin, zero-based, inclusive, in byte
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	145 // end .. end, zero-based, exclusive, in byte
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	146 public String GetString(int beg, int end) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	147 int len = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	148 char[] buffer = new char[end - beg];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	149 int oldPos = getPos();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	150 setPos(beg);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	151 while (getPos() < end)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	152 buffer[len++] = (char) Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	153 setPos(oldPos);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	154 return new String(buffer, 0, len);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	155 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	156
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	157 public int getPos() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	158 return bufPos + bufStart;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	159 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	160
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	161 public void setPos(int value) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	162 if (value >= fileLen && stream != null) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	163 // Wanted position is after buffer and the stream
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	164 // is not seek-able e.g. network or console,
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	165 // thus we have to read the stream manually till
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	166 // the wanted position is in sight.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	167 while (value >= fileLen && ReadNextStreamChunk() > 0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	168 // nothing to do...
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	169 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	170 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	171
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	172 if (value < 0 \|\| value > fileLen) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	173 throw new FatalError("buffer out of bounds access, position: " + value);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	174 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	175
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	176 if (value >= bufStart && value < bufStart + bufLen) { // already in buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	177 bufPos = value - bufStart;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	178 } else if (file != null) { // must be swapped in
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	179 try {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	180 file.seek(value);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	181 bufLen = file.read(buf);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	182 bufStart = value;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	183 bufPos = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	184 } catch (IOException e) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	185 throw new FatalError(e.getMessage());
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	186 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	187 } else {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	188 // set the position to the end of the file, Pos will return fileLen.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	189 bufPos = fileLen - bufStart;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	190 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	191 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	192
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	193 // Read the next chunk of bytes from the stream, increases the buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	194 // if needed and updates the fields fileLen and bufLen.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	195 // Returns the number of bytes read.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	196 private int ReadNextStreamChunk() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	197 int free = buf.length - bufLen;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	198 if (free == 0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	199 // in the case of a growing input stream
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	200 // we can neither seek in the stream, nor can we
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	201 // foresee the maximum length, thus we must adapt
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	202 // the buffer size on demand.
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	203 byte[] newBuf = new byte[bufLen * 2];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	204 System.arraycopy(buf, 0, newBuf, 0, bufLen);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	205 buf = newBuf;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	206 free = bufLen;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	207 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	208
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	209 int read;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	210 try {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	211 read = stream.read(buf, bufLen, free);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	212 } catch (IOException ioex) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	213 throw new FatalError(ioex.getMessage());
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	214 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	215
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	216 if (read > 0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	217 fileLen = bufLen = (bufLen + read);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	218 return read;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	219 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	220 // end of stream reached
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	221 return 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	222 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	223 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	224
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	225 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	226 // UTF8Buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	227 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	228 class UTF8Buffer extends Buffer {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	229
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	230 UTF8Buffer(Buffer b) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	231 super(b);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	232 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	233
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	234 @Override
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	235 public int Read() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	236 int ch;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	237 do {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	238 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	239 // until we find a utf8 start (0xxxxxxx or 11xxxxxx)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	240 } while ((ch >= 128) && ((ch & 0xC0) != 0xC0) && (ch != EOF));
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	241 if (ch < 128 \|\| ch == EOF) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	242 // nothing to do, first 127 chars are the same in ascii and utf8
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	243 // 0xxxxxxx or end of file character
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	244 } else if ((ch & 0xF0) == 0xF0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	245 // 11110xxx 10xxxxxx 10xxxxxx 10xxxxxx
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	246 int c1 = ch & 0x07;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	247 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	248 int c2 = ch & 0x3F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	249 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	250 int c3 = ch & 0x3F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	251 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	252 int c4 = ch & 0x3F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	253 ch = (((((c1 << 6) \| c2) << 6) \| c3) << 6) \| c4;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	254 } else if ((ch & 0xE0) == 0xE0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	255 // 1110xxxx 10xxxxxx 10xxxxxx
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	256 int c1 = ch & 0x0F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	257 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	258 int c2 = ch & 0x3F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	259 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	260 int c3 = ch & 0x3F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	261 ch = (((c1 << 6) \| c2) << 6) \| c3;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	262 } else if ((ch & 0xC0) == 0xC0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	263 // 110xxxxx 10xxxxxx
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	264 int c1 = ch & 0x1F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	265 ch = super.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	266 int c2 = ch & 0x3F;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	267 ch = (c1 << 6) \| c2;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	268 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	269 return ch;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	270 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	271 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	272
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	273 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	274 // StartStates -- maps characters to start states of tokens
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	275 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	276 class StartStates {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	277
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	278 private static class Elem {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	279
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	280 public int key, val;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	281 public Elem next;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	282
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	283 public Elem(int key, int val) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	284 this.key = key;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	285 this.val = val;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	286 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	287 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	288
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	289 private Elem[] tab = new Elem[128];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	290
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	291 public void set(int key, int val) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	292 Elem e = new Elem(key, val);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	293 int k = key % 128;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	294 e.next = tab[k];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	295 tab[k] = e;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	296 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	297
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	298 public int state(int key) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	299 Elem e = tab[key % 128];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	300 while (e != null && e.key != key)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	301 e = e.next;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	302 return e == null ? 0 : e.val;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	303 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	304 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	305
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	306 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	307 // Scanner
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	308 // -----------------------------------------------------------------------------------
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	309 @SuppressWarnings({"rawtypes"})
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	310 public class Scanner {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	311
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	312 static final char EOL = '\n';
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	313 static final int eofSym = 0;
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	314 static final int maxT = 15;
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	315 static final int noSym = 15;
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	316
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	317
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	318 public Buffer buffer; // scanner buffer
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	319
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	320 Token t; // current token
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	321 int ch; // current input character
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	322 int pos; // byte position of current character
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	323 int charPos; // position by unicode characters starting with 0
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	324 int col; // column number of current character
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	325 int line; // line number of current character
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	326 int oldEols; // EOLs that appeared in a comment;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	327 static final StartStates start; // maps initial token character to start state
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	328 static final Map literals; // maps literal strings to literal kinds
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	329
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	330 Token tokens; // list of tokens already peeked (first token is a dummy)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	331 Token pt; // current peek token
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	332
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	333 char[] tval = new char[16]; // token text used in NextToken(), dynamically enlarged
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	334 int tlen; // length of current token
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	335
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	336 static {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	337 start = new StartStates();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	338 literals = new HashMap();
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	339 for (int i = 36; i <= 36; ++i) start.set(i, 1);
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	340 for (int i = 65; i <= 90; ++i) start.set(i, 1);
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	341 for (int i = 95; i <= 95; ++i) start.set(i, 1);
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	342 for (int i = 97; i <= 122; ++i) start.set(i, 1);
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	343 for (int i = 49; i <= 57; ++i) start.set(i, 6);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	344 start.set(48, 2);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	345 start.set(124, 7);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	346 start.set(60, 18);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	347 start.set(62, 19);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	348 start.set(61, 11);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	349 start.set(33, 20);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	350 start.set(40, 14);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	351 start.set(41, 15);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	352 start.set(44, 16);
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	353 start.set(46, 17);
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	354 start.set(Buffer.EOF, -1);
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	355
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	356 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	357
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	358 public Scanner(String fileName) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	359 buffer = new Buffer(fileName);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	360 Init();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	361 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	362
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	363 public Scanner(InputStream s) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	364 buffer = new Buffer(s);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	365 Init();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	366 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	367
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	368 void Init() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	369 pos = -1;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	370 line = 1;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	371 col = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	372 charPos = -1;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	373 oldEols = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	374 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	375 if (ch == 0xEF) { // check optional byte order mark for UTF-8
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	376 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	377 int ch1 = ch;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	378 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	379 int ch2 = ch;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	380 if (ch1 != 0xBB \|\| ch2 != 0xBF) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	381 throw new FatalError("Illegal byte order mark at start of file");
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	382 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	383 buffer = new UTF8Buffer(buffer);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	384 col = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	385 charPos = -1;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	386 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	387 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	388 pt = tokens = new Token(); // first token is a dummy
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	389 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	390
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	391 void NextCh() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	392 if (oldEols > 0) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	393 ch = EOL;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	394 oldEols--;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	395 } else {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	396 pos = buffer.getPos();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	397 // buffer reads unicode chars, if UTF8 has been detected
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	398 ch = buffer.Read();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	399 col++;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	400 charPos++;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	401 // replace isolated '\r' by '\n' in order to make
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	402 // eol handling uniform across Windows, Unix and Mac
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	403 if (ch == '\r' && buffer.Peek() != '\n')
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	404 ch = EOL;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	405 if (ch == EOL) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	406 line++;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	407 col = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	408 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	409 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	410
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	411 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	412
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	413 void AddCh() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	414 if (tlen >= tval.length) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	415 char[] newBuf = new char[2 * tval.length];
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	416 System.arraycopy(tval, 0, newBuf, 0, tval.length);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	417 tval = newBuf;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	418 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	419 if (ch != Buffer.EOF) {
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	420 tval[tlen++] = (char)ch;
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	421
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	422 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	423 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	424 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	425
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	426
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	427
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	428 void CheckLiteral() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	429 String val = t.val;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	430
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	431 Object kind = literals.get(val);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	432 if (kind != null) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	433 t.kind = ((Integer) kind).intValue();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	434 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	435 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	436
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	437 Token NextToken() {
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	438 while (ch == ' ' \|\|
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	439 false
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	440 ) NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	441
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	442 int recKind = noSym;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	443 int recEnd = pos;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	444 t = new Token();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	445 t.pos = pos;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	446 t.col = col;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	447 t.line = line;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	448 t.charPos = charPos;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	449 int state = start.state(ch);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	450 tlen = 0;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	451 AddCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	452
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	453 loop: for (;;) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	454 switch (state) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	455 case -1: {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	456 t.kind = eofSym;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	457 break loop;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	458 } // NextCh already done
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	459 case 0: {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	460 if (recKind != noSym) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	461 tlen = recEnd - t.pos;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	462 SetScannerBehindT();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	463 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	464 t.kind = recKind;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	465 break loop;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	466 } // NextCh already done
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	467 case 1:
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	468 recEnd = pos; recKind = 1;
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	469 if (ch == '$' \|\| ch >= '0' && ch <= '9' \|\| ch >= 'A' && ch <= 'Z' \|\| ch == '_' \|\| ch >= 'a' && ch <= 'z') {AddCh(); state = 1; break;}
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	470 else {t.kind = 1; break loop;}
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	471 case 2:
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	472 recEnd = pos; recKind = 2;
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	473 if (ch >= '0' && ch <= '7') {AddCh(); state = 5; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	474 else if (ch == 'x') {AddCh(); state = 3; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	475 else if (ch == 'b') {AddCh(); state = 4; break;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	476 else {t.kind = 2; break loop;}
62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	477 case 3:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	478 recEnd = pos; recKind = 2;
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	479 if (ch >= '0' && ch <= '9' \|\| ch >= 'A' && ch <= 'F' \|\| ch >= 'a' && ch <= 'f') {AddCh(); state = 3; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	480 else {t.kind = 2; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	481 case 4:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	482 recEnd = pos; recKind = 2;
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	483 if (ch >= '0' && ch <= '1') {AddCh(); state = 4; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	484 else {t.kind = 2; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	485 case 5:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	486 recEnd = pos; recKind = 2;
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	487 if (ch >= '0' && ch <= '7') {AddCh(); state = 5; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	488 else {t.kind = 2; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	489 case 6:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	490 recEnd = pos; recKind = 2;
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	491 if (ch >= '0' && ch <= '9') {AddCh(); state = 6; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	492 else {t.kind = 2; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	493 case 7:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	494 if (ch == '\|') {AddCh(); state = 8; break;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	495 else {state = 0; break;}
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	496 case 8:
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	497 {t.kind = 3; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	498 case 9:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	499 {t.kind = 5; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	500 case 10:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	501 {t.kind = 7; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	502 case 11:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	503 if (ch == '=') {AddCh(); state = 12; break;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	504 else {state = 0; break;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	505 case 12:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	506 {t.kind = 8; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	507 case 13:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	508 {t.kind = 9; break loop;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	509 case 14:
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	510 {t.kind = 11; break loop;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	511 case 15:
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	512 {t.kind = 12; break loop;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	513 case 16:
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	514 {t.kind = 13; break loop;}
65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	515 case 17:
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	516 {t.kind = 14; break loop;}
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	517 case 18:
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	518 recEnd = pos; recKind = 4;
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	519 if (ch == '=') {AddCh(); state = 9; break;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	520 else {t.kind = 4; break loop;}
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	521 case 19:
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	522 recEnd = pos; recKind = 6;
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	523 if (ch == '=') {AddCh(); state = 10; break;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	524 else {t.kind = 6; break loop;}
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	525 case 20:
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	526 recEnd = pos; recKind = 10;
20169 65d29fa81397 DSL: add support for hex, oct and binary integer literals. Chris Seaton <chris.seaton@oracle.com> parents: 19289 diff changeset	527 if (ch == '=') {AddCh(); state = 13; break;}
19289 62c43fcf5be2 Truffle-DSL: implement @Cached and fixes for the new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: 19283 diff changeset	528 else {t.kind = 10; break loop;}
19283 08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	529
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	530 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	531 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	532 t.val = new String(tval, 0, tlen);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	533 return t;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	534 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	535
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	536 private void SetScannerBehindT() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	537 buffer.setPos(t.pos);
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	538 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	539 line = t.line;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	540 col = t.col;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	541 charPos = t.charPos;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	542 for (int i = 0; i < tlen; i++)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	543 NextCh();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	544 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	545
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	546 // get the next token (possibly a token already seen during peeking)
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	547 public Token Scan() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	548 if (tokens.next == null) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	549 return NextToken();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	550 } else {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	551 pt = tokens = tokens.next;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	552 return tokens;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	553 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	554 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	555
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	556 // get the next token, ignore pragmas
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	557 public Token Peek() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	558 do {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	559 if (pt.next == null) {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	560 pt.next = NextToken();
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	561 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	562 pt = pt.next;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	563 } while (pt.kind > maxT); // skip pragmas
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	564
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	565 return pt;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	566 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	567
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	568 // make sure that peeking starts at current scan position
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	569 public void ResetPeek() {
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	570 pt = tokens;
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	571 }
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	572
08aa0372dad4 Truffle-DSL: implement new guard expression syntax. Christian Humer <christian.humer@gmail.com> parents: diff changeset	573 } // end Scanner

Mercurial > hg > truffle

annotate truffle/com.oracle.truffle.dsl.processor/src/com/oracle/truffle/dsl/processor/expression/Scanner.java @ 22548:6b76a24fffbd default tip