truffle: graal/com.oracle.truffle.sl.test/src/com/oracle/truffle/sl/test/instrument/SLInstrumentTestRunner.java annotate

author	David Piorkowski <david.piorkowski@oracle.com>
date	Tue, 05 Aug 2014 16:34:08 -0700
parents
children	a24beb9c9993

rev	line source
16702 2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	1 /*
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	2 * Copyright (c) 2012, 2013, Oracle and/or its affiliates. All rights reserved.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	3 * DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	4 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	5 * This code is free software; you can redistribute it and/or modify it
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	6 * under the terms of the GNU General Public License version 2 only, as
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	7 * published by the Free Software Foundation.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	8 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	9 * This code is distributed in the hope that it will be useful, but WITHOUT
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	10 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	11 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	12 * version 2 for more details (a copy is included in the LICENSE file that
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	13 * accompanied this code).
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	14 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	15 * You should have received a copy of the GNU General Public License version
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	16 * 2 along with this work; if not, write to the Free Software Foundation,
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	17 * Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	18 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	19 * Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	20 * or visit www.oracle.com if you need additional information or have any
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	21 * questions.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	22 */
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	23 package com.oracle.truffle.sl.test.instrument;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	24
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	25 import java.io.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	26 import java.nio.charset.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	27 import java.nio.file.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	28 import java.nio.file.attribute.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	29 import java.util.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	30
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	31 import org.junit.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	32 import org.junit.internal.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	33 import org.junit.runner.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	34 import org.junit.runner.manipulation.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	35 import org.junit.runner.notification.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	36 import org.junit.runners.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	37 import org.junit.runners.model.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	38
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	39 import com.oracle.truffle.api.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	40 import com.oracle.truffle.api.nodes.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	41 import com.oracle.truffle.api.source.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	42 import com.oracle.truffle.sl.nodes.instrument.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	43 import com.oracle.truffle.sl.parser.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	44 import com.oracle.truffle.sl.runtime.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	45 import com.oracle.truffle.sl.test.*;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	46 import com.oracle.truffle.sl.test.instrument.SLInstrumentTestRunner.InstrumentTestCase;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	47
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	48 /**
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	49 * This class builds and executes the tests for instrumenting SL. Although much of this class is
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	50 * written with future automation in mind, at the moment the tests that are created are hard-coded
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	51 * according to the file name of the test. To be automated, an automatic way of generating both the
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	52 * node visitor and the node prober is necessary.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	53 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	54 * Testing is done via JUnit via comparing execution outputs with expected outputs.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	55 */
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	56 public final class SLInstrumentTestRunner extends ParentRunner<InstrumentTestCase> {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	57
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	58 private static final String SOURCE_SUFFIX = ".sl";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	59 private static final String INPUT_SUFFIX = ".input";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	60 private static final String OUTPUT_SUFFIX = ".output";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	61 private static final String VISITOR_ASSIGNMENT_COUNT_SUFFIX = "_assnCount";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	62 private static final String VISITOR_VARIABLE_COMPARE_SUFFIX = "_varCompare";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	63
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	64 private static final String LF = System.getProperty("line.separator");
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	65 private static SLContext slContext;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	66
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	67 static class InstrumentTestCase {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	68 protected final Description name;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	69 protected final Path path;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	70 protected final String baseName;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	71 protected final String sourceName;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	72 protected final String testInput;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	73 protected final String expectedOutput;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	74 protected String actualOutput;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	75
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	76 protected InstrumentTestCase(Class<?> testClass, String baseName, String sourceName, Path path, String testInput, String expectedOutput) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	77 this.name = Description.createTestDescription(testClass, baseName);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	78 this.baseName = baseName;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	79 this.sourceName = sourceName;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	80 this.path = path;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	81 this.testInput = testInput;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	82 this.expectedOutput = expectedOutput;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	83 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	84 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	85
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	86 private final List<InstrumentTestCase> testCases;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	87
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	88 public SLInstrumentTestRunner(Class<?> testClass) throws InitializationError {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	89 super(testClass);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	90 try {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	91 testCases = createTests(testClass);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	92 } catch (IOException e) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	93 throw new InitializationError(e);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	94 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	95 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	96
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	97 @Override
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	98 protected List<InstrumentTestCase> getChildren() {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	99 return testCases;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	100 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	101
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	102 @Override
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	103 protected Description describeChild(InstrumentTestCase child) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	104 return child.name;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	105 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	106
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	107 /**
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	108 * Tests are created based on the files that exist in the directory specified in the passed in
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	109 * annotation. Each test must have a source file and an expected output file. Optionally, each
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	110 * test can also include an input file. Source files have an ".sl" extension. Expected output
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	111 * have a ".output" extension. Input files have an ".input" extension. All these files must
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	112 * share the same base name to be correctly grouped. For example: "test1_assnCount.sl",
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	113 * "test1_assnCount.output" and "test1_assnCount.input" would all be used to create a single
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	114 * test called "test1_assnCount".
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	115 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	116 * This method iterates over the files in the directory and creates a new InstrumentTestCase for
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	117 * each group of related files. Each file is also expected to end with an identified at the end
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	118 * of the base name to indicate what visitor needs to be attached. Currently, visitors are hard
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	119 * coded to work on specific lines, so the code here is not currently generalizable.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	120 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	121 * @param c The annotation containing the directory with tests
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	122 * @return A list of {@link InstrumentTestCase}s to run.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	123 * @throws IOException If the directory is invalid.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	124 * @throws InitializationError If no directory is provided.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	125 *
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	126 * @see #runChild(InstrumentTestCase, RunNotifier)
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	127 */
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	128 protected static List<InstrumentTestCase> createTests(final Class<?> c) throws IOException, InitializationError {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	129 SLInstrumentTestSuite suite = c.getAnnotation(SLInstrumentTestSuite.class);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	130 if (suite == null) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	131 throw new InitializationError(String.format("@%s annotation required on class '%s' to run with '%s'.", SLTestSuite.class.getSimpleName(), c.getName(), SLTestRunner.class.getSimpleName()));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	132 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	133
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	134 String[] paths = suite.value();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	135
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	136 Path root = null;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	137 for (String path : paths) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	138 root = FileSystems.getDefault().getPath(path);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	139 if (Files.exists(root)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	140 break;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	141 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	142 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	143 if (root == null && paths.length > 0) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	144 throw new FileNotFoundException(paths[0]);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	145 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	146
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	147 final Path rootPath = root;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	148
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	149 final List<InstrumentTestCase> testCases = new ArrayList<>();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	150
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	151 // Scaffolding in place for future automation
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	152 Files.walkFileTree(rootPath, new SimpleFileVisitor<Path>() {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	153 @Override
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	154 public FileVisitResult visitFile(Path sourceFile, BasicFileAttributes attrs) throws IOException {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	155 String sourceName = sourceFile.getFileName().toString();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	156 if (sourceName.endsWith(SOURCE_SUFFIX)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	157 String baseName = sourceName.substring(0, sourceName.length() - SOURCE_SUFFIX.length());
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	158
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	159 Path inputFile = sourceFile.resolveSibling(baseName + INPUT_SUFFIX);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	160 String testInput = "";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	161 if (Files.exists(inputFile)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	162 testInput = readAllLines(inputFile);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	163 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	164
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	165 Path outputFile = sourceFile.resolveSibling(baseName + OUTPUT_SUFFIX);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	166 String expectedOutput = "";
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	167 if (Files.exists(outputFile)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	168 expectedOutput = readAllLines(outputFile);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	169 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	170
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	171 testCases.add(new InstrumentTestCase(c, baseName, sourceName, sourceFile, testInput, expectedOutput));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	172
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	173 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	174 return FileVisitResult.CONTINUE;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	175 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	176 });
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	177
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	178 return testCases;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	179 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	180
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	181 private static String readAllLines(Path file) throws IOException {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	182 // fix line feeds for non unix os
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	183 StringBuilder outFile = new StringBuilder();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	184 for (String line : Files.readAllLines(file, Charset.defaultCharset())) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	185 outFile.append(line).append(LF);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	186 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	187 return outFile.toString();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	188 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	189
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	190 /**
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	191 * Executes the passed in test case. Instrumentation is added according to the name of the file
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	192 * as explained in {@link #createTests(Class)}. Note that this code is not generalizable.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	193 */
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	194 @Override
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	195 protected void runChild(InstrumentTestCase testCase, RunNotifier notifier) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	196 // TODO Current tests are hard-coded, automate this eventually
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	197 notifier.fireTestStarted(testCase.name);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	198
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	199 ByteArrayOutputStream out = new ByteArrayOutputStream();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	200 PrintStream printer = new PrintStream(out);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	201 try {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	202 // We use the name of the file to determine what visitor to attach to it.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	203 if (testCase.baseName.endsWith(VISITOR_ASSIGNMENT_COUNT_SUFFIX) \|\| testCase.baseName.endsWith(VISITOR_VARIABLE_COMPARE_SUFFIX)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	204 NodeVisitor nodeVisitor = null;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	205 slContext = new SLContext(new BufferedReader(new StringReader(testCase.testInput)), printer);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	206 final Source source = Source.fromText(readAllLines(testCase.path), testCase.sourceName);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	207 SLASTProber prober = new SLASTProber();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	208
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	209 // Note that the visitor looks for an attachment point via line number
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	210 if (testCase.baseName.endsWith(VISITOR_ASSIGNMENT_COUNT_SUFFIX)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	211 nodeVisitor = new NodeVisitor() {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	212
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	213 public boolean visit(Node node) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	214 if (node instanceof SLExpressionWrapper) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	215 SLExpressionWrapper wrapper = (SLExpressionWrapper) node;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	216 int lineNum = wrapper.getSourceSection().getLineLocation().getLineNumber();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	217
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	218 if (lineNum == 4) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	219 wrapper.getProbe().addInstrument(new SLPrintAssigmentValueInstrument(slContext.getOutput()));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	220 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	221 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	222 return true;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	223 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	224 };
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	225
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	226 // Note that the visitor looks for an attachment point via line number
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	227 } else if (testCase.baseName.endsWith(VISITOR_VARIABLE_COMPARE_SUFFIX)) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	228 nodeVisitor = new NodeVisitor() {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	229
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	230 public boolean visit(Node node) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	231 if (node instanceof SLStatementWrapper) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	232 SLStatementWrapper wrapper = (SLStatementWrapper) node;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	233 int lineNum = wrapper.getSourceSection().getLineLocation().getLineNumber();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	234
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	235 if (lineNum == 6) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	236 wrapper.getProbe().addInstrument(new SLCheckVariableEqualityInstrument("i", "count", slContext.getOutput()));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	237 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	238 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	239 return true;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	240 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	241 };
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	242 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	243
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	244 prober.addNodeProber(new SLInstrumentTestNodeProber(slContext));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	245 Parser.parseSL(slContext, source, prober);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	246 List<SLFunction> functionList = slContext.getFunctionRegistry().getFunctions();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	247
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	248 // Since only functions can be global in SL, this guarantees that we instrument
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	249 // everything of interest. Parsing must occur before accepting the visitors since
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	250 // parsing is what creates our instrumentation points.
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	251 for (SLFunction function : functionList) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	252 RootCallTarget rootCallTarget = function.getCallTarget();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	253 rootCallTarget.getRootNode().accept(nodeVisitor);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	254 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	255
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	256 SLFunction main = slContext.getFunctionRegistry().lookup("main");
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	257 main.getCallTarget().call();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	258 } else {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	259 notifier.fireTestFailure(new Failure(testCase.name, new UnsupportedOperationException("No instrumentation found.")));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	260 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	261
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	262 String actualOutput = new String(out.toByteArray());
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	263 Assert.assertEquals(testCase.expectedOutput, actualOutput);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	264 } catch (Throwable ex) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	265 notifier.fireTestFailure(new Failure(testCase.name, ex));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	266 } finally {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	267 notifier.fireTestFinished(testCase.name);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	268 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	269
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	270 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	271
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	272 public static void runInMain(Class<?> testClass, String[] args) throws InitializationError, NoTestsRemainException {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	273 JUnitCore core = new JUnitCore();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	274 core.addListener(new TextListener(System.out));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	275 SLTestRunner suite = new SLTestRunner(testClass);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	276 if (args.length > 0) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	277 suite.filter(new NameFilter(args[0]));
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	278 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	279 Result r = core.run(suite);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	280 if (!r.wasSuccessful()) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	281 System.exit(1);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	282 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	283 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	284
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	285 private static final class NameFilter extends Filter {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	286 private final String pattern;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	287
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	288 private NameFilter(String pattern) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	289 this.pattern = pattern.toLowerCase();
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	290 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	291
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	292 @Override
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	293 public boolean shouldRun(Description description) {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	294 return description.getMethodName().toLowerCase().contains(pattern);
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	295 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	296
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	297 @Override
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	298 public String describe() {
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	299 return "Filter contains " + pattern;
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	300 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	301 }
2a5ec181dad4 SL: Added instrumentation testing David Piorkowski <david.piorkowski@oracle.com> parents: diff changeset	302 }

16702

2a5ec181dad4 SL: Added instrumentation testing