cloudera vm oozieWorkflow java.lang.ClassNotFoundException(cloudera vm oozieWorkflow java.lang.ClassNotFoundException)
我是Hadoop的新手,我有一个流动的问题:
当我试图运行我的oozzie工作流程时,我不断收到“java.lang.ClassNotFoundException”。 我使用Cloudera快速启动VM v 4.5。
使用的oozzie设置:
- Jar名称:sample.jar
- 主要类别:司机
- 参数:in_single / out
用过java类
public class Driver{ public static class TokenizerMapper extends Mapper<Object, Text, Text, Text> { @Override public void map(final Object key, final Text value, final Mapper<Object, Text, Text, Text>.Context context) throws IOException, InterruptedException { context.write(new Text("key " + UUID.randomUUID().toString()), new Text("value " + UUID.randomUUID().toString())); } } public static class IntSumReducer extends Reducer<Text, Text, Text, Text> { private final IntWritable result = new IntWritable(); @Override public void reduce(final Text key, final Iterable<Text> values, final Reducer<Text, Text, Text, Text>.Context context) throws IOException, InterruptedException { for (Text value : values) context.write(new Text(UUID.randomUUID().toString()), new Text(value)); } } public static void main(final String[] args) throws Exception { Configuration conf = new Configuration(); String[] otherArgs = new GenericOptionsParser(conf, args).getRemainingArgs(); if (otherArgs.length != 2) { System.err.println("Usage: wordcount <in> <out>"); System.exit(2); } Job job = new Job(conf, "MRJ"); job.setJarByClass(Driver.class); job.setMapperClass(TokenizerMapper.class); job.setCombinerClass(IntSumReducer.class); job.setReducerClass(IntSumReducer.class); job.setOutputKeyClass(Text.class); job.setOutputValueClass(Text.class); FileInputFormat.addInputPath(job, new Path(otherArgs[0])); FileOutputFormat.setOutputPath(job, new Path(otherArgs[1])); System.exit(job.waitForCompletion(true) ? 0 : 1); }}
用过pom.xml
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>LittleBigData.Sample</groupId> <artifactId>WordCountCeSample</artifactId> <version>0.0.1-SNAPSHOT</version> <dependencies> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-mapreduce-client-core</artifactId> <version>2.2.0</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.2.0</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-hdfs</artifactId> <version>2.2.0</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hbase</groupId> <artifactId>hbase</artifactId> <version>0.92.1</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>zookeeper</artifactId> <version>3.3.1</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.1</version> <configuration> <source>1.6</source> <target>1.6</target> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <version>2.2</version> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project>
任何人都知道这是为什么,以及如何解决这个错误?
补充:stdout日志
Oozie Launcher starts Heart beat Starting the execution of prepare actions Completed the execution of prepare actions successfully Files in current dir:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/. ====================== File: action.xml File: .action.xml.crc Dir: tmp Oozie Java/Map-Reduce/Pig action launcher-job configuration ================================================================= Workflow job id : 0000039-140127061714030-oozie-oozi-W Workflow action id: 0000039-140127061714030-oozie-oozi-W@MRJ Classpath : ------------------------ /var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER /usr/java/jdk1.6.0_32/lib/tools.jar /usr/lib/hadoop-0.20-mapreduce /usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar /usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar /usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar /usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar /usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar /usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar /usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar /usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar /usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar /usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar /usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar /usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar /usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar /usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar /usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar /usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar /usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar /usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar /usr/lib/hadoop-hdfs/lib/asm-3.2.jar /usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar /usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar /usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar /usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar /usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar /usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar /usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar /usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar /usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar /usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar /usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar /usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar /usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar /usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar /usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar /usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar /usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar /usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar /usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar /usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar /usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar /usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar /usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar /usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar /usr/lib/hadoop-hdfs/hadoop-hdfs.jar /usr/lib/hadoop/lib/guava-11.0.2.jar /usr/lib/hadoop/lib/asm-3.2.jar /usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar /usr/lib/hadoop/lib/slf4j-api-1.6.1.jar /usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar /usr/lib/hadoop/lib/junit-4.8.2.jar /usr/lib/hadoop/lib/commons-net-3.1.jar /usr/lib/hadoop/lib/jline-0.9.94.jar /usr/lib/hadoop/lib/jersey-json-1.8.jar /usr/lib/hadoop/lib/servlet-api-2.5.jar /usr/lib/hadoop/lib/paranamer-2.3.jar /usr/lib/hadoop/lib/stax-api-1.0.1.jar /usr/lib/hadoop/lib/jersey-core-1.8.jar /usr/lib/hadoop/lib/commons-lang-2.5.jar /usr/lib/hadoop/lib/commons-logging-1.1.1.jar /usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar /usr/lib/hadoop/lib/jsch-0.1.42.jar /usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar /usr/lib/hadoop/lib/log4j-1.2.17.jar /usr/lib/hadoop/lib/avro-1.7.4.jar /usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar /usr/lib/hadoop/lib/jettison-1.1.jar /usr/lib/hadoop/lib/commons-digester-1.8.jar /usr/lib/hadoop/lib/mockito-all-1.8.5.jar /usr/lib/hadoop/lib/jackson-xc-1.8.8.jar /usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar /usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar /usr/lib/hadoop/lib/xz-1.0.jar /usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar /usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar /usr/lib/hadoop/lib/commons-compress-1.4.1.jar /usr/lib/hadoop/lib/jaxb-api-2.2.2.jar /usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar /usr/lib/hadoop/lib/commons-httpclient-3.1.jar /usr/lib/hadoop/lib/commons-cli-1.2.jar /usr/lib/hadoop/lib/jsr305-1.3.9.jar /usr/lib/hadoop/lib/activation-1.1.jar /usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar /usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar /usr/lib/hadoop/lib/jsp-api-2.1.jar /usr/lib/hadoop/lib/commons-math-2.1.jar /usr/lib/hadoop/lib/xmlenc-0.52.jar /usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar /usr/lib/hadoop/lib/commons-io-2.1.jar /usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar /usr/lib/hadoop/lib/commons-collections-3.2.1.jar /usr/lib/hadoop/lib/kfs-0.3.jar /usr/lib/hadoop/lib/commons-codec-1.4.jar /usr/lib/hadoop/lib/commons-configuration-1.6.jar /usr/lib/hadoop/lib/commons-el-1.0.jar /usr/lib/hadoop/lib/jets3t-0.6.1.jar /usr/lib/hadoop/lib/jersey-server-1.8.jar /usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-auth.jar /usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-common.jar /usr/lib/hadoop/hadoop-annotations.jar /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar /mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar /mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar /mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar /mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar /mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work ------------------------ Main class : Driver Maximum output : 2048 Arguments : in_single/ out Java System Properties: ------------------------ # #Tue Jan 28 05:33:17 PST 2014 java.runtime.name=Java(TM) SE Runtime Environment hadoop.tasklog.taskid=attempt_201401270439_0058_m_000000_0 oozie.action.externalChildIDs.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/externalChildIds.properties sun.boot.library.path=/usr/java/jdk1.6.0_32/jre/lib/amd64 java.vm.version=20.7-b02 hadoop.root.logger=INFO,TLA java.vm.vendor=Sun Microsystems Inc. java.vendor.url=http\://java.sun.com/ path.separator=\: java.vm.name=Java HotSpot(TM) 64-Bit Server VM file.encoding.pkg=sun.io sun.java.launcher=SUN_STANDARD user.country=US sun.os.patch.level=unknown java.vm.specification.name=Java Virtual Machine Specification user.dir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work java.runtime.version=1.6.0_32-b05 java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment java.endorsed.dirs=/usr/java/jdk1.6.0_32/jre/lib/endorsed os.arch=amd64 oozie.job.id=0000039-140127061714030-oozie-oozi-W oozie.action.id=0000039-140127061714030-oozie-oozi-W@MRJ java.io.tmpdir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/tmp line.separator=\n oozie.action.output.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/output.properties hadoop.tasklog.totalLogFileSize=0 java.vm.specification.vendor=Sun Microsystems Inc. os.name=Linux log4j.configuration=task-log4j.properties sun.jnu.encoding=UTF-8 java.library.path=/usr/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work oozie.action.conf.xml=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/action.xml java.specification.name=Java Platform API Specification java.class.version=50.0 sun.management.compiler=HotSpot 64-Bit Tiered Compilers os.version=2.6.32-220.el6.x86_64 user.home=/usr/lib/hadoop user.timezone=America/Los_Angeles java.awt.printerjob=sun.print.PSPrinterJob file.encoding=UTF-8 java.specification.version=1.6 java.class.path=/var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER\:/usr/java/jdk1.6.0_32/lib/tools.jar\:/usr/lib/hadoop-0.20-mapreduce\:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar\:/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar\:/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar\:/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar\:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar\:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar\:/usr/lib/hadoop/lib/guava-11.0.2.jar\:/usr/lib/hadoop/lib/asm-3.2.jar\:/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop/lib/junit-4.8.2.jar\:/usr/lib/hadoop/lib/commons-net-3.1.jar\:/usr/lib/hadoop/lib/jline-0.9.94.jar\:/usr/lib/hadoop/lib/jersey-json-1.8.jar\:/usr/lib/hadoop/lib/servlet-api-2.5.jar\:/usr/lib/hadoop/lib/paranamer-2.3.jar\:/usr/lib/hadoop/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop/lib/jersey-core-1.8.jar\:/usr/lib/hadoop/lib/commons-lang-2.5.jar\:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop/lib/jsch-0.1.42.jar\:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop/lib/log4j-1.2.17.jar\:/usr/lib/hadoop/lib/avro-1.7.4.jar\:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop/lib/jettison-1.1.jar\:/usr/lib/hadoop/lib/commons-digester-1.8.jar\:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/xz-1.0.jar\:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop/lib/commons-cli-1.2.jar\:/usr/lib/hadoop/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop/lib/activation-1.1.jar\:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop/lib/jsp-api-2.1.jar\:/usr/lib/hadoop/lib/commons-math-2.1.jar\:/usr/lib/hadoop/lib/xmlenc-0.52.jar\:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop/lib/commons-io-2.1.jar\:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop/lib/kfs-0.3.jar\:/usr/lib/hadoop/lib/commons-codec-1.4.jar\:/usr/lib/hadoop/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop/lib/commons-el-1.0.jar\:/usr/lib/hadoop/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop/lib/jersey-server-1.8.jar\:/usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth.jar\:/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common.jar\:/usr/lib/hadoop/hadoop-annotations.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar\:/mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar\:/mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar\:/mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar\:/mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work user.name=mapred hadoop.tasklog.iscleanup=false oozie.action.newId.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/newId.properties java.vm.specification.version=1.0 sun.java.command=org.apache.hadoop.mapred.Child 127.0.0.1 46136 attempt_201401270439_0058_m_000000_0 /var/log/hadoop-0.20-mapreduce/userlogs/job_201401270439_0058/attempt_201401270439_0058_m_000000_0 -17914583 java.home=/usr/java/jdk1.6.0_32/jre sun.arch.data.model=64 user.language=en java.specification.vendor=Sun Microsystems Inc. hadoop.log.dir=/var/log/hadoop-0.20-mapreduce java.vm.info=mixed mode java.version=1.6.0_32 java.ext.dirs=/usr/java/jdk1.6.0_32/jre/lib/ext\:/usr/java/packages/lib/ext sun.boot.class.path=/usr/java/jdk1.6.0_32/jre/lib/resources.jar\:/usr/java/jdk1.6.0_32/jre/lib/rt.jar\:/usr/java/jdk1.6.0_32/jre/lib/sunrsasign.jar\:/usr/java/jdk1.6.0_32/jre/lib/jsse.jar\:/usr/java/jdk1.6.0_32/jre/lib/jce.jar\:/usr/java/jdk1.6.0_32/jre/lib/charsets.jar\:/usr/java/jdk1.6.0_32/jre/lib/modules/jdk.boot.jar\:/usr/java/jdk1.6.0_32/jre/classes java.vendor=Sun Microsystems Inc. file.separator=/ oozie.launcher.job.id=job_201401270439_0058 oozie.action.stats.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/stats.properties java.vendor.url.bug=http\://java.sun.com/cgi-bin/bugreport.cgi sun.io.unicode.encoding=UnicodeLittle sun.cpu.endian=little sun.cpu.isalist= ------------------------ ================================================================= >>> Invoking Main class now >>> <<< Invocation of Main class completed <<< Failing Oozie Launcher, Main class [Driver], exception invoking main(), java.lang.ClassNotFoundException: Class Driver not found java.lang.RuntimeException: java.lang.ClassNotFoundException: Class Driver not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1617) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:493) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332) at org.apache.hadoop.mapred.Child$4.run(Child.java:268) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408) at org.apache.hadoop.mapred.Child.main(Child.java:262) Caused by: java.lang.ClassNotFoundException: Class Driver not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1523) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1615) ... 9 more Oozie Launcher failed, finishing Hadoop job gracefully Oozie Launcher ends
I'm new to Hadoop and I have the flowing problem:
I keep getting a "java.lang.ClassNotFoundException" when I’m trying to run my oozzie work flow. I use the Cloudera quick start VM v 4.5.
used oozzie settings:
- Jar name : sample.jar
- Main class : Driver
- Arguments : in_single/ out
used java class
public class Driver{ public static class TokenizerMapper extends Mapper<Object, Text, Text, Text> { @Override public void map(final Object key, final Text value, final Mapper<Object, Text, Text, Text>.Context context) throws IOException, InterruptedException { context.write(new Text("key " + UUID.randomUUID().toString()), new Text("value " + UUID.randomUUID().toString())); } } public static class IntSumReducer extends Reducer<Text, Text, Text, Text> { private final IntWritable result = new IntWritable(); @Override public void reduce(final Text key, final Iterable<Text> values, final Reducer<Text, Text, Text, Text>.Context context) throws IOException, InterruptedException { for (Text value : values) context.write(new Text(UUID.randomUUID().toString()), new Text(value)); } } public static void main(final String[] args) throws Exception { Configuration conf = new Configuration(); String[] otherArgs = new GenericOptionsParser(conf, args).getRemainingArgs(); if (otherArgs.length != 2) { System.err.println("Usage: wordcount <in> <out>"); System.exit(2); } Job job = new Job(conf, "MRJ"); job.setJarByClass(Driver.class); job.setMapperClass(TokenizerMapper.class); job.setCombinerClass(IntSumReducer.class); job.setReducerClass(IntSumReducer.class); job.setOutputKeyClass(Text.class); job.setOutputValueClass(Text.class); FileInputFormat.addInputPath(job, new Path(otherArgs[0])); FileOutputFormat.setOutputPath(job, new Path(otherArgs[1])); System.exit(job.waitForCompletion(true) ? 0 : 1); }}
used pom.xml
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>LittleBigData.Sample</groupId> <artifactId>WordCountCeSample</artifactId> <version>0.0.1-SNAPSHOT</version> <dependencies> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-mapreduce-client-core</artifactId> <version>2.2.0</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.2.0</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-hdfs</artifactId> <version>2.2.0</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hbase</groupId> <artifactId>hbase</artifactId> <version>0.92.1</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>zookeeper</artifactId> <version>3.3.1</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.1</version> <configuration> <source>1.6</source> <target>1.6</target> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <version>2.2</version> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project>
Anyone knows why this is, and how I can solve this error?
added: stdout log
Oozie Launcher starts Heart beat Starting the execution of prepare actions Completed the execution of prepare actions successfully Files in current dir:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/. ====================== File: action.xml File: .action.xml.crc Dir: tmp Oozie Java/Map-Reduce/Pig action launcher-job configuration ================================================================= Workflow job id : 0000039-140127061714030-oozie-oozi-W Workflow action id: 0000039-140127061714030-oozie-oozi-W@MRJ Classpath : ------------------------ /var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER /usr/java/jdk1.6.0_32/lib/tools.jar /usr/lib/hadoop-0.20-mapreduce /usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar /usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar /usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar /usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar /usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar /usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar /usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar /usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar /usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar /usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar /usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar /usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar /usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar /usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar /usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar /usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar /usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar /usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar /usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar /usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar /usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar /usr/lib/hadoop-hdfs/lib/asm-3.2.jar /usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar /usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar /usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar /usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar /usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar /usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar /usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar /usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar /usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar /usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar /usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar /usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar /usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar /usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar /usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar /usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar /usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar /usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar /usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar /usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar /usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar /usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar /usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar /usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar /usr/lib/hadoop-hdfs/hadoop-hdfs.jar /usr/lib/hadoop/lib/guava-11.0.2.jar /usr/lib/hadoop/lib/asm-3.2.jar /usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar /usr/lib/hadoop/lib/slf4j-api-1.6.1.jar /usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar /usr/lib/hadoop/lib/junit-4.8.2.jar /usr/lib/hadoop/lib/commons-net-3.1.jar /usr/lib/hadoop/lib/jline-0.9.94.jar /usr/lib/hadoop/lib/jersey-json-1.8.jar /usr/lib/hadoop/lib/servlet-api-2.5.jar /usr/lib/hadoop/lib/paranamer-2.3.jar /usr/lib/hadoop/lib/stax-api-1.0.1.jar /usr/lib/hadoop/lib/jersey-core-1.8.jar /usr/lib/hadoop/lib/commons-lang-2.5.jar /usr/lib/hadoop/lib/commons-logging-1.1.1.jar /usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar /usr/lib/hadoop/lib/jsch-0.1.42.jar /usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar /usr/lib/hadoop/lib/log4j-1.2.17.jar /usr/lib/hadoop/lib/avro-1.7.4.jar /usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar /usr/lib/hadoop/lib/jettison-1.1.jar /usr/lib/hadoop/lib/commons-digester-1.8.jar /usr/lib/hadoop/lib/mockito-all-1.8.5.jar /usr/lib/hadoop/lib/jackson-xc-1.8.8.jar /usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar /usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar /usr/lib/hadoop/lib/xz-1.0.jar /usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar /usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar /usr/lib/hadoop/lib/commons-compress-1.4.1.jar /usr/lib/hadoop/lib/jaxb-api-2.2.2.jar /usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar /usr/lib/hadoop/lib/commons-httpclient-3.1.jar /usr/lib/hadoop/lib/commons-cli-1.2.jar /usr/lib/hadoop/lib/jsr305-1.3.9.jar /usr/lib/hadoop/lib/activation-1.1.jar /usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar /usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar /usr/lib/hadoop/lib/jsp-api-2.1.jar /usr/lib/hadoop/lib/commons-math-2.1.jar /usr/lib/hadoop/lib/xmlenc-0.52.jar /usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar /usr/lib/hadoop/lib/commons-io-2.1.jar /usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar /usr/lib/hadoop/lib/commons-collections-3.2.1.jar /usr/lib/hadoop/lib/kfs-0.3.jar /usr/lib/hadoop/lib/commons-codec-1.4.jar /usr/lib/hadoop/lib/commons-configuration-1.6.jar /usr/lib/hadoop/lib/commons-el-1.0.jar /usr/lib/hadoop/lib/jets3t-0.6.1.jar /usr/lib/hadoop/lib/jersey-server-1.8.jar /usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-auth.jar /usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar /usr/lib/hadoop/hadoop-common.jar /usr/lib/hadoop/hadoop-annotations.jar /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar /mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar /mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar /mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar /mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar /mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work ------------------------ Main class : Driver Maximum output : 2048 Arguments : in_single/ out Java System Properties: ------------------------ # #Tue Jan 28 05:33:17 PST 2014 java.runtime.name=Java(TM) SE Runtime Environment hadoop.tasklog.taskid=attempt_201401270439_0058_m_000000_0 oozie.action.externalChildIDs.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/externalChildIds.properties sun.boot.library.path=/usr/java/jdk1.6.0_32/jre/lib/amd64 java.vm.version=20.7-b02 hadoop.root.logger=INFO,TLA java.vm.vendor=Sun Microsystems Inc. java.vendor.url=http\://java.sun.com/ path.separator=\: java.vm.name=Java HotSpot(TM) 64-Bit Server VM file.encoding.pkg=sun.io sun.java.launcher=SUN_STANDARD user.country=US sun.os.patch.level=unknown java.vm.specification.name=Java Virtual Machine Specification user.dir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work java.runtime.version=1.6.0_32-b05 java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment java.endorsed.dirs=/usr/java/jdk1.6.0_32/jre/lib/endorsed os.arch=amd64 oozie.job.id=0000039-140127061714030-oozie-oozi-W oozie.action.id=0000039-140127061714030-oozie-oozi-W@MRJ java.io.tmpdir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/tmp line.separator=\n oozie.action.output.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/output.properties hadoop.tasklog.totalLogFileSize=0 java.vm.specification.vendor=Sun Microsystems Inc. os.name=Linux log4j.configuration=task-log4j.properties sun.jnu.encoding=UTF-8 java.library.path=/usr/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work oozie.action.conf.xml=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/action.xml java.specification.name=Java Platform API Specification java.class.version=50.0 sun.management.compiler=HotSpot 64-Bit Tiered Compilers os.version=2.6.32-220.el6.x86_64 user.home=/usr/lib/hadoop user.timezone=America/Los_Angeles java.awt.printerjob=sun.print.PSPrinterJob file.encoding=UTF-8 java.specification.version=1.6 java.class.path=/var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER\:/usr/java/jdk1.6.0_32/lib/tools.jar\:/usr/lib/hadoop-0.20-mapreduce\:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar\:/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar\:/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar\:/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar\:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar\:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar\:/usr/lib/hadoop/lib/guava-11.0.2.jar\:/usr/lib/hadoop/lib/asm-3.2.jar\:/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop/lib/junit-4.8.2.jar\:/usr/lib/hadoop/lib/commons-net-3.1.jar\:/usr/lib/hadoop/lib/jline-0.9.94.jar\:/usr/lib/hadoop/lib/jersey-json-1.8.jar\:/usr/lib/hadoop/lib/servlet-api-2.5.jar\:/usr/lib/hadoop/lib/paranamer-2.3.jar\:/usr/lib/hadoop/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop/lib/jersey-core-1.8.jar\:/usr/lib/hadoop/lib/commons-lang-2.5.jar\:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop/lib/jsch-0.1.42.jar\:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop/lib/log4j-1.2.17.jar\:/usr/lib/hadoop/lib/avro-1.7.4.jar\:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop/lib/jettison-1.1.jar\:/usr/lib/hadoop/lib/commons-digester-1.8.jar\:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/xz-1.0.jar\:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop/lib/commons-cli-1.2.jar\:/usr/lib/hadoop/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop/lib/activation-1.1.jar\:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop/lib/jsp-api-2.1.jar\:/usr/lib/hadoop/lib/commons-math-2.1.jar\:/usr/lib/hadoop/lib/xmlenc-0.52.jar\:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop/lib/commons-io-2.1.jar\:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop/lib/kfs-0.3.jar\:/usr/lib/hadoop/lib/commons-codec-1.4.jar\:/usr/lib/hadoop/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop/lib/commons-el-1.0.jar\:/usr/lib/hadoop/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop/lib/jersey-server-1.8.jar\:/usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth.jar\:/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common.jar\:/usr/lib/hadoop/hadoop-annotations.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar\:/mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar\:/mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar\:/mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar\:/mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work user.name=mapred hadoop.tasklog.iscleanup=false oozie.action.newId.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/newId.properties java.vm.specification.version=1.0 sun.java.command=org.apache.hadoop.mapred.Child 127.0.0.1 46136 attempt_201401270439_0058_m_000000_0 /var/log/hadoop-0.20-mapreduce/userlogs/job_201401270439_0058/attempt_201401270439_0058_m_000000_0 -17914583 java.home=/usr/java/jdk1.6.0_32/jre sun.arch.data.model=64 user.language=en java.specification.vendor=Sun Microsystems Inc. hadoop.log.dir=/var/log/hadoop-0.20-mapreduce java.vm.info=mixed mode java.version=1.6.0_32 java.ext.dirs=/usr/java/jdk1.6.0_32/jre/lib/ext\:/usr/java/packages/lib/ext sun.boot.class.path=/usr/java/jdk1.6.0_32/jre/lib/resources.jar\:/usr/java/jdk1.6.0_32/jre/lib/rt.jar\:/usr/java/jdk1.6.0_32/jre/lib/sunrsasign.jar\:/usr/java/jdk1.6.0_32/jre/lib/jsse.jar\:/usr/java/jdk1.6.0_32/jre/lib/jce.jar\:/usr/java/jdk1.6.0_32/jre/lib/charsets.jar\:/usr/java/jdk1.6.0_32/jre/lib/modules/jdk.boot.jar\:/usr/java/jdk1.6.0_32/jre/classes java.vendor=Sun Microsystems Inc. file.separator=/ oozie.launcher.job.id=job_201401270439_0058 oozie.action.stats.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/stats.properties java.vendor.url.bug=http\://java.sun.com/cgi-bin/bugreport.cgi sun.io.unicode.encoding=UnicodeLittle sun.cpu.endian=little sun.cpu.isalist= ------------------------ ================================================================= >>> Invoking Main class now >>> <<< Invocation of Main class completed <<< Failing Oozie Launcher, Main class [Driver], exception invoking main(), java.lang.ClassNotFoundException: Class Driver not found java.lang.RuntimeException: java.lang.ClassNotFoundException: Class Driver not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1617) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:493) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332) at org.apache.hadoop.mapred.Child$4.run(Child.java:268) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408) at org.apache.hadoop.mapred.Child.main(Child.java:262) Caused by: java.lang.ClassNotFoundException: Class Driver not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1523) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1615) ... 9 more Oozie Launcher failed, finishing Hadoop job gracefully Oozie Launcher ends
原文:https://stackoverflow.com/questions/21406658
最满意答案
我发现为什么我的代码不起作用。 创建纹理时,宽度和高度必须为2的幂。例如,如果宽度为1920,则应创建宽度为2048的纹理(因为2048是接下来的2次幂)。
将initTexture更改为以下。 现在我可以将文本绘制到SkBitmap,然后将位图上传到纹理并绘制纹理。
下面是新的initTexture,它将给定的位图上传到纹理。
bool initTexture(Texture* texture, const SkBitmap &bitmap) { bool result = true; SkAutoLockPixels alp(bitmap); const int w = bitmap.width(); const int h = bitmap.height(); const void* p = bitmap.getPixels(); int tw = 1 << (31 - __builtin_clz(w)); int th = 1 << (31 - __builtin_clz(h)); if (tw < w) tw <<= 1; if (th < h) th <<= 1; if (NULL == texture) return false; if (texture->id != 0) { glBindTexture(GL_TEXTURE_2D, texture->id); switch (bitmap.getConfig()) { case SkBitmap::kA8_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_ALPHA, GL_UNSIGNED_BYTE, p); break; case SkBitmap::kARGB_4444_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p); break; case SkBitmap::kARGB_8888_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_BYTE, p); break; case SkBitmap::kRGB_565_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p); break; default: break; } return true; } GLint crop[4] = { 0, h, w, -h }; texture->w = w; texture->h = h; glEnable (GL_TEXTURE_2D); glGenTextures(1, &(texture->id)); glBindTexture(GL_TEXTURE_2D, texture->id); switch (bitmap.getConfig()) { case SkBitmap::kA8_Config: glTexImage2D(GL_TEXTURE_2D, 0, GL_ALPHA, w, h, 0, GL_ALPHA, GL_UNSIGNED_BYTE, p); break; case SkBitmap::kARGB_4444_Config: glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p); break; case SkBitmap::kARGB_8888_Config: if (tw != w || th != h) { glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, tw, th, 0, GL_RGBA, GL_UNSIGNED_BYTE, 0); glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_BYTE, p); } else { glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_BYTE, p); } break; case SkBitmap::kRGB_565_Config: glTexImage2D(GL_TEXTURE_2D, 0, GL_RGB, w, h, 0, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p); break; default: break; } glTexParameteriv(GL_TEXTURE_2D, GL_TEXTURE_CROP_RECT_OES, crop); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_S, GL_REPEAT); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_T, GL_REPEAT); return result; }
I found why my code didn't work. When creating textures, the width and height must be power of 2. For example, if the width is 1920, then texture should be created with a width of 2048 (as 2048 is next 2 power).
Changed initTexture to below. Now I am able to draw text to SkBitmap and then upload the bitmap to texture and draw the texture.
Below is new initTexture that uploads given bitmap to a texture.
bool initTexture(Texture* texture, const SkBitmap &bitmap) { bool result = true; SkAutoLockPixels alp(bitmap); const int w = bitmap.width(); const int h = bitmap.height(); const void* p = bitmap.getPixels(); int tw = 1 << (31 - __builtin_clz(w)); int th = 1 << (31 - __builtin_clz(h)); if (tw < w) tw <<= 1; if (th < h) th <<= 1; if (NULL == texture) return false; if (texture->id != 0) { glBindTexture(GL_TEXTURE_2D, texture->id); switch (bitmap.getConfig()) { case SkBitmap::kA8_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_ALPHA, GL_UNSIGNED_BYTE, p); break; case SkBitmap::kARGB_4444_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p); break; case SkBitmap::kARGB_8888_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_BYTE, p); break; case SkBitmap::kRGB_565_Config: glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p); break; default: break; } return true; } GLint crop[4] = { 0, h, w, -h }; texture->w = w; texture->h = h; glEnable (GL_TEXTURE_2D); glGenTextures(1, &(texture->id)); glBindTexture(GL_TEXTURE_2D, texture->id); switch (bitmap.getConfig()) { case SkBitmap::kA8_Config: glTexImage2D(GL_TEXTURE_2D, 0, GL_ALPHA, w, h, 0, GL_ALPHA, GL_UNSIGNED_BYTE, p); break; case SkBitmap::kARGB_4444_Config: glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p); break; case SkBitmap::kARGB_8888_Config: if (tw != w || th != h) { glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, tw, th, 0, GL_RGBA, GL_UNSIGNED_BYTE, 0); glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_BYTE, p); } else { glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_BYTE, p); } break; case SkBitmap::kRGB_565_Config: glTexImage2D(GL_TEXTURE_2D, 0, GL_RGB, w, h, 0, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p); break; default: break; } glTexParameteriv(GL_TEXTURE_2D, GL_TEXTURE_CROP_RECT_OES, crop); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_S, GL_REPEAT); glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_T, GL_REPEAT); return result; }
相关问答
更多-
原文答案2017年11月28日: 我认为这是最近版本的nvidia软件包中的一个错误: https://bugs.launchpad.net/ubuntu/+source/nvidia-graphics-drivers-384/+bug/1731968 发行:Ubuntu 16.04.3 LTS 软件包版本:384.90-0ubuntu0.16.04.2 在最新的驱动程序384.90-0ubuntu0.16.04.2中,EGL初始化现在被破坏,返回的GL上下文不一致导致崩溃。 我准备了一个最小化的测试用例来 ...
-
如何解决问题: 添加库搜索路径 此屏幕截图显示了执行以下步骤的位置: 添加Skia Library Path Image 在Project Navigator中,单击项目的图标。 在项目导航器旁边的主窗口部分左侧的面板中:再次单击您的项目图标以打开项目全局信息和设置。 在主窗口部分顶部的导航栏中:单击“构建设置” 使shure下面的视图过滤器设置为“全部”和“组合”,这样您就不会错过任何设置。 在选项搜索表单中输入“库搜索路径”以查找“库搜索路径”的条目 双击条目“库搜索路径”以接收弹出窗口,您可以在其中指 ...
-
事实证明它无法检测到它是从它接收的前1024个字节中的实际图像。如果它没有检测到文件是实际图像,它将不会打扰其余的解码,因此只有read []被调用一旦。 turns out that it wasnt able to detect that it was an actual image from the first 1024 bytes it takes in. If it doesnt detect that the file is an actual image, it will not bother ...
-
您可以拍摄照片并将其保存为设备文件夹中的SKImage,然后将其作为流并调整大小并重新保存 SKImage snapI = e.Surface.Snapshot(); SKData pngImage = snapI.Encode(); var x= Path.Combine(Environment.GetFolderPath(Environment.SpecialFolder.Personal), "FolderName"); var ful ...
-
我发现为什么我的代码不起作用。 创建纹理时,宽度和高度必须为2的幂。例如,如果宽度为1920,则应创建宽度为2048的纹理(因为2048是接下来的2次幂)。 将initTexture更改为以下。 现在我可以将文本绘制到SkBitmap,然后将位图上传到纹理并绘制纹理。 下面是新的initTexture,它将给定的位图上传到纹理。 bool initTexture(Texture* texture, const SkBitmap &bitmap) { bool result = true; S ...
-
是的,Flutter也在iOS上与Skia一起呈现。 Skia是用C语言编写的,通常可以为任何平台编译。 Skia还直接处理图形硬件,因此不依赖于目标平台。 Yes, Flutter renders with Skia also on iOS. Skia is written in C and that can usually be compiled for any platform. Skia also addresses graphics hardware directly and therefore ...
-
看看SkSurface :: MakeRasterDirect() look at SkSurface::MakeRasterDirect()
-
我对Skia没有任何线索,我找不到任何关于其图像格式的文档,但这里的最后一个参数应该是步幅。 自然步幅将是4*image.Width 。 这也是Skia使用的吗? (stride是像素开头和低于该像素的像素之间的字节数) Cairo.Surface surface = new Cairo.ImageSurface ( image.Encode ().Data, Cairo.Format.Argb32, ...
-
我相信你想要匹配的东西将来自“界限” SkRect bounds; SkScalar textWidth = paint.measureText("some", 4, &bounds); 这是适合给定文本的最小矩形,而textWidth略大于该文本。 I believe what you are trying to match will come from "bounds" SkRect bounds; SkScalar textWidth = paint.measureText("some", 4, & ...
-
他们显然希望Skia能够通过某些东西加速,但它从未实际发生过。 PixelFlinger和libagl看起来很像OpenGL的早期版本,但实际上从未加速过。 最大的破坏是OpenGL ES的2.0版本。 它的大部分功能都在于它的着色语言,并且没有直接的方法可以通过Skia来利用它。 ICS实际上是一个重大的重新设计,他们放弃了Skia而不是使用OpenGL ES 2.0 - 具有所有的GLSL功能。 他们还非常需要在2.0中改进对FBO的支持。 它是新的TextureView和VideoView类的基础。 ...