首页 \ 问答 \ cloudera vm oozieWorkflow java.lang.ClassNotFoundException(cloudera vm oozieWorkflow java.lang.ClassNotFoundException)

cloudera vm oozieWorkflow java.lang.ClassNotFoundException(cloudera vm oozieWorkflow java.lang.ClassNotFoundException)

我是Hadoop的新手,我有一个流动的问题:

当我试图运行我的oozzie工作流程时,我不断收到“java.lang.ClassNotFoundException”。 我使用Cloudera快速启动VM v 4.5。

使用的oozzie设置:

  • Jar名称:sample.jar
  • 主要类别:司机
  • 参数:in_single / out

用过java类

public class Driver{
public static class TokenizerMapper extends Mapper<Object, Text, Text, Text>
{
    @Override
    public void map(final Object key, final Text value, final Mapper<Object, Text, Text, Text>.Context context) throws IOException, InterruptedException
    {
        context.write(new Text("key " + UUID.randomUUID().toString()), new Text("value " + UUID.randomUUID().toString()));
    }
}

public static class IntSumReducer extends Reducer<Text, Text, Text, Text>
{
    private final IntWritable   result  = new IntWritable();

    @Override
    public void reduce(final Text key, final Iterable<Text> values, final Reducer<Text, Text, Text, Text>.Context context) throws IOException, InterruptedException
    {
        for (Text value : values)
            context.write(new Text(UUID.randomUUID().toString()), new Text(value));
    }
}

public static void main(final String[] args) throws Exception
{
    Configuration conf = new Configuration();
    String[] otherArgs = new GenericOptionsParser(conf, args).getRemainingArgs();
    if (otherArgs.length != 2)
    {
        System.err.println("Usage: wordcount <in> <out>");
        System.exit(2);
    }

    Job job = new Job(conf, "MRJ");
    job.setJarByClass(Driver.class);
    job.setMapperClass(TokenizerMapper.class);
    job.setCombinerClass(IntSumReducer.class);
    job.setReducerClass(IntSumReducer.class);
    job.setOutputKeyClass(Text.class);
    job.setOutputValueClass(Text.class);
    FileInputFormat.addInputPath(job, new Path(otherArgs[0]));
    FileOutputFormat.setOutputPath(job, new Path(otherArgs[1]));
    System.exit(job.waitForCompletion(true) ? 0 : 1);
}}

用过pom.xml

    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <groupId>LittleBigData.Sample</groupId>
    <artifactId>WordCountCeSample</artifactId>
    <version>0.0.1-SNAPSHOT</version>

    <dependencies>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-mapreduce-client-core</artifactId>
            <version>2.2.0</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>2.2.0</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-hdfs</artifactId>
            <version>2.2.0</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hbase</groupId>
            <artifactId>hbase</artifactId>
            <version>0.92.1</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>zookeeper</artifactId>
            <version>3.3.1</version>
            <scope>provided</scope>
        </dependency>

    </dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-compiler-plugin</artifactId>
                <version>3.1</version>
                <configuration>
                    <source>1.6</source>
                    <target>1.6</target>
                </configuration>
            </plugin>


            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <version>2.2</version>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                    </execution>
                </executions>
            </plugin>

        </plugins>

    </build>

</project>

任何人都知道这是为什么,以及如何解决这个错误?

补充:stdout日志

Oozie Launcher starts

Heart beat

Starting the execution of prepare actions
Completed the execution of prepare actions successfully

Files in current dir:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/.
======================
File: action.xml
File: .action.xml.crc
Dir: tmp

Oozie Java/Map-Reduce/Pig action launcher-job configuration
=================================================================
Workflow job id   : 0000039-140127061714030-oozie-oozi-W
Workflow action id: 0000039-140127061714030-oozie-oozi-W@MRJ

Classpath         :
------------------------
/var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER
/usr/java/jdk1.6.0_32/lib/tools.jar
/usr/lib/hadoop-0.20-mapreduce
/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar
/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar
/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar
/usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar
/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar
/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar
/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar
/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar
/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar
/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar
/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar
/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar
/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar
/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar
/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar
/usr/lib/hadoop-hdfs/lib/asm-3.2.jar
/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar
/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar
/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar
/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar
/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar
/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar
/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar
/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar
/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar
/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar
/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar
/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar
/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar
/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar
/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar
/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar
/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar
/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs.jar
/usr/lib/hadoop/lib/guava-11.0.2.jar
/usr/lib/hadoop/lib/asm-3.2.jar
/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar
/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar
/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop/lib/junit-4.8.2.jar
/usr/lib/hadoop/lib/commons-net-3.1.jar
/usr/lib/hadoop/lib/jline-0.9.94.jar
/usr/lib/hadoop/lib/jersey-json-1.8.jar
/usr/lib/hadoop/lib/servlet-api-2.5.jar
/usr/lib/hadoop/lib/paranamer-2.3.jar
/usr/lib/hadoop/lib/stax-api-1.0.1.jar
/usr/lib/hadoop/lib/jersey-core-1.8.jar
/usr/lib/hadoop/lib/commons-lang-2.5.jar
/usr/lib/hadoop/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar
/usr/lib/hadoop/lib/jsch-0.1.42.jar
/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop/lib/log4j-1.2.17.jar
/usr/lib/hadoop/lib/avro-1.7.4.jar
/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar
/usr/lib/hadoop/lib/jettison-1.1.jar
/usr/lib/hadoop/lib/commons-digester-1.8.jar
/usr/lib/hadoop/lib/mockito-all-1.8.5.jar
/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar
/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar
/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar
/usr/lib/hadoop/lib/xz-1.0.jar
/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar
/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar
/usr/lib/hadoop/lib/commons-compress-1.4.1.jar
/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar
/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar
/usr/lib/hadoop/lib/commons-httpclient-3.1.jar
/usr/lib/hadoop/lib/commons-cli-1.2.jar
/usr/lib/hadoop/lib/jsr305-1.3.9.jar
/usr/lib/hadoop/lib/activation-1.1.jar
/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar
/usr/lib/hadoop/lib/jsp-api-2.1.jar
/usr/lib/hadoop/lib/commons-math-2.1.jar
/usr/lib/hadoop/lib/xmlenc-0.52.jar
/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar
/usr/lib/hadoop/lib/commons-io-2.1.jar
/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar
/usr/lib/hadoop/lib/commons-collections-3.2.1.jar
/usr/lib/hadoop/lib/kfs-0.3.jar
/usr/lib/hadoop/lib/commons-codec-1.4.jar
/usr/lib/hadoop/lib/commons-configuration-1.6.jar
/usr/lib/hadoop/lib/commons-el-1.0.jar
/usr/lib/hadoop/lib/jets3t-0.6.1.jar
/usr/lib/hadoop/lib/jersey-server-1.8.jar
/usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-auth.jar
/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-common.jar
/usr/lib/hadoop/hadoop-annotations.jar
/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar
/mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar
/mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar
/mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar
/mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar
/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
------------------------

Main class        : Driver

Maximum output    : 2048

Arguments         :
in_single/
out

Java System Properties:
------------------------
#
#Tue Jan 28 05:33:17 PST 2014
java.runtime.name=Java(TM) SE Runtime Environment
hadoop.tasklog.taskid=attempt_201401270439_0058_m_000000_0
oozie.action.externalChildIDs.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/externalChildIds.properties
sun.boot.library.path=/usr/java/jdk1.6.0_32/jre/lib/amd64
java.vm.version=20.7-b02
hadoop.root.logger=INFO,TLA
java.vm.vendor=Sun Microsystems Inc.
java.vendor.url=http\://java.sun.com/
path.separator=\:
java.vm.name=Java HotSpot(TM) 64-Bit Server VM
file.encoding.pkg=sun.io
sun.java.launcher=SUN_STANDARD
user.country=US
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
java.runtime.version=1.6.0_32-b05
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/usr/java/jdk1.6.0_32/jre/lib/endorsed
os.arch=amd64
oozie.job.id=0000039-140127061714030-oozie-oozi-W
oozie.action.id=0000039-140127061714030-oozie-oozi-W@MRJ
java.io.tmpdir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/tmp
line.separator=\n
oozie.action.output.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/output.properties
hadoop.tasklog.totalLogFileSize=0
java.vm.specification.vendor=Sun Microsystems Inc.
os.name=Linux
log4j.configuration=task-log4j.properties
sun.jnu.encoding=UTF-8
java.library.path=/usr/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
oozie.action.conf.xml=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/action.xml
java.specification.name=Java Platform API Specification
java.class.version=50.0
sun.management.compiler=HotSpot 64-Bit Tiered Compilers
os.version=2.6.32-220.el6.x86_64
user.home=/usr/lib/hadoop
user.timezone=America/Los_Angeles
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=UTF-8
java.specification.version=1.6
java.class.path=/var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER\:/usr/java/jdk1.6.0_32/lib/tools.jar\:/usr/lib/hadoop-0.20-mapreduce\:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar\:/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar\:/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar\:/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar\:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar\:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar\:/usr/lib/hadoop/lib/guava-11.0.2.jar\:/usr/lib/hadoop/lib/asm-3.2.jar\:/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop/lib/junit-4.8.2.jar\:/usr/lib/hadoop/lib/commons-net-3.1.jar\:/usr/lib/hadoop/lib/jline-0.9.94.jar\:/usr/lib/hadoop/lib/jersey-json-1.8.jar\:/usr/lib/hadoop/lib/servlet-api-2.5.jar\:/usr/lib/hadoop/lib/paranamer-2.3.jar\:/usr/lib/hadoop/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop/lib/jersey-core-1.8.jar\:/usr/lib/hadoop/lib/commons-lang-2.5.jar\:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop/lib/jsch-0.1.42.jar\:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop/lib/log4j-1.2.17.jar\:/usr/lib/hadoop/lib/avro-1.7.4.jar\:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop/lib/jettison-1.1.jar\:/usr/lib/hadoop/lib/commons-digester-1.8.jar\:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/xz-1.0.jar\:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop/lib/commons-cli-1.2.jar\:/usr/lib/hadoop/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop/lib/activation-1.1.jar\:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop/lib/jsp-api-2.1.jar\:/usr/lib/hadoop/lib/commons-math-2.1.jar\:/usr/lib/hadoop/lib/xmlenc-0.52.jar\:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop/lib/commons-io-2.1.jar\:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop/lib/kfs-0.3.jar\:/usr/lib/hadoop/lib/commons-codec-1.4.jar\:/usr/lib/hadoop/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop/lib/commons-el-1.0.jar\:/usr/lib/hadoop/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop/lib/jersey-server-1.8.jar\:/usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth.jar\:/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common.jar\:/usr/lib/hadoop/hadoop-annotations.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar\:/mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar\:/mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar\:/mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar\:/mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
user.name=mapred
hadoop.tasklog.iscleanup=false
oozie.action.newId.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/newId.properties
java.vm.specification.version=1.0
sun.java.command=org.apache.hadoop.mapred.Child 127.0.0.1 46136 attempt_201401270439_0058_m_000000_0 /var/log/hadoop-0.20-mapreduce/userlogs/job_201401270439_0058/attempt_201401270439_0058_m_000000_0 -17914583
java.home=/usr/java/jdk1.6.0_32/jre
sun.arch.data.model=64
user.language=en
java.specification.vendor=Sun Microsystems Inc.
hadoop.log.dir=/var/log/hadoop-0.20-mapreduce
java.vm.info=mixed mode
java.version=1.6.0_32
java.ext.dirs=/usr/java/jdk1.6.0_32/jre/lib/ext\:/usr/java/packages/lib/ext
sun.boot.class.path=/usr/java/jdk1.6.0_32/jre/lib/resources.jar\:/usr/java/jdk1.6.0_32/jre/lib/rt.jar\:/usr/java/jdk1.6.0_32/jre/lib/sunrsasign.jar\:/usr/java/jdk1.6.0_32/jre/lib/jsse.jar\:/usr/java/jdk1.6.0_32/jre/lib/jce.jar\:/usr/java/jdk1.6.0_32/jre/lib/charsets.jar\:/usr/java/jdk1.6.0_32/jre/lib/modules/jdk.boot.jar\:/usr/java/jdk1.6.0_32/jre/classes
java.vendor=Sun Microsystems Inc.
file.separator=/
oozie.launcher.job.id=job_201401270439_0058
oozie.action.stats.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/stats.properties
java.vendor.url.bug=http\://java.sun.com/cgi-bin/bugreport.cgi
sun.io.unicode.encoding=UnicodeLittle
sun.cpu.endian=little
sun.cpu.isalist=
------------------------

=================================================================

>>> Invoking Main class now >>>


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [Driver], exception invoking main(), java.lang.ClassNotFoundException: Class Driver not found
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class Driver not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1617)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:493)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.lang.ClassNotFoundException: Class Driver not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1523)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1615)
... 9 more

Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher ends

I'm new to Hadoop and I have the flowing problem:

I keep getting a "java.lang.ClassNotFoundException" when I’m trying to run my oozzie work flow. I use the Cloudera quick start VM v 4.5.

used oozzie settings:

  • Jar name : sample.jar
  • Main class : Driver
  • Arguments : in_single/ out

used java class

public class Driver{
public static class TokenizerMapper extends Mapper<Object, Text, Text, Text>
{
    @Override
    public void map(final Object key, final Text value, final Mapper<Object, Text, Text, Text>.Context context) throws IOException, InterruptedException
    {
        context.write(new Text("key " + UUID.randomUUID().toString()), new Text("value " + UUID.randomUUID().toString()));
    }
}

public static class IntSumReducer extends Reducer<Text, Text, Text, Text>
{
    private final IntWritable   result  = new IntWritable();

    @Override
    public void reduce(final Text key, final Iterable<Text> values, final Reducer<Text, Text, Text, Text>.Context context) throws IOException, InterruptedException
    {
        for (Text value : values)
            context.write(new Text(UUID.randomUUID().toString()), new Text(value));
    }
}

public static void main(final String[] args) throws Exception
{
    Configuration conf = new Configuration();
    String[] otherArgs = new GenericOptionsParser(conf, args).getRemainingArgs();
    if (otherArgs.length != 2)
    {
        System.err.println("Usage: wordcount <in> <out>");
        System.exit(2);
    }

    Job job = new Job(conf, "MRJ");
    job.setJarByClass(Driver.class);
    job.setMapperClass(TokenizerMapper.class);
    job.setCombinerClass(IntSumReducer.class);
    job.setReducerClass(IntSumReducer.class);
    job.setOutputKeyClass(Text.class);
    job.setOutputValueClass(Text.class);
    FileInputFormat.addInputPath(job, new Path(otherArgs[0]));
    FileOutputFormat.setOutputPath(job, new Path(otherArgs[1]));
    System.exit(job.waitForCompletion(true) ? 0 : 1);
}}

used pom.xml

    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <groupId>LittleBigData.Sample</groupId>
    <artifactId>WordCountCeSample</artifactId>
    <version>0.0.1-SNAPSHOT</version>

    <dependencies>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-mapreduce-client-core</artifactId>
            <version>2.2.0</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>2.2.0</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-hdfs</artifactId>
            <version>2.2.0</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hbase</groupId>
            <artifactId>hbase</artifactId>
            <version>0.92.1</version>
            <scope>provided</scope>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>zookeeper</artifactId>
            <version>3.3.1</version>
            <scope>provided</scope>
        </dependency>

    </dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-compiler-plugin</artifactId>
                <version>3.1</version>
                <configuration>
                    <source>1.6</source>
                    <target>1.6</target>
                </configuration>
            </plugin>


            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <version>2.2</version>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                    </execution>
                </executions>
            </plugin>

        </plugins>

    </build>

</project>

Anyone knows why this is, and how I can solve this error?

added: stdout log

Oozie Launcher starts

Heart beat

Starting the execution of prepare actions
Completed the execution of prepare actions successfully

Files in current dir:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/.
======================
File: action.xml
File: .action.xml.crc
Dir: tmp

Oozie Java/Map-Reduce/Pig action launcher-job configuration
=================================================================
Workflow job id   : 0000039-140127061714030-oozie-oozi-W
Workflow action id: 0000039-140127061714030-oozie-oozi-W@MRJ

Classpath         :
------------------------
/var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER
/usr/java/jdk1.6.0_32/lib/tools.jar
/usr/lib/hadoop-0.20-mapreduce
/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar
/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar
/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar
/usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar
/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar
/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar
/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar
/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar
/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar
/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar
/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar
/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar
/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar
/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar
/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar
/usr/lib/hadoop-hdfs/lib/asm-3.2.jar
/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar
/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar
/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar
/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar
/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar
/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar
/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar
/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar
/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar
/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar
/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar
/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar
/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar
/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar
/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar
/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar
/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar
/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs.jar
/usr/lib/hadoop/lib/guava-11.0.2.jar
/usr/lib/hadoop/lib/asm-3.2.jar
/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar
/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar
/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop/lib/junit-4.8.2.jar
/usr/lib/hadoop/lib/commons-net-3.1.jar
/usr/lib/hadoop/lib/jline-0.9.94.jar
/usr/lib/hadoop/lib/jersey-json-1.8.jar
/usr/lib/hadoop/lib/servlet-api-2.5.jar
/usr/lib/hadoop/lib/paranamer-2.3.jar
/usr/lib/hadoop/lib/stax-api-1.0.1.jar
/usr/lib/hadoop/lib/jersey-core-1.8.jar
/usr/lib/hadoop/lib/commons-lang-2.5.jar
/usr/lib/hadoop/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar
/usr/lib/hadoop/lib/jsch-0.1.42.jar
/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop/lib/log4j-1.2.17.jar
/usr/lib/hadoop/lib/avro-1.7.4.jar
/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar
/usr/lib/hadoop/lib/jettison-1.1.jar
/usr/lib/hadoop/lib/commons-digester-1.8.jar
/usr/lib/hadoop/lib/mockito-all-1.8.5.jar
/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar
/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar
/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar
/usr/lib/hadoop/lib/xz-1.0.jar
/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar
/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar
/usr/lib/hadoop/lib/commons-compress-1.4.1.jar
/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar
/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar
/usr/lib/hadoop/lib/commons-httpclient-3.1.jar
/usr/lib/hadoop/lib/commons-cli-1.2.jar
/usr/lib/hadoop/lib/jsr305-1.3.9.jar
/usr/lib/hadoop/lib/activation-1.1.jar
/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar
/usr/lib/hadoop/lib/jsp-api-2.1.jar
/usr/lib/hadoop/lib/commons-math-2.1.jar
/usr/lib/hadoop/lib/xmlenc-0.52.jar
/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar
/usr/lib/hadoop/lib/commons-io-2.1.jar
/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar
/usr/lib/hadoop/lib/commons-collections-3.2.1.jar
/usr/lib/hadoop/lib/kfs-0.3.jar
/usr/lib/hadoop/lib/commons-codec-1.4.jar
/usr/lib/hadoop/lib/commons-configuration-1.6.jar
/usr/lib/hadoop/lib/commons-el-1.0.jar
/usr/lib/hadoop/lib/jets3t-0.6.1.jar
/usr/lib/hadoop/lib/jersey-server-1.8.jar
/usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-auth.jar
/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar
/usr/lib/hadoop/hadoop-common.jar
/usr/lib/hadoop/hadoop-annotations.jar
/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar
/mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar
/mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar
/mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar
/mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar
/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
------------------------

Main class        : Driver

Maximum output    : 2048

Arguments         :
in_single/
out

Java System Properties:
------------------------
#
#Tue Jan 28 05:33:17 PST 2014
java.runtime.name=Java(TM) SE Runtime Environment
hadoop.tasklog.taskid=attempt_201401270439_0058_m_000000_0
oozie.action.externalChildIDs.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/externalChildIds.properties
sun.boot.library.path=/usr/java/jdk1.6.0_32/jre/lib/amd64
java.vm.version=20.7-b02
hadoop.root.logger=INFO,TLA
java.vm.vendor=Sun Microsystems Inc.
java.vendor.url=http\://java.sun.com/
path.separator=\:
java.vm.name=Java HotSpot(TM) 64-Bit Server VM
file.encoding.pkg=sun.io
sun.java.launcher=SUN_STANDARD
user.country=US
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
java.runtime.version=1.6.0_32-b05
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/usr/java/jdk1.6.0_32/jre/lib/endorsed
os.arch=amd64
oozie.job.id=0000039-140127061714030-oozie-oozi-W
oozie.action.id=0000039-140127061714030-oozie-oozi-W@MRJ
java.io.tmpdir=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/tmp
line.separator=\n
oozie.action.output.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/output.properties
hadoop.tasklog.totalLogFileSize=0
java.vm.specification.vendor=Sun Microsystems Inc.
os.name=Linux
log4j.configuration=task-log4j.properties
sun.jnu.encoding=UTF-8
java.library.path=/usr/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
oozie.action.conf.xml=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/action.xml
java.specification.name=Java Platform API Specification
java.class.version=50.0
sun.management.compiler=HotSpot 64-Bit Tiered Compilers
os.version=2.6.32-220.el6.x86_64
user.home=/usr/lib/hadoop
user.timezone=America/Los_Angeles
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=UTF-8
java.specification.version=1.6
java.class.path=/var/run/cloudera-scm-agent/process/10-mapreduce-TASKTRACKER\:/usr/java/jdk1.6.0_32/lib/tools.jar\:/usr/lib/hadoop-0.20-mapreduce\:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar\:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar\:/usr/share/cmf/lib/plugins/event-publish-4.7.2-shaded.jar\:/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.2.jar\:/usr/share/cmf/lib/plugins/navigator-plugin-4.7.2-shaded.jar\:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar\:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.4.0-tests.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar\:/usr/lib/hadoop/lib/guava-11.0.2.jar\:/usr/lib/hadoop/lib/asm-3.2.jar\:/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.4.0.jar\:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop/lib/junit-4.8.2.jar\:/usr/lib/hadoop/lib/commons-net-3.1.jar\:/usr/lib/hadoop/lib/jline-0.9.94.jar\:/usr/lib/hadoop/lib/jersey-json-1.8.jar\:/usr/lib/hadoop/lib/servlet-api-2.5.jar\:/usr/lib/hadoop/lib/paranamer-2.3.jar\:/usr/lib/hadoop/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop/lib/jersey-core-1.8.jar\:/usr/lib/hadoop/lib/commons-lang-2.5.jar\:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop/lib/jsch-0.1.42.jar\:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop/lib/log4j-1.2.17.jar\:/usr/lib/hadoop/lib/avro-1.7.4.jar\:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop/lib/jettison-1.1.jar\:/usr/lib/hadoop/lib/commons-digester-1.8.jar\:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/xz-1.0.jar\:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar\:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop/lib/commons-cli-1.2.jar\:/usr/lib/hadoop/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop/lib/activation-1.1.jar\:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop/lib/jsp-api-2.1.jar\:/usr/lib/hadoop/lib/commons-math-2.1.jar\:/usr/lib/hadoop/lib/xmlenc-0.52.jar\:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop/lib/commons-io-2.1.jar\:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop/lib/kfs-0.3.jar\:/usr/lib/hadoop/lib/commons-codec-1.4.jar\:/usr/lib/hadoop/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop/lib/commons-el-1.0.jar\:/usr/lib/hadoop/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop/lib/jersey-server-1.8.jar\:/usr/lib/hadoop/lib/hue-plugins-2.5.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-auth.jar\:/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.4.0.jar\:/usr/lib/hadoop/hadoop-common.jar\:/usr/lib/hadoop/hadoop-annotations.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0-tests.jar\:/mapred/local/taskTracker/distcache/-1860118727254658637_-1076703533_1494062849/localhost.localdomain/user/cloudera/oozie-oozi/0000039-140127061714030-oozie-oozi-W/MRJ--java/java-launcher.jar\:/mapred/local/taskTracker/distcache/-2689018396186434637_1026166682_1483994242/localhost.localdomain/user/hue/oozie/workspaces/_cloudera_-oozie-32-1390902497.72/lib/hadoop-examples.jar\:/mapred/local/taskTracker/distcache/7324599977783858114_-844170377_413593709/localhost.localdomain/user/oozie/share/lib/oozie/json-simple-1.1.jar\:/mapred/local/taskTracker/distcache/1983218835533269135_-24009080_413593767/localhost.localdomain/user/oozie/share/lib/oozie/oozie-sharelib-oozie-3.3.2-cdh4.4.0.jar\:/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work
user.name=mapred
hadoop.tasklog.iscleanup=false
oozie.action.newId.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/newId.properties
java.vm.specification.version=1.0
sun.java.command=org.apache.hadoop.mapred.Child 127.0.0.1 46136 attempt_201401270439_0058_m_000000_0 /var/log/hadoop-0.20-mapreduce/userlogs/job_201401270439_0058/attempt_201401270439_0058_m_000000_0 -17914583
java.home=/usr/java/jdk1.6.0_32/jre
sun.arch.data.model=64
user.language=en
java.specification.vendor=Sun Microsystems Inc.
hadoop.log.dir=/var/log/hadoop-0.20-mapreduce
java.vm.info=mixed mode
java.version=1.6.0_32
java.ext.dirs=/usr/java/jdk1.6.0_32/jre/lib/ext\:/usr/java/packages/lib/ext
sun.boot.class.path=/usr/java/jdk1.6.0_32/jre/lib/resources.jar\:/usr/java/jdk1.6.0_32/jre/lib/rt.jar\:/usr/java/jdk1.6.0_32/jre/lib/sunrsasign.jar\:/usr/java/jdk1.6.0_32/jre/lib/jsse.jar\:/usr/java/jdk1.6.0_32/jre/lib/jce.jar\:/usr/java/jdk1.6.0_32/jre/lib/charsets.jar\:/usr/java/jdk1.6.0_32/jre/lib/modules/jdk.boot.jar\:/usr/java/jdk1.6.0_32/jre/classes
java.vendor=Sun Microsystems Inc.
file.separator=/
oozie.launcher.job.id=job_201401270439_0058
oozie.action.stats.properties=/mapred/local/taskTracker/cloudera/jobcache/job_201401270439_0058/attempt_201401270439_0058_m_000000_0/work/stats.properties
java.vendor.url.bug=http\://java.sun.com/cgi-bin/bugreport.cgi
sun.io.unicode.encoding=UnicodeLittle
sun.cpu.endian=little
sun.cpu.isalist=
------------------------

=================================================================

>>> Invoking Main class now >>>


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [Driver], exception invoking main(), java.lang.ClassNotFoundException: Class Driver not found
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class Driver not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1617)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:493)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.lang.ClassNotFoundException: Class Driver not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1523)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1615)
... 9 more

Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher ends

原文:https://stackoverflow.com/questions/21406658
更新时间:2023-10-17 19:10

最满意答案

我发现为什么我的代码不起作用。 创建纹理时,宽度和高度必须为2的幂。例如,如果宽度为1920,则应创建宽度为2048的纹理(因为2048是接下来的2次幂)。

将initTexture更改为以下。 现在我可以将文本绘制到SkBitmap,然后将位图上传到纹理并绘制纹理。

下面是新的initTexture,它将给定的位图上传到纹理。

bool initTexture(Texture* texture, const SkBitmap &bitmap)
{
    bool result = true;
    SkAutoLockPixels alp(bitmap);

    const int w = bitmap.width();
    const int h = bitmap.height();
    const void* p = bitmap.getPixels();
    int tw = 1 << (31 - __builtin_clz(w));
    int th = 1 << (31 - __builtin_clz(h));
    if (tw < w)
        tw <<= 1;
    if (th < h)
        th <<= 1;

    if (NULL == texture)
        return false;
    if (texture->id != 0)
    {
        glBindTexture(GL_TEXTURE_2D, texture->id);
        switch (bitmap.getConfig())
        {
        case SkBitmap::kA8_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_ALPHA, GL_UNSIGNED_BYTE, p);
            break;
        case SkBitmap::kARGB_4444_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p);
            break;
        case SkBitmap::kARGB_8888_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_BYTE, p);
            break;
        case SkBitmap::kRGB_565_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p);
            break;
        default:
            break;
        }
        return true;
    }
    GLint crop[4] = { 0, h, w, -h };
    texture->w = w;
    texture->h = h;

    glEnable (GL_TEXTURE_2D);
    glGenTextures(1, &(texture->id));
    glBindTexture(GL_TEXTURE_2D, texture->id);

    switch (bitmap.getConfig())
    {
    case SkBitmap::kA8_Config:
        glTexImage2D(GL_TEXTURE_2D, 0, GL_ALPHA, w, h, 0, GL_ALPHA, GL_UNSIGNED_BYTE, p);
        break;
    case SkBitmap::kARGB_4444_Config:
        glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p);
        break;
    case SkBitmap::kARGB_8888_Config:
        if (tw != w || th != h)
        {
            glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, tw, th, 0, GL_RGBA,
                    GL_UNSIGNED_BYTE, 0);
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA,
                    GL_UNSIGNED_BYTE, p);
        }
        else
        {
            glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_BYTE, p);
        }
        break;
    case SkBitmap::kRGB_565_Config:
        glTexImage2D(GL_TEXTURE_2D, 0, GL_RGB, w, h, 0, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p);
        break;
    default:
        break;
    }

    glTexParameteriv(GL_TEXTURE_2D, GL_TEXTURE_CROP_RECT_OES, crop);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_S, GL_REPEAT);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_T, GL_REPEAT);
    return result;
}

I found why my code didn't work. When creating textures, the width and height must be power of 2. For example, if the width is 1920, then texture should be created with a width of 2048 (as 2048 is next 2 power).

Changed initTexture to below. Now I am able to draw text to SkBitmap and then upload the bitmap to texture and draw the texture.

Below is new initTexture that uploads given bitmap to a texture.

bool initTexture(Texture* texture, const SkBitmap &bitmap)
{
    bool result = true;
    SkAutoLockPixels alp(bitmap);

    const int w = bitmap.width();
    const int h = bitmap.height();
    const void* p = bitmap.getPixels();
    int tw = 1 << (31 - __builtin_clz(w));
    int th = 1 << (31 - __builtin_clz(h));
    if (tw < w)
        tw <<= 1;
    if (th < h)
        th <<= 1;

    if (NULL == texture)
        return false;
    if (texture->id != 0)
    {
        glBindTexture(GL_TEXTURE_2D, texture->id);
        switch (bitmap.getConfig())
        {
        case SkBitmap::kA8_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_ALPHA, GL_UNSIGNED_BYTE, p);
            break;
        case SkBitmap::kARGB_4444_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p);
            break;
        case SkBitmap::kARGB_8888_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA, GL_UNSIGNED_BYTE, p);
            break;
        case SkBitmap::kRGB_565_Config:
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p);
            break;
        default:
            break;
        }
        return true;
    }
    GLint crop[4] = { 0, h, w, -h };
    texture->w = w;
    texture->h = h;

    glEnable (GL_TEXTURE_2D);
    glGenTextures(1, &(texture->id));
    glBindTexture(GL_TEXTURE_2D, texture->id);

    switch (bitmap.getConfig())
    {
    case SkBitmap::kA8_Config:
        glTexImage2D(GL_TEXTURE_2D, 0, GL_ALPHA, w, h, 0, GL_ALPHA, GL_UNSIGNED_BYTE, p);
        break;
    case SkBitmap::kARGB_4444_Config:
        glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_SHORT_4_4_4_4, p);
        break;
    case SkBitmap::kARGB_8888_Config:
        if (tw != w || th != h)
        {
            glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, tw, th, 0, GL_RGBA,
                    GL_UNSIGNED_BYTE, 0);
            glTexSubImage2D(GL_TEXTURE_2D, 0, 0, 0, w, h, GL_RGBA,
                    GL_UNSIGNED_BYTE, p);
        }
        else
        {
            glTexImage2D(GL_TEXTURE_2D, 0, GL_RGBA, w, h, 0, GL_RGBA, GL_UNSIGNED_BYTE, p);
        }
        break;
    case SkBitmap::kRGB_565_Config:
        glTexImage2D(GL_TEXTURE_2D, 0, GL_RGB, w, h, 0, GL_RGB, GL_UNSIGNED_SHORT_5_6_5, p);
        break;
    default:
        break;
    }

    glTexParameteriv(GL_TEXTURE_2D, GL_TEXTURE_CROP_RECT_OES, crop);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_S, GL_REPEAT);
    glTexParameterx(GL_TEXTURE_2D, GL_TEXTURE_WRAP_T, GL_REPEAT);
    return result;
}

相关问答

更多

相关文章

更多

最新问答

更多
  • 您如何使用git diff文件,并将其应用于同一存储库的副本的本地分支?(How do you take a git diff file, and apply it to a local branch that is a copy of the same repository?)
  • 将长浮点值剪切为2个小数点并复制到字符数组(Cut Long Float Value to 2 decimal points and copy to Character Array)
  • OctoberCMS侧边栏不呈现(OctoberCMS Sidebar not rendering)
  • 页面加载后对象是否有资格进行垃圾回收?(Are objects eligible for garbage collection after the page loads?)
  • codeigniter中的语言不能按预期工作(language in codeigniter doesn' t work as expected)
  • 在计算机拍照在哪里进入
  • 使用cin.get()从c ++中的输入流中丢弃不需要的字符(Using cin.get() to discard unwanted characters from the input stream in c++)
  • No for循环将在for循环中运行。(No for loop will run inside for loop. Testing for primes)
  • 单页应用程序:页面重新加载(Single Page Application: page reload)
  • 在循环中选择具有相似模式的列名称(Selecting Column Name With Similar Pattern in a Loop)
  • System.StackOverflow错误(System.StackOverflow error)
  • KnockoutJS未在嵌套模板上应用beforeRemove和afterAdd(KnockoutJS not applying beforeRemove and afterAdd on nested templates)
  • 散列包括方法和/或嵌套属性(Hash include methods and/or nested attributes)
  • android - 如何避免使用Samsung RFS文件系统延迟/冻结?(android - how to avoid lag/freezes with Samsung RFS filesystem?)
  • TensorFlow:基于索引列表创建新张量(TensorFlow: Create a new tensor based on list of indices)
  • 企业安全培训的各项内容
  • 错误:RPC失败;(error: RPC failed; curl transfer closed with outstanding read data remaining)
  • C#类名中允许哪些字符?(What characters are allowed in C# class name?)
  • NumPy:将int64值存储在np.array中并使用dtype float64并将其转换回整数是否安全?(NumPy: Is it safe to store an int64 value in an np.array with dtype float64 and later convert it back to integer?)
  • 注销后如何隐藏导航portlet?(How to hide navigation portlet after logout?)
  • 将多个行和可变行移动到列(moving multiple and variable rows to columns)
  • 提交表单时忽略基础href,而不使用Javascript(ignore base href when submitting form, without using Javascript)
  • 对setOnInfoWindowClickListener的意图(Intent on setOnInfoWindowClickListener)
  • Angular $资源不会改变方法(Angular $resource doesn't change method)
  • 在Angular 5中不是一个函数(is not a function in Angular 5)
  • 如何配置Composite C1以将.m和桌面作为同一站点提供服务(How to configure Composite C1 to serve .m and desktop as the same site)
  • 不适用:悬停在悬停时:在元素之前[复制](Don't apply :hover when hovering on :before element [duplicate])
  • 常见的python rpc和cli接口(Common python rpc and cli interface)
  • Mysql DB单个字段匹配多个其他字段(Mysql DB single field matching to multiple other fields)
  • 产品页面上的Magento Up出售对齐问题(Magento Up sell alignment issue on the products page)