首页 \ 问答 \ Hadoop Java错误:线程“main”中的异常java.lang.ClassNotFoundException:Titanic(Hadoop Java Error : Exception in thread “main” java.lang.ClassNotFoundException: Titanic)

Hadoop Java错误:线程“main”中的异常java.lang.ClassNotFoundException:Titanic(Hadoop Java Error : Exception in thread “main” java.lang.ClassNotFoundException: Titanic)

我正在尝试运行一个简单的MapReduce程序来计算男性和女性的平均年龄。 当我试图执行它时,它会给我Class Not Found Exception(泰坦尼克类)。 我发现许多问题提供了类似的答案,并基于我修改了我的程序,但它仍然给我同样的错误。 如果任何人都可以调试它,那将是非常有用的。

import java.io.IOException;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.conf.*;
import org.apache.hadoop.io.*;
import org.apache.hadoop.mapreduce.*;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.input.TextInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.mapreduce.lib.output.TextOutputFormat;

public class Titanic{
public static class Map extends Mapper<LongWritable, Text, Text, IntWritable>{
    private Text category = new Text();
    public void map(LongWritable key, Text text, Context context) throws IOException, InterruptedException{
        String line = text.toString();
        String str[] = line.split(",");
        if(str[4] == "male"){
            category.set(str[4]);
        }else{
            category.set(str[4]);
        }
        IntWritable value = new IntWritable(Integer.parseInt(str[5]));
        context.write(category,value);
    }

}

public static class Reduce extends Reducer<Text, IntWritable, Text, FloatWritable>{

    public void reduce(Text key, Iterable<IntWritable> values, Context context) throws IOException, InterruptedException{
        float average = 0;
        int count =0;
        for(IntWritable val : values){
                average = average+val.get();
                count = count + 1;              
        }
        average =average/count;
        context.write(key, new FloatWritable(average));

    }   

}

public static void main(String[] args) throws Exception{
    Configuration conf = new Configuration();
    Job job = Job.getInstance(conf, "titanic");
    job.setJarByClass(Titanic.class);
    job.setMapperClass(Map.class);
    job.setReducerClass(Reduce.class);
    job.setMapOutputKeyClass(Text.class);
    job.setMapOutputValueClass(IntWritable.class);
    FileInputFormat.addInputPath(job, new Path(args[0]));
    FileOutputFormat.setOutputPath(job, new Path(args[1]));
    System.exit(job.waitForCompletion(true) ? 0 : 1);       
}

}

下面是我执行的命令。

创建一个jar文件:

jar cf example/titanic/titanic.jar example/titanic/Titanic*.class

执行一个jar文件:

bin/hadoop jar example/titanic/titanic.jar Titanic /user/akhil/titanic/input/TitanicData.txt /user/akhil/titanic/output/

I am trying to run a simple MapReduce program which calculates the average age of male and female. When i am trying to execute it, it is giving me Class Not Found Exception (Titanic class). I have found many questions which has provided the similar answer and based on that i have modified my program but still it's giving me same error. It would be really helpfull if anyone can debug it.

import java.io.IOException;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.conf.*;
import org.apache.hadoop.io.*;
import org.apache.hadoop.mapreduce.*;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.input.TextInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.mapreduce.lib.output.TextOutputFormat;

public class Titanic{
public static class Map extends Mapper<LongWritable, Text, Text, IntWritable>{
    private Text category = new Text();
    public void map(LongWritable key, Text text, Context context) throws IOException, InterruptedException{
        String line = text.toString();
        String str[] = line.split(",");
        if(str[4] == "male"){
            category.set(str[4]);
        }else{
            category.set(str[4]);
        }
        IntWritable value = new IntWritable(Integer.parseInt(str[5]));
        context.write(category,value);
    }

}

public static class Reduce extends Reducer<Text, IntWritable, Text, FloatWritable>{

    public void reduce(Text key, Iterable<IntWritable> values, Context context) throws IOException, InterruptedException{
        float average = 0;
        int count =0;
        for(IntWritable val : values){
                average = average+val.get();
                count = count + 1;              
        }
        average =average/count;
        context.write(key, new FloatWritable(average));

    }   

}

public static void main(String[] args) throws Exception{
    Configuration conf = new Configuration();
    Job job = Job.getInstance(conf, "titanic");
    job.setJarByClass(Titanic.class);
    job.setMapperClass(Map.class);
    job.setReducerClass(Reduce.class);
    job.setMapOutputKeyClass(Text.class);
    job.setMapOutputValueClass(IntWritable.class);
    FileInputFormat.addInputPath(job, new Path(args[0]));
    FileOutputFormat.setOutputPath(job, new Path(args[1]));
    System.exit(job.waitForCompletion(true) ? 0 : 1);       
}

}

below are the commands i have executed on it.

creating a jar file:

jar cf example/titanic/titanic.jar example/titanic/Titanic*.class

executing a jar file:

bin/hadoop jar example/titanic/titanic.jar Titanic /user/akhil/titanic/input/TitanicData.txt /user/akhil/titanic/output/

原文:https://stackoverflow.com/questions/39647108
更新时间:2023-11-25 13:11

最满意答案

我找到了解决方案,用于查找当前URL以查找添加的标签 - > slug,删除它并获取新URL:

    $only_tags = substr($URI, strrpos($URI,'/')+1);
    $tags = explode('+',$only_tags);
    $tags_string = implode('+',$tags);

工作代码如下:

  for($f = 0, $s = 0; $f <= count($terms_name), $s <= count($terms_slug); $f++, $s++){

        if(!empty($result_name[$f]) && !is_category() || !empty($result_slug[$s]) && !is_category() ){

        $only_tags = substr($URI, strrpos($URI,'/')+1);
        $tags = explode('+',$only_tags);

        foreach ($tags as $t_key=>$t_value) {
        if ($t_value == $result_slug[$s]) unset ($tags[$t_key]);
         }
        $tags_string = implode('+',$tags);

        echo '<div class="tagCloud-cover" id="cat-hide-'. $s .'"><a class="cat-hide-link" href="'. $URI .'+'. $result_slug[$s] .'" >+</a>';
        echo '<a href="'. $result_slug[$s] .'" rel="tag">' . $result_name[$f] . '</a>'; 
        echo '<a href="'. $tags_string .'" >-</a></div>';
        if (false !== strpos($Path, $result_slug[$s])) {
        echo '<style>#cat-hide-'. $s .'{display:none;}</style>';
        echo '<div class="tagCloud-cover" id="cat-hide"><span class="cat-hide-link" >+</span>';
        echo '<a href="'. $result_slug[$s] .'" rel="tag">' . $result_name[$f] . '</a>';
        echo '<a href="'. $tags_string .'" >-</a></div>'; 

        }

        }

I find solution, what was used to devide current URL for finding added tags->slug, delete it and get new URL:

    $only_tags = substr($URI, strrpos($URI,'/')+1);
    $tags = explode('+',$only_tags);
    $tags_string = implode('+',$tags);

Working code below:

  for($f = 0, $s = 0; $f <= count($terms_name), $s <= count($terms_slug); $f++, $s++){

        if(!empty($result_name[$f]) && !is_category() || !empty($result_slug[$s]) && !is_category() ){

        $only_tags = substr($URI, strrpos($URI,'/')+1);
        $tags = explode('+',$only_tags);

        foreach ($tags as $t_key=>$t_value) {
        if ($t_value == $result_slug[$s]) unset ($tags[$t_key]);
         }
        $tags_string = implode('+',$tags);

        echo '<div class="tagCloud-cover" id="cat-hide-'. $s .'"><a class="cat-hide-link" href="'. $URI .'+'. $result_slug[$s] .'" >+</a>';
        echo '<a href="'. $result_slug[$s] .'" rel="tag">' . $result_name[$f] . '</a>'; 
        echo '<a href="'. $tags_string .'" >-</a></div>';
        if (false !== strpos($Path, $result_slug[$s])) {
        echo '<style>#cat-hide-'. $s .'{display:none;}</style>';
        echo '<div class="tagCloud-cover" id="cat-hide"><span class="cat-hide-link" >+</span>';
        echo '<a href="'. $result_slug[$s] .'" rel="tag">' . $result_name[$f] . '</a>';
        echo '<a href="'. $tags_string .'" >-</a></div>'; 

        }

        }

相关问答

更多

相关文章

更多

最新问答

更多
  • 您如何使用git diff文件,并将其应用于同一存储库的副本的本地分支?(How do you take a git diff file, and apply it to a local branch that is a copy of the same repository?)
  • 将长浮点值剪切为2个小数点并复制到字符数组(Cut Long Float Value to 2 decimal points and copy to Character Array)
  • OctoberCMS侧边栏不呈现(OctoberCMS Sidebar not rendering)
  • 页面加载后对象是否有资格进行垃圾回收?(Are objects eligible for garbage collection after the page loads?)
  • codeigniter中的语言不能按预期工作(language in codeigniter doesn' t work as expected)
  • 在计算机拍照在哪里进入
  • 使用cin.get()从c ++中的输入流中丢弃不需要的字符(Using cin.get() to discard unwanted characters from the input stream in c++)
  • No for循环将在for循环中运行。(No for loop will run inside for loop. Testing for primes)
  • 单页应用程序:页面重新加载(Single Page Application: page reload)
  • 在循环中选择具有相似模式的列名称(Selecting Column Name With Similar Pattern in a Loop)
  • System.StackOverflow错误(System.StackOverflow error)
  • KnockoutJS未在嵌套模板上应用beforeRemove和afterAdd(KnockoutJS not applying beforeRemove and afterAdd on nested templates)
  • 散列包括方法和/或嵌套属性(Hash include methods and/or nested attributes)
  • android - 如何避免使用Samsung RFS文件系统延迟/冻结?(android - how to avoid lag/freezes with Samsung RFS filesystem?)
  • TensorFlow:基于索引列表创建新张量(TensorFlow: Create a new tensor based on list of indices)
  • 企业安全培训的各项内容
  • 错误:RPC失败;(error: RPC failed; curl transfer closed with outstanding read data remaining)
  • C#类名中允许哪些字符?(What characters are allowed in C# class name?)
  • NumPy:将int64值存储在np.array中并使用dtype float64并将其转换回整数是否安全?(NumPy: Is it safe to store an int64 value in an np.array with dtype float64 and later convert it back to integer?)
  • 注销后如何隐藏导航portlet?(How to hide navigation portlet after logout?)
  • 将多个行和可变行移动到列(moving multiple and variable rows to columns)
  • 提交表单时忽略基础href,而不使用Javascript(ignore base href when submitting form, without using Javascript)
  • 对setOnInfoWindowClickListener的意图(Intent on setOnInfoWindowClickListener)
  • Angular $资源不会改变方法(Angular $resource doesn't change method)
  • 在Angular 5中不是一个函数(is not a function in Angular 5)
  • 如何配置Composite C1以将.m和桌面作为同一站点提供服务(How to configure Composite C1 to serve .m and desktop as the same site)
  • 不适用:悬停在悬停时:在元素之前[复制](Don't apply :hover when hovering on :before element [duplicate])
  • 常见的python rpc和cli接口(Common python rpc and cli interface)
  • Mysql DB单个字段匹配多个其他字段(Mysql DB single field matching to multiple other fields)
  • 产品页面上的Magento Up出售对齐问题(Magento Up sell alignment issue on the products page)