首页 \ 问答 \ 通过多线程与使用诸如hbase / hive之类的选项一起写入HDFS(writing to HDFS via multi threading vs using options like hbase / hive)

通过多线程与使用诸如hbase / hive之类的选项一起写入HDFS(writing to HDFS via multi threading vs using options like hbase / hive)

 我需要以一种有效的方式使用JAVA API批量写入hadoop系统。 只需在这里查看选项。 
 

 与使用诸如hbase / hive之类的选项相比，通过多线程写入HDFS是一项昂贵的操作。 

I need to bulk write to the hadoop system using a JAVA API, in an efficient way. Just checking the options here.
 

Is writing to HDFS via multi threading an expensive operation compared to using options like hbase / hive.

原文：https://stackoverflow.com/questions/42274998
更新时间：2021-05-20 13:05

最满意答案

 您不能在项目中使用Bootstrap链接，并且可以删除文件中的内联样式。 我已经解决了你的错误，它完美的工作......你可以在你的项目文件夹中试试这个html文件然后运行它... 
 

 

 
 
 
  
<html>
<head>
	<link href="https://fonts.googleapis.com/css?family=Montserrat" rel="stylesheet">
	<link rel="stylesheet" type="text/css" href="thumb-css/style.css">
	<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/css/bootstrap.min.css">
</head>
<body>
<div class="isotope-wrap">
    <div class="col-lg-12 offset-top-34">
        <div data-isotope-layout="fitRows" data-isotope-group="gallery" class="isotope isotope--loaded" style="position: relative; height: 2100px;">
            <div class="row">
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item">
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
            	            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
            </div>
        </div>
    </div>
</div>
</body>
</html>
 
 
 

 


You can't use Bootstrap link in your project and you can remove inline style on your file. I have solved your error and it work perfectly ... you can try this html file in your project folder then run it ...
 

 

 
 
 
  
<html>
<head>
	<link href="https://fonts.googleapis.com/css?family=Montserrat" rel="stylesheet">
	<link rel="stylesheet" type="text/css" href="thumb-css/style.css">
	<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/css/bootstrap.min.css">
</head>
<body>
<div class="isotope-wrap">
    <div class="col-lg-12 offset-top-34">
        <div data-isotope-layout="fitRows" data-isotope-group="gallery" class="isotope isotope--loaded" style="position: relative; height: 2100px;">
            <div class="row">
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item">
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
            	            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
                <div data-filter="All" class="col-xs-12 col-sm-6 col-lg-4 isotope-item" >
                    <div class="inset-xl-left-20 inset-xl-right-20">
                        <a class="thumbnail-classic" href="index-variant-2.html" target="_blank">
                            <figure>
                                <img class="img-responsive" src="images/intense-570x428.jpg" alt="">
                                <figcaption class="thumbnail-classic-caption text-center">
                                    <h4 class="thumbnail-classic-title text-light" style="font-family: 'Montserrat', sans-serif; color: #212121;text-transform: uppercase; text-align: center; font-weight: 100">Intense</h4>
                                    <p class="thumbnail-classic-desc text-bold veil reveal-xs-block" style="font-family: 'Montserrat', sans-serif;text-transform: uppercase;font-weight: 100;text-align: center;">Feel the power of future</p>
                                </figcaption>
                            </figure>
                        </a>
                    </div>
                </div>
            </div>
        </div>
    </div>
</div>
</body>
</html>

相关问答

更多

  • 图片库源样本？(image gallery source sample? (like facebook app) [closed])[2024-01-12]

    以下链接包含图库应用程序的示例源代码。 请尝试： http : //gitorious.org/0xdroid/packages_apps_gallery3d/trees/3c02f2877dc2f8f0b5c01d03fa2b487c040e4000 Following link contains a sample source code for gallery application. Please try that also: http://gitorious.org/0xdroid/packages ...

  • 创建响应式图像库(Create Responsive Image Gallery)[2022-08-07]

    编辑：添加桌面视图。 总是把你的媒体查询结束，否则他们将被他们的后续选择器覆盖。 将您的非媒体查询.portofolio-list切换到flexbox。 您在portfolio-list中缺少list-style: none 。 基本上我添加了以下内容： * { box-sizing: border-box; margin: 0; padding: 0; } 重置浏览器页边距并防止框崩溃。 评论margin: -3px; 在.portfolio-list li以避免打破确切的居中。 https ...

  • 网格图库 - 宽度响应但需要高度才能响应(Grid image gallery - Width is responsive but need height to be responsive too)[2022-08-25]

    设置.line1{ height: auto;}和.line1{ height: auto; 这将使其保持响应。 检查jsfiddle示例。 Set both .line1{ height: auto;} and .line1{ height: auto; this will keep it responsive. Check the jsfiddle example.

  • Android上的图片库(Image Gallery on Android)[2022-12-31]

    检查你是否导入了正确的布局参数..我认为它应该是导入android.widget.Gallery.LayoutParams; 你可能正在进口其他一些..一看看它 请更改类名，xml文件和那里的图像 package com.exam.samplegalery; import android.app.Activity; import android.content.Context; import android.os.Bundle; import android.view.View; import andro ...

  • Drupal图片库教程[已关闭](Drupal Photo Gallery Tutorial [closed])[2022-04-25]

    这里有一个模块，用于放置图库的Views / CCK / Imagefield配置： http ://drupal.org/project/views_gallery 这种方法的好处是，你最终得到一个基于cck / views的图库，并且可以很容易地将它调整为任何你想要的东西（比如不想显示标题，图像在标题中弹出并带有标题等）并轻松地在别处重新使用图像的显示。 Here's a module that puts together the Views/CCK/Imagefield configuration f ...

  • 转盘图片库的问题(issue with carousel image gallery)[2022-12-27]

    测试你的小提琴，javascript工作得很好，只有css缺少以下属性： #gallery-wrapper { position:relative; } #gallery { position:absolute; } 代码也需要在内部执行 $(window).load(); 而不是$（document）.ready（）; 事件处理程序正常工作。 http://jsfiddle.net/kGAxa/42/ Tested your fiddle, javascript works well ...

  • 如何让我的图片库响应[关闭](How to make my image gallery responsive [closed])[2024-03-09]

    您不能在项目中使用Bootstrap链接，并且可以删除文件中的内联样式。 我已经解决了你的错误，它完美的工作......你可以在你的项目文件夹中试试这个html文件然后运行它...

    是否有任何插件可以为Drupal 7制作一些HuffPost图像库？(is there any plugin to make kind of HuffPost image gallery for Drupal 7? [closed])[2022-04-09]

    您可以简单地使用图像字段创建新的内容类型，并使用正文字段作为标题。 要呈现包含图像和标题的页面，您可以使用核心分类模块，也可以使用视图模块构建自定义视图。 You could simply create a new content type with an image field and use the body field for the caption. To render a page with images and captions you can either use the core taxon ...

  • 我的图片库的JavaScript代码(JavaScript code for my Image Gallery)[2022-09-24]

    这是您的图库的vanilla JS版本： var images = document.getElementsByClassName('thumbnails')[0].getElementsByTagName('img'); for (var i = 0; i < images.length; i++) { images[i].onmouseover = function () { document.getElementById('preview').src = this.src; ...

  • 使用砌体的响应式图库(Responsive image gallery using Masonry)[2023-12-25]

    所以小提琴不是很多帮助，但感谢发布你能做的代码...... 使用CSS中默认值的类命名约定，例如class =“image”是一个坏主意。 我无法用小提琴做很多事情......但是我去了演示并做了我认为你想要的。 你想要在所有画廊周围添加一个包装div HTML
    //this is where all the code in the gallery goes including the container on the ...

相关文章

更多
  • Hive入门之Hive与HBase整合
  • HBase和Hive的基本配置
  • Hadoop Hive与Hbase整合
  • HBase多线程建立HTable问题
  • HBase和NoSQL区别
  • 什么时候才应该使用HBase？
  • 基于Hadoop+Hive架构对海量数据进行查询
  • Hadoop-1.0.3+Hive-0.9.0+HBase-0.92.0单机伪分布式配置
  • Hadoop的Hbase环境搭建
  • Hadoop生态系统搭建（hadoop hive hbase zookeeper oozie sqoop）

    • 最新问答

    更多
  • 散列包括方法和/或嵌套属性(Hash include methods and/or nested attributes)
  • TensorFlow：基于索引列表创建新张量(TensorFlow: Create a new tensor based on list of indices)
  • 企业安全培训的各项内容
  • 错误：RPC失败;(error: RPC failed; curl transfer closed with outstanding read data remaining)
  • NumPy：将int64值存储在np.array中并使用dtype float64并将其转换回整数是否安全？(NumPy: Is it safe to store an int64 value in an np.array with dtype float64 and later convert it back to integer?)
  • 注销后如何隐藏导航portlet？(How to hide navigation portlet after logout?)
  • 将多个行和可变行移动到列(moving multiple and variable rows to columns)
  • 对setOnInfoWindowClickListener的意图(Intent on setOnInfoWindowClickListener)
  • Angular $资源不会改变方法(Angular $resource doesn't change method)
  • 如何配置Composite C1以将.m和桌面作为同一站点提供服务(How to configure Composite C1 to serve .m and desktop as the same site)
  • 不适用：悬停在悬停时：在元素之前[复制](Don't apply :hover when hovering on :before element [duplicate])
  • Mysql DB单个字段匹配多个其他字段(Mysql DB single field matching to multiple other fields)
  • 产品页面上的Magento Up出售对齐问题(Magento Up sell alignment issue on the products page)
  • 是否可以嵌套hazelcast IMaps？(Is it possible to nest hazelcast IMaps? And whick side effects can I expect? Is it a good Idea anyway?)
  • UIViewAnimationOptionRepeat在两个动画之间暂停(UIViewAnimationOptionRepeat pausing in between two animations)
  • 在x-kendo-template中使用Razor查询(Using Razor query within x-kendo-template)
  • 在BeautifulSoup中替换文本而不转义(Replace text without escaping in BeautifulSoup)
  • 如何在存根或模拟不存在的方法时配置Rspec以引发错误？(How can I configure Rspec to raise error when stubbing or mocking non-existing methods?)
  • asp用javascript(asp with javascript)
  • “％（）s”在sql查询中的含义是什么？(What does “%()s” means in sql query?)
  • 如何为其编辑的内容提供自定义UITableViewCell上下文？(How to give a custom UITableViewCell context of what it is editing?)
  • c ++十进制到二进制，然后使用操作，然后回到十进制(c++ Decimal to binary, then use operation, then back to decimal)
  • 以编程方式创建视频？(Create videos programmatically?)
  • 无法在BeautifulSoup中正确解析数据(Unable to parse data correctly in BeautifulSoup)
  • webform和mvc的区别 知乎
  • 如何使用wadl2java生成REST服务模板，其中POST / PUT方法具有参数？(How do you generate REST service template with wadl2java where POST/PUT methods have parameters?)
  • 我无法理解我的travis构建有什么问题(I am having trouble understanding what is wrong with my travis build)
  • iOS9 Scope Bar出现在Search Bar后面或旁边(iOS9 Scope Bar appears either behind or beside Search Bar)
  • 为什么开机慢上面还显示；Inetrnet,Explorer
  • 有关调用远程WCF服务的超时问题(Timeout Question about Invoking a Remote WCF Service)

    • Copyright ©2023 peixunduo.com All Rights Reserved.粤ICP备14003112号

    本站部分内容来源于互联网，仅供学习和参考使用，请莫用于商业用途。如有侵犯你的版权，请联系我们(neng862121861#163.com)，本站将尽快处理。谢谢合作！