首页 \ 问答 \ 在运行mapred作业时，容器会根据请求被杀死(Container killed on request, while running mapred jobs)

在运行mapred作业时，容器会根据请求被杀死(Container killed on request, while running mapred jobs)

 我正在运行基准的tearasort程序，映射器阶段进展顺利。 但是当谈到减速机阶段时，我会得到以下信息。 最终工作失败了  
16/05/20 14:42:53 INFO mapreduce.Job: Task Id : attempt_1463557283514_0017_r_000008_1, Status : FAILED

Container [pid=54068,containerID=container_1463557283514_0017_01_018425] is running beyond physical memory limits. Current usage: 4.2 GB of 4 GB physical memory used; 8.1 GB of 8.4 GB virtual memory used. Killing container.

Dump of the process-tree for container_1463557283514_0017_01_018425 :
        |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
        |- 54068 54066 54068 54068 (bash) 0 0 115843072 362 /bin/bash -c /usr/java/jdk1.8.0_60/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN  -Xmx6144m -Djava.io.tmpdir=/u10/yarn/nm/usercache/username/appcache/application_1463557283514_0017/container_1463557283514_0017_01_018425/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 1x.4x.3x.9x 47528 attempt_1463557283514_0017_r_000008_1 18425 1>/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425/stdout 2>/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425/stderr
        |- 54073 54068 54068 54068 (java) 5355 6080 8573480960 1103372 /usr/java/jdk1.8.0_60/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx6144m -Djava.io.tmpdir=/u10/yarn/nm/usercache/username/appcache/application_1463557283514_0017/container_1463557283514_0017_01_018425/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 1x.4x.3x.9x 47528 attempt_1463557283514_0017_r_000008_1 18425

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
 
  

I am running benchmark tearasort program, mapper phase is going well. But when it comes to reducer phase i am getting below info. Ultimately job is failing 
16/05/20 14:42:53 INFO mapreduce.Job: Task Id : attempt_1463557283514_0017_r_000008_1, Status : FAILED

Container [pid=54068,containerID=container_1463557283514_0017_01_018425] is running beyond physical memory limits. Current usage: 4.2 GB of 4 GB physical memory used; 8.1 GB of 8.4 GB virtual memory used. Killing container.

Dump of the process-tree for container_1463557283514_0017_01_018425 :
        |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
        |- 54068 54066 54068 54068 (bash) 0 0 115843072 362 /bin/bash -c /usr/java/jdk1.8.0_60/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN  -Xmx6144m -Djava.io.tmpdir=/u10/yarn/nm/usercache/username/appcache/application_1463557283514_0017/container_1463557283514_0017_01_018425/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 1x.4x.3x.9x 47528 attempt_1463557283514_0017_r_000008_1 18425 1>/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425/stdout 2>/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425/stderr
        |- 54073 54068 54068 54068 (java) 5355 6080 8573480960 1103372 /usr/java/jdk1.8.0_60/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx6144m -Djava.io.tmpdir=/u10/yarn/nm/usercache/username/appcache/application_1463557283514_0017/container_1463557283514_0017_01_018425/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/u04/yarn/container-logs/application_1463557283514_0017/container_1463557283514_0017_01_018425 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 1x.4x.3x.9x 47528 attempt_1463557283514_0017_r_000008_1 18425

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
 

原文：https://stackoverflow.com/questions/37343171

更新时间：2022-06-06 13:06

最满意答案

 我将Linq用于xml并填充CollectionViewSource。 然后绑定到那个而不是xmlDataProvider。 

Once again, this guy's article helped me out. I moved my Teams XML into my Products.xml file, so I have the following format: 
<Products>
  <Product name="MyProduct1">
    <Components>
      <Component name="MyComponent1">
        <Teams>
          <Team id="1"/>
          <Team id="4"/>
        </Teams>
      </Component>
    </Components>
  </Product>
  <Teams>
    <Team name="Team A" id="1"/>
    <Team name="Team B" id="2"/>
    <Team name="Team C" id="3"/>
    <Team name="Team D" id="4"/>
  </Teams>  
</Products>
 
Then, I did the following for my ComboBox in XAML: 
<ComboBox Height="23" HorizontalAlignment="Left" Margin="133,218,0,0"
          Name="cbo_team" VerticalAlignment="Top" Width="148"
          DataContext="{Binding ElementName=cbo_component, Path=SelectedItem}">
    <ComboBox.ItemsSource>
        <Binding XPath="Teams/Team/@id"
                 Converter="{StaticResource xmlConverter}">
            <Binding.ConverterParameter>
                <local:XmlConverterParameter
                    XPathTemplate="/Products/Teams/Team[{0}]"
                    XPathCondition="@id='{0}'" />
            </Binding.ConverterParameter>
        </Binding>
    </ComboBox.ItemsSource>
    <ComboBox.ItemTemplate>
        <DataTemplate>
            <TextBlock Text="{Binding XPath=@name}" />
        </DataTemplate>
    </ComboBox.ItemTemplate>
</ComboBox>
 
I had to include the following in my <Window.Resources> in XAML: 
<local:XmlConverter x:Key="xmlConverter"/>
 
And, following his tutorial, I created two C# classes: XmlConverter and XmlConverterParameter. Now my ComboBox converts a team id to a name and displays the name, so my XML is fairly DRY because the team names are only defined in one place.

AngularJs Group和Fill Comboboxes(AngularJs Group And Fill Comboboxes)[2023-04-29]

请参阅下面的工作代码，您可以在此处找到解决方案。 Index

Ada N ...

datagridview与组合框(datagridview with comboboxes)[2024-01-11]

我从来没有能够得到自动数据绑定来正确设置DataGridViewComboBoxCell / DataGridViewComboBoxColumn （也不是CheckBox的），所以我决定将AutoGenerateColumns设置为false并手动设置列。 I was never able to get the automatic data-binding to set up a DataGridViewComboBoxCell / DataGridViewComboBoxColumn properly ...

有没有一种方法可以指定使用maven包含在EAR中的data-sources.xml文件？(Is there a way to specify data-sources.xml file to be included in EAR using maven?)[2023-06-29]

Maven具有这种事物的概要文件的概念：使用Maven构建不同的环境2 Maven has the concept of profiles for this kind of things: Building For Different Environments with Maven 2

Excel 2013 VBA - ActiveX级联组合框 - 仅在cmb4中具有相关值的问题(Excel 2013 VBA - ActiveX Cascading ComboBoxes - Issue with having only related values in cmb4)[2024-03-19]

问题是您没有对代码中的子类别进行比较。您遇到的一个更大的问题是您似乎不了解代码正在做什么。我会花一些时间来浏览你的代码并尝试理解每一行的作用。可能会再次观看您在其他帖子中引用的视频。你的代码部分正在检查要放入combobox4的值，也就是cmbCust，这里是： If MyVal = wsData.Cells(x, 3) Then 这是检查MyVal，以前定义为： MyVal = ThisWorkbook.Sheets("CHART").cmbLoc.Value 这只是cmbLoc中的选择，它对 ...

WPF，在级联ComboBox中将两个XML数据源链接在一起(WPF, linking together two XML data sources in cascading ComboBoxes)[2023-12-16]

我将Linq用于xml并填充CollectionViewSource。然后绑定到那个而不是xmlDataProvider。 Once again, this guy's article helped me out. I moved my Teams XML into my Products.xml file, so I have the following format:

XSLT - 两个单独的数据源合并为一个XSLT(XSLT - Two seperate data sources merged into one XSLT)[2022-02-17]

使用document功能访问外部文档中的节点例如，以下样式表应用于UserDetails.xml ：

Hadoop mapred-queue-acls 配置

Running Solr with Maven

HDFS patch前后Ganglia看到running processes变化的分析

mapred streaming 脚本输出运行状态导致的奇怪问题

Hadoop mapred(hive)执行目录文件权限问题

最近遇到一个Ext.Ajax.request的奇怪问题

自己封装的一个Solr Data Import Request Handler Scheduler

Cannot expose request attribute 'website' because of an existing model object of the same name 的解决方案

Hadoop 异常记录 Cannot delete /tmp/hadoop/mapred/system. Name node is in safe mode.

Another MySQL daemon already running with the same unix socket.

在运行mapred作业时，容器会根据请求被杀死(Container killed on request, while running mapred jobs)

最满意答案

相关问答

链接组合框(Linking Comboboxes)[2023-12-14]

WPF，XML数据绑定到依赖/级联组合框(WPF, XML databinding into dependent/cascading ComboBoxes)[2021-12-29]

MySQL - ListMenus / Comboboxes(MySQL - ListMenus/Comboboxes)[2023-10-20]

如何为2个组合框定义不同的来源？(How to define different sources for 2 comboboxes?)[2023-12-17]