ACCEPTED:等待AM容器分配,启动并注册RM。

时间:2016-11-20 11:51:03

标签: hadoop mapreduce yarn

我正在研究具有4GB Ram和40 GB HDD的hadoop2.7.0单节点集群。在Map reduce上执行字数统计示例时,它在运行作业后停止了...我已经尝试在纱线站点增加容器内存但仍然没有运气。

错误

16/11/20 17:05:03 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/11/20 17:05:07 INFO input.FileInputFormat: Total input paths to process : 1
16/11/20 17:05:08 INFO mapreduce.JobSubmitter: number of splits:1
16/11/20 17:05:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1479631325160_0002
16/11/20 17:05:09 INFO impl.YarnClientImpl: Submitted application application_1479631325160_0002
16/11/20 17:05:09 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1479631325160_0002/
16/11/20 17:05:09 INFO mapreduce.Job: Running job: job_1479631325160_0002

此链接显示:

YarnApplicationState:   ACCEPTED: waiting for AM container to be allocated, launched and register with RM. 

HDFS-site.xml中

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>dfs.name.dir</name>
  <value>/nn1</value>
</property>
<property>
  <name>dfs.data.dir</name>
  <value>/dn1</value>
</property>
</configuration>

芯-site.xml中

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:9000</value>
</property>
</configuration>

mapred-site.xml中

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>
<property>
  <name>mapreduce.job.reduces</name>
  <value>1</value>
</property>
<property>  
  <name>yarn.app.mapreduce.am.resource.mb</name>  
  <value>512</value>
</property>
<property> 
  <name>yarn.app.mapreduce.am.command-opts</name> 
  <value>-Xmx410m</value>
</property>
<property>
  <name>mapreduce.map.memory.mb</name>
  <value>256</value>
</property>
<property>
  <name>mapreduce.reduce.memory.mb</name>
  <value>2048</value>
</property>
<property>
  <name>mapreduce.map.java.opts</name>
  <value>-Xmx204m</value>
</property>
<property>
  <name>mapreduce.reduce.java.opts</name>
  <value>-Xmx410m</value>
</property>
</configuration>

纱-site.xml中

<?xml version="1.0"?>
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property> 
<property>
  <name>yarn.scheduler.minimum-allocation-mb</name>
  <value>256</value>
</property>
<property> 
  <name>yarn.scheduler.maximum-allocation-mb</name> 
  <value>2048</value>
</property>
<property> 
  <name>yarn.nodemanager.resource.memory-mb</name> 
  <value>2048</value>
</property>
</configuration>

请告诉我如何解决这个问题。

0 个答案:

没有答案