Hadoop错误以Hadoop 2.8.5源代码的形式启动NodeManager

时间:2019-03-30 01:26:28

标签: intellij-idea yarn hadoop2 runtimeexception nodemanager

我想从源代码在Intellij IDEA中启动hadoop,并且已经通过运行NameNode和DataNode的主类来启动hdfs,但是当我通过运行NodeManager.java启动NodeManager时遇到了一些错误。


2019-03-30 08:49:10,845 INFO  [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(210)) - Stopping NodeManager metrics system...
2019-03-30 08:49:10,846 INFO  [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(216)) - NodeManager metrics system stopped.
2019-03-30 08:49:10,846 INFO  [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(609)) - NodeManager metrics system shutdown complete.
2019-03-30 08:49:10,846 FATAL [main] nodemanager.NodeManager (NodeManager.java:initAndStartNodeManager(639)) - Error starting NodeManager
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2401)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:124)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:268)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:357)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:636)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2369)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2393)
        ... 10 more
Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.mapred.ShuffleHandler not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2273)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2367)
        ... 11 more
2019-03-30 08:49:10,851 INFO  [pool-1-thread-1] nodemanager.NodeManager (LogAdapter.java:info(45)) - SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NodeManager at 20s207/10.11.1.207
************************************************************/

Process finished with exit code 255

0 个答案:

没有答案