我正在按照本教程尝试使用Hadoop Streaming运行MapReduce作业。当我尝试运行它时,出现以下错误
2018-11-05 22:49:31,093 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2018-11-05 22:49:31,170 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
2018-11-05 22:49:31,170 INFO impl.MetricsSystemImpl: JobTracker metrics system started
2018-11-05 22:49:31,184 WARN impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2018-11-05 22:49:31,365 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop/mapred/staging/hduser1541912163/.staging/job_local1541912163_0001
2018-11-05 22:49:31,366 ERROR streaming.StreamJob: Error Launching job : No such file or directory
Streaming Command Failed!
如您所见,该错误不是很有帮助,因为它没有告诉我找不到哪个文件。
我正在使用的命令是
/ usr / local / hadoop / bin / hadoop jar /usr/local/hadoop/share/hadoop/tools/lib/hadoop-streaming-3.1.1.jar -mapper“ / home / hduser / emotion_test / mapper。 py“ -reducer” /home/hduser/emotion_test/reducer.py“ -input / emotion_doc -output / emotion_output
我也尝试提及this问题,但这没有帮助。