像HDFS这样的分布式文件系统上的OpenMPI

Question

是否支持HDFS（Hadoop分布式文件系统）等分布式文件系统上的OpenMPI？

Answer 1

Hadoop未使用MPI实现，因为

1. MPI是一个消息传递接口，而MapReduce是Google最初开发的用于运行大数据应用程序的工具。
2. Hadoop / Mapreduce中可用的主要功能之一是容错。但MPI不支持它。

参考
Why isn't Hadoop implemented using MPI?
MPI and MapReduce

让我们来回答您的问题，

一篇文章说，

The prospect of running MPI jobs under YARN is an enticing proposition. As mentioned, the vast stores of data now living in HDFS can be accessed by non-MapReduce applications like those written in MPI. (Please note, however, that the intimate interface of MapReduce to HDFS is part of the MapReduce framework and is not automatic in other frameworks and must be managed by the user’s application.)

公开MPI小组的Ralph H. Castain对running Open MPI under YARN的前景进行了调查。

您可以参考以下链接获取更多信息，

The New Hadoop