IntelMPI错误(适用于openMPI)

时间:2018-04-25 08:24:39

标签: c++ mpi openmpi intel-mpi

我收到此错误,并想知道我是如何修复它的。一点背景:它可以在开放式mpi中运行,但不适用于英特尔mpi。

错误:

Fatal error in MPI_Recv: Invalid argument, error stack:
MPI_Recv(200): MPI_Recv(buf=0x7fffffff92f0, count=2, MPI_INT, src=0, 
tag=123, MPI_COMM_WORLD, status=(ni$
MPI_Recv(93).: Null pointer in parameter status

代码:首先发送

int rank;
int store[2];

MPI_Comm_rank(MPI_COMM_WORLD, &rank);

// if master node
if(rank == 0) {


    // Some maths to distribute the workload where positions_start and 
    // positions end are std::vector<int>

    int this_core[2];

    for(int i = 0; i < number_threads; i++) {
        store[0] = positions_start[i];
        store[1] = positions_end[i];

        if (i == 0) {
            //memcpy(this_core, store, 2 * sizeof(int));
            this_core[0] = positions_start[i];
            this_core[1] = positions_end[i];
        } else {
            MPI_Send(&store, 2, MPI_INT, i, 123, MPI_COMM_WORLD);
        }
    }
}

首先,收到:

// not master node
{ else {
   // Create array
    store[0] = -1;
    store[1] = -1;

    MPI_Recv(&store, 2, MPI_INT, 0, 123, MPI_COMM_WORLD, NULL);

第二次发送:

    float tempDataSet[(aVolumeSize[1] * aVolumeSize[0]) * ((store[1] - store[0]) + 1)];
    // Some math comutations here and results stored in tempDataset
    // Send results to the master
    MPI_Send(&tempDataSet, (aVolumeSize[1] * aVolumeSize[0]) * ((store[1] - store[0]) + 1), MPI_FLOAT, 0, 124, MPI_COMM_WORLD);
}

第二,收到:

 // back in master node receive the array from other nodes and store them in a larger array
 // Set the size of the buffer is necessary
    unsigned int number_of_voxels(aVolumeSize[0] * aVolumeSize[1] * aVolumeSize[2]);
     std::vector<float>& apVoxelDataSet;
     apVoxelDataSet.resize(number_of_voxels, 0);

        for (int i = 1; i < number_threads; ++i) {
            // Calculate the size of the array
            arrSize = (aVolumeSize[1] * aVolumeSize[0]) * ((positions_end[i] - positions_start[i]) + 1);
            float values[arrSize + 1];

            MPI_Recv(&values, arrSize, MPI_FLOAT, i, 124, MPI_COMM_WORLD, NULL);

            std::copy(values, values + arrSize + 1, apVoxelDataSet.begin() + curLoc);
            curLoc += arrSize;
        }

使用openmpi,一切都按预期工作,但只有当我使用intelmpi时才会出现错误。我怎么能修复这个错误,所以它在intelmpi中工作?

编辑:slurm文件

#!/bin/bash --login
#SBATCH --job-name=MPI_assignment
#SBATCH -o MPI_assignment.out
#SBATCH -e MPI_assignment.err
#SBATCH -t 0-12:00
#SBATCH --ntasks=60
#SBATCH --tasks-per-node=8

module purge
module load compiler/intel mpi/intel
printf "Making Project ...\n"
make
printf "Done!"
mpirun -np $SLURM_NTASKS ./test >& MPI_assignment.log.$SLURM_JOBID

如果我改变了行:

module load compiler/intel mpi/intel

module load compiler/intel mpi/openmpi

module load compiler/gnu mpi/openmpi

程序正常运行,没有错误发生。

生成文件

CXX=mpiicc
BIN=test
LIB=libImplicitSurface.a
OBJECTS= ImplicitSurface.o test.o

CXXFLAGS+=-I../include -O3 -Wall 
LDFLAGS+=-L. -lImplicitSurface


all: $(BIN)


$(BIN): $(LIB) test.o
@echo Build $@
@$(CXX) -o $@ test.o $(LDFLAGS)


$(LIB): ImplicitSurface.o
@echo Build $@ from $<
@$(AR) rcs $@ $<


# Default rule for creating OBJECT files from CXX files
%.o: ../src/%.cxx
@echo Build $@ from $<
@$(CXX) $(CXXFLAGS) -c $< -o $@


ImplicitSurface.o: ../include/ImplicitSurface.h 
../include/ImplicitSurface.inl ../src/ImplicitSurface.cxx
test.o: ../include/ImplicitSurface.h $(LIB) ../src/test.cxx


clean:
$(RM) $(OBJECTS)
$(RM) $(LIB)
$(RM) $(BIN)
$(RM) -r ../doc/html
$(RM) -r ../doc/tex

1 个答案:

答案 0 :(得分:2)

如果您不打算使用MPI_Recv()的“返回”状态,则必须使用MPI_STATUS_IGNORE代替NULL

你的程序不正确,因此有一个未定义的行为(读你很幸运,它与Open MPI一起使用)。