我正在尝试用C ++学习MPI。我对OpenCV有一些了解,所以我尝试使用MPI和OpenCV编写程序。这可能听起来很愚蠢,但出于学习的目的,我尝试从线程0上的网络摄像头捕获图像,并将图像传递给线程1以转换为灰度并显示灰度图像。
这是我编译代码的方式:
mpic++ opencv.cpp `pkg-config opencv --libs`
代码编译成功,但是当我运行可执行文件时,图像会在屏幕上显示几分之一秒,这就是我在终端上看到的内容
~/mpi$ mpirun -np 2 ./a.out
libv4l2: error setting pixformat: Device or resource busy
HIGHGUI ERROR: libv4l unable to ioctl S_FMT
libv4l2: error setting pixformat: Device or resource busy
libv4l1: error setting pixformat: Device or resource busy
HIGHGUI ERROR: libv4l unable to ioctl VIDIOCSPICT
[arch:09670] *** Process received signal ***
[arch:09670] Signal: Segmentation fault (11)
[arch:09670] Signal code: Address not mapped (1)
[arch:09670] Failing at address: 0x218ac50
[arch:09670] [ 0] /usr/lib/libpthread.so.0(+0x10740)[0x7f422fcac740]
[arch:09670] [ 1] /usr/lib/libopencv_core.so.2.4(_ZNK2cv11_InputArray6getMatEi+0x203)[0x7f4233c8c113]
[arch:09670] [ 2] /usr/lib/libopencv_imgproc.so.2.4(_ZN2cv8cvtColorERKNS_11_InputArrayERKNS_12_OutputArrayEii+0x50)[0x7f4232c25de0]
[arch:09670] [ 3] ./a.out[0x408f54]
[arch:09670] [ 4] /usr/lib/libc.so.6(__libc_start_main+0xf0)[0x7f422e9e9800]
[arch:09670] [ 5] ./a.out[0x408c19]
[arch:09670] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 9670 on node arch exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
这是代码
#include <opencv2/opencv.hpp>
#include <mpi.h>
int main(int argc, char **argv) {
cv::Mat_<uint> img(640,480);
cv::Mat_<uint> gray(640,480);
cv::VideoCapture cam(0);
int rank, nproc, j=0;
MPI_Status status;
MPI_Init(&argc, &argv);
// MPI datatype for 8UC3 image
MPI_Datatype mat_8uc3;
MPI_Type_contiguous(sizeof(img), MPI_BYTE, &mat_8uc3);
MPI_Type_commit(&mat_8uc3);
// MPI datatype for 8UC1 image
MPI_Datatype mat_8uc1;
MPI_Type_contiguous(sizeof(gray), MPI_BYTE, &mat_8uc1);
MPI_Type_commit(&mat_8uc1);
MPI_Comm_size(MPI_COMM_WORLD, &nproc); // number of processes
MPI_Comm_rank(MPI_COMM_WORLD, &rank); // rank of the current process
/*
* Thread 0 captures the image from camera
* and sends the image to process 1 for processing
* thread 1 converts the image to grayscale and
* displays the image
*/
if (rank == 0) {
// capture the image and send to thread 1
while (1) {
cam >> img;
cv::imshow("proc 0", img);
MPI_Send(&img, 1, mat_8uc3, 1, j, MPI_COMM_WORLD);
cv::waitKey(40);
j++;
}
}
else if (rank == 1) {
// receive the image, convert to grayscale and display
while (1) {
MPI_Recv(&img, 1, mat_8uc3, 0, j, MPI_COMM_WORLD, &status);
cv::cvtColor(img, gray, cv::COLOR_BGR2GRAY);
cv::imshow("proc 1", gray);
cv::waitKey(20);
j++;
}
}
MPI_Finalize();
return 0;
}
有人可以指出我哪里出错吗
由于
编辑:(在用户0815的回答之后)
在进行建议的更改时,问题Device or resource busy
已解决,但程序仍然存在段错误。
[arch:01080] *** Process received signal ***
[arch:01080] Signal: Segmentation fault (11)
[arch:01080] Signal code: Address not mapped (1)
[arch:01080] Failing at address: 0x16bbf80
[arch:01080] [ 0] /usr/lib/libpthread.so.0(+0x10740)[0x7fea97322740]
[arch:01080] [ 1] /usr/lib/libopencv_core.so.2.4(_ZNK2cv11_InputArray6getMatEi+0x203)[0x7fea9b302113]
[arch:01080] [ 2] /usr/lib/libopencv_imgproc.so.2.4(_ZN2cv8cvtColorERKNS_11_InputArrayERKNS_12_OutputArrayEii+0x50)[0x7fea9a29bde0]
[arch:01080] [ 3] ./a.out[0x408fc3]
[arch:01080] [ 4] /usr/lib/libc.so.6(__libc_start_main+0xf0)[0x7fea9605f800]
[arch:01080] [ 5] ./a.out[0x408c79]
[arch:01080] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 1080 on node arch exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
答案 0 :(得分:2)
目前,每个进程都会尝试打开相机。这很可能会导致问题。尝试将开头移动到根特定部分,如下所示:
int main(int argc, char **argv) {
cv::Mat_<uint> img(640,480);
cv::Mat_<uint> gray(640,480);
cv::VideoCapture cam;
/* ... */
if (rank == 0) {
cam.open(0);
/* ... */
}
/* ... */
}
<强>更新强>
我认为您的代码存在的问题是,您无法简单地使用MPI_Send
传输对象。同样,sizeof
运算符对一般对象也无效。如果要传输对象,则需要传输基础数据。
您可以通过发送大小为img.data
的{{1}}来实现此目的。然后,您还可以使用MPI_BYTE作为数据类型,不需要自定义类型。
有关img.rows * img.cols * sizeof(uint)
内部结构的一些详细信息,请参见here。
答案 1 :(得分:0)
正如@ user0851所注意到的,在您的代码中,所有进程都会尝试打开相机,并且只能通过root进程执行相机的打开。
openCV的Mat
对象非常复杂,定义相应的MPI_Datatype
也可能很复杂。相反,发送像素数组img.data
要容易得多。这是一段代码,展示了如何完成它。它由mpiCC main.cpp -o main -lopencv_highgui -lopencv_imgproc -lopencv_core
编译并由mpirun -np 2 main
#include <opencv2/opencv.hpp>
#include <mpi.h>
using namespace cv;
int main(int argc, char **argv) {
Mat img;
Mat gray;
int rank, nproc, j=0;
size_t total;
size_t elemsize;
int sizes[3];
MPI_Status status;
MPI_Init(&argc, &argv);
MPI_Comm_size(MPI_COMM_WORLD, &nproc); // number of processes
MPI_Comm_rank(MPI_COMM_WORLD, &rank); // rank of the current process
/*
* Thread 0 captures the image from camera
* and sends the image to process 1 for processing
* thread 1 converts the image to grayscale and
* displays the image
*/
if (rank == 0) {
VideoCapture cam(0);
if(!cam.isOpened()){
fprintf(stderr,"unable to open camera.\n");
exit(1);
}
// capture the image and send to thread 1
while (1) {
cam >> img;
cv::imshow("proc 0", img);
if(j==0){
sizes[2]=img.elemSize();
Size s = img.size();
sizes[0] = s.height;
sizes[1] = s.width;
MPI_Send( sizes, 3, MPI_INT, 1,0, MPI_COMM_WORLD);
}
MPI_Send( img.data, sizes[0]*sizes[1]*3, MPI_CHAR,1,1, MPI_COMM_WORLD);
cv::waitKey(40);
j++;
}
}
else if (rank == 1) {
// receive the image, convert to grayscale and display
while (1) {
if(j==0){
MPI_Recv( sizes,3, MPI_INT,0,0, MPI_COMM_WORLD,&status);
img.create(sizes[0],sizes[1],CV_8UC3);
}
MPI_Recv( img.data, sizes[0]*sizes[1]*3, MPI_CHAR,0,1, MPI_COMM_WORLD,&status);
cv::cvtColor(img, gray, cv::COLOR_BGR2GRAY);
cv::imshow("proc 1", gray);
cv::waitKey(20);
j++;
}
}
MPI_Finalize();
return 0;
}
答案 2 :(得分:0)
Mat对象只是一个标题结构,指向存储图像的内存。
所以你有一些问题:
首先,创建一个大小为640X640的Mat
对象,而不是从相机读取到该对象。但Mat
只是一个标题,它不是指向数据的指针,Mat对象现在可以是任何宽度和高度。
其次,sizeof(Mat)
不返回分配给图像的内存量,只返回Mat对象本身的内存量。图像所需的内存量为Mat.total()*Mat.elemSize()