如何读取与另一个线程共享的std :: queue?

时间:2017-09-07 22:42:51

标签: c++ multithreading

我的代码获取图像并处理它们。性能对我的代码至关重要,所以我尝试了多线程。目前,我只是将获取部分作为一个单独的线程。我正在使用std::queue实现一个简单的FIFO缓冲区,用于存储所获取的图像。采集功能AcquireImages无限期地将原始图像数据写入此缓冲区,直到用户中断。处理函数ProcessImages读取缓冲区并处理图像数据(当前在主线程中,但我计划在解决问题后将其作为一个单独的线程)。这是我的代码(修改后形成MCV example):

#include <iostream>
#include <vector>
#include <queue>
#include <atomic>
#include <thread>

#define NUM_CAMERAS 2

void AcquireImages(std::queue<unsigned char*> &rawImageQueue, std::atomic<bool> &quit)
{
    unsigned char* rawImage{};

    while (!quit)
    {
        for (int camera = 0; camera < NUM_CAMERAS; camera++)
        {
            switch (camera)
            {
            case 0:
                rawImage = (unsigned char*)"Cam0Image";
                break;
            case 1:
                rawImage = (unsigned char*)"Cam1Image";
                break;
            default:
                break;
            }

            rawImageQueue.push(std::move(rawImage));
        }
    }
}

int ProcessImages(const std::vector<unsigned char*> &rawImageVec, const int count)
{
    // Do something to the raw image vector

    if (count > 10)
    {
        return 1;
    }
    else
    {
        return 0;
    } // In my application, this function only returns non-zero upon user interception.
}


int main()
{
    // Preparation
    std::vector<unsigned char*> rawImageVec;
    rawImageVec.reserve(NUM_CAMERAS);
    std::queue<unsigned char*> rawImageQueue;
    int count{};

    const unsigned int nThreads = 1;    // this might grow later

    std::atomic<bool> loopFlags[nThreads];
    std::thread       threads[nThreads];

    // Start threads
    for (int i = 0; i < nThreads; i++) {
        loopFlags[i] = false;
        threads[i] = std::thread(AcquireImages, rawImageQueue, ref(loopFlags[i]));
    }

    // Process images
    while (true)
    {

        // Process the images
        for (int cam{}; cam < NUM_CAMERAS; ++cam)
        {
            rawImageVec.push_back(rawImageQueue.front());
            rawImageQueue.pop();
        }

        int processResult = ProcessImages(move(rawImageVec), count);
        if (processResult)
        {
            std::cout << "Leaving while loop.\n"; // In my application this is triggered by the user
            break;
        }

        rawImageVec.clear();
        ++count;
    }

    // Shutdown other threads
    for (auto & flag : loopFlags) {
        flag = true;
    }

    // Wait for threads to actually finish.
    for (auto& thread : threads) {
        thread.join();
    }

    return 0;
}

你们中的一些人可能已经注意到我的错误。我所知道的是,该程序在rawImageVec.push_back(rawImageQueue.front());处抛出异常。

抛出异常后的输出如下:

Debug Assertion Failed!

Program: C:\WINDOWS\SYSTEM32\MSVCP140D.dll
File: c:\program files (x86)\microsoft visual studio 14.0\vc\include\deque
Line: 329

Expression: deque iterator not dereferencable

我理解问题的原因可能是我正在阅读与另一个帖子共享的内容(我是否正确?)。我该如何解决这个问题?

我在评论中遵循了Praetorian的建议,在检查rawImageQueue是否为空之后,我发现它总是空的。我不确定是什么导致了这一点。

2 个答案:

答案 0 :(得分:2)

以下是共享队列上的生产者/消费者的一般化示例。我们的想法是,如果您从数据结构中进行编写和读取,则需要对访问进行某种保护。

为此,下面的示例使用条件变量和互斥锁。

#include <thread>
#include <iostream>
#include <chrono>
#include <queue>
#include <mutex>
#include <vector>
#include <condition_variable>

using namespace std::chrono_literals;
using std::vector;
using std::thread;
using std::unique_lock;
using std::mutex;
using std::condition_variable;
using std::queue;

class WorkQueue
{
  condition_variable work_available;
  mutex work_mutex;
  queue<int> work;

public:
  void push_work(int item)
  {
    unique_lock<mutex> lock(work_mutex);

    bool was_empty = work.empty();
    work.push(item);

    lock.unlock();

    if (was_empty)
    {
      work_available.notify_one();
    }    
  }

  int wait_and_pop()
  {
    unique_lock<mutex> lock(work_mutex);
    while (work.empty())
    {
      work_available.wait(lock);
    }

    int tmp = work.front();
    work.pop();
    return tmp;
  }
};

int main() {
  WorkQueue work_queue;

  auto producer = [&]() {
    while (true) {
      work_queue.push_work(10);
      std::this_thread::sleep_for(2ms);
    }
  };

  vector<thread> producers;
  producers.push_back(std::thread(producer));
  producers.push_back(std::thread(producer));
  producers.push_back(std::thread(producer));
  producers.push_back(std::thread(producer));

  std::thread consumer([&]() {        
    while (true)
    {
      int work_to_do = work_queue.wait_and_pop();
      std::cout << "Got some work: " << work_to_do << std::endl;
    }
  });

  std::for_each(producers.begin(), producers.end(), [](thread &p) {
    p.join();
  });    

  consumer.join();  
}

答案 1 :(得分:1)

您的情况相对简单,因为您似乎只有一个生产者和一个消费者。此外,图像处理听起来非常慢(慢到不用担心线程争用),而且你正在从单线程版本切换,所以可能不需要为高效的无锁实现而烦恼。

我建议研究这个伪代码:https://en.wikipedia.org/wiki/Producer%E2%80%93consumer_problem#Using_monitors,然后在需要时了解条件变量:http://en.cppreference.com/w/cpp/thread/condition_variable