实现线程池的Wait操作

时间:2013-11-19 09:56:00

标签: multithreading synchronization pthreads threadpool

我已经实现了一个线程池。现在它适用于基本操作,如下所示:

void initialise(bool detached_threads);

bool dispatch(void *(* dispatch_fn)(void *),void * arg,bool free_arg);

void shut_down();

static void * execute_task(void * arg);

现在我想添加操作wait(),它将由主线程调用,它将等待线程池中的所有线程完成它们正在执行的任务。我不想使用pthread_join,因为这会杀死所有线程,我不想再次创建一个线程池。我已经在下面提供的代码中实现了等待操作,但似乎不正确。

请告诉我有关错误的建议。谢谢!!!

#include "../inc/ThreadPool.hpp"

#include <cstdio>
#include <cstdlib>
#include <iostream>

using namespace std;

ThreadPool::ThreadPool( unsigned int n )
:num_threads(n)
{
    if(num_threads<=0)
    {
    num_threads = DEFAULT_THREAD_POOL_SIZE;
    }

    barrier_count = 0;
    threads = (pthread_t*) malloc(sizeof(pthread_t)*num_threads);
    shutdown = false;
    dont_accept = false;

    pthread_mutex_init(&barrier_lock,NULL);
    pthread_cond_init(&barrier_reached,NULL);

    pthread_mutex_init(&q_lock,NULL);
    pthread_cond_init(&q_not_empty,NULL);
    pthread_cond_init(&q_empty,NULL);
}

ThreadPool::~ThreadPool()
{
  //cout << "~ThreadPool()" << endl; 
}

void ThreadPool::initialise( bool detached_threads )
{
    //pthread_attr_t attr;

    //if(detached_threads)
    //{
    //pthread_attr_init(&attr);
    //pthread_attr_setdetachstate(&attr, PTHREAD_CREATE_DETACHED);
    //}

    for ( int i = 0 ; i<num_threads ; i++ )
    {
      pthread_create( &threads[i] , NULL , execute_task , this );
    }
}

bool ThreadPool::dispatch( void *(*routine)(void*) , void * arg , bool free_arg )
{
    task_t * new_task = (task_t*) malloc(sizeof(task_t));
    new_task->routine = routine;
    new_task->arg = arg;
    new_task->free_arg = free_arg;

    pthread_mutex_lock(&q_lock);

    if(dont_accept)
    {
        free(new_task);
        return false;
    }

    bool was_empty = tasks.empty();
    tasks.push(new_task);

    if(was_empty)
    {
        pthread_cond_signal(&q_not_empty);
    }

    pthread_mutex_unlock(&q_lock);

    return true;
}

void ThreadPool::shut_down()
{
      void * return_val;
      pthread_mutex_lock(&q_lock);
      dont_accept = true;

      while(!(tasks.empty()))
      {
      pthread_cond_wait(&q_empty,&q_lock);
      }

      shutdown = true;
      pthread_cond_broadcast(&q_not_empty);
      pthread_mutex_unlock(&q_lock);

      for(int i=0 ; i<num_threads ; i++)
      {
      //pthread_join(threads[i],NULL);
      pthread_join(threads[i],&return_val);
      }

      free(threads);

      pthread_mutex_destroy(&barrier_lock);
      pthread_cond_destroy(&barrier_reached);

      pthread_mutex_destroy(&q_lock);
      pthread_cond_destroy(&q_empty);
      pthread_cond_destroy(&q_not_empty);
}

void ThreadPool::init_barrier()
{
    pthread_mutex_lock(&barrier_lock);

    barrier_count = 0;

    pthread_mutex_unlock(&barrier_lock);
}

void ThreadPool::barrier( int ns )
{
    pthread_mutex_lock(&barrier_lock);

    barrier_count++;

    if(barrier_count==ns)
    {
        for( int i=0 ; i<ns ; i++ )
        {
            pthread_cond_signal(&barrier_reached);
        }
    }else
    {
        while( barrier_count<ns )
        {
            pthread_cond_wait(&barrier_reached,&barrier_lock);
        }
    }

    pthread_mutex_unlock(&barrier_lock);
}

void ThreadPool::wait()
{
      pthread_mutex_lock(&q_lock);

      while(!(tasks.empty()))
      {
      pthread_cond_wait(&q_empty,&q_lock);
      }

      pthread_mutex_unlock(&q_lock);
}


void * ThreadPool::execute_task( void * arg )
{
    ThreadPool * thread_pool = (ThreadPool*) arg;
    task_t * cur_task;

    while(true)
    {
    pthread_mutex_lock(&(thread_pool->q_lock));

    while((thread_pool->tasks).empty())
    {
          if(thread_pool->shutdown)
          {
          pthread_mutex_unlock(&(thread_pool->q_lock));
          pthread_exit(NULL);
          }

          //cout << "I'm going to sleep!!!" << endl;

          pthread_cond_wait(&(thread_pool->q_not_empty),&(thread_pool->q_lock));

          //cout << "I've woken up!!!" << endl;

          if(thread_pool->shutdown)
          {
          pthread_mutex_unlock(&(thread_pool->q_lock));
          pthread_exit(NULL);
          }
    }

    cur_task = thread_pool->tasks.front();
    thread_pool->tasks.pop();

    if(thread_pool->tasks.empty() && !thread_pool->shutdown )
    {
          pthread_cond_signal(&(thread_pool->q_empty));
    }

    pthread_mutex_unlock(&(thread_pool->q_lock));

    //cout << "I'm executing a task!!!" << endl;

    (cur_task->routine)(cur_task->arg);

    if(cur_task->free_arg)
    {
           free(cur_task->arg);
    }

    free(cur_task);

    //cout << "I'm done with the task!!!" << endl;
    }
}

1 个答案:

答案 0 :(得分:1)

嗯,我通常做的是从线程池请求'TasksetWait',(TW),对象,通过'dispatch'方法发出任务,然后,对于同步通知,调用'AwaitCompletion()方法。 TW提供了一个已为请求线程锁定的私有互斥锁(确保它现在具有独占访问权限),任务计数器int,请求者等待的“已完成”condvar /事件以及对其池的引用。 TW调度通过将ref加载到每个任务中将任务转发到池中,将任务推送到池中并通过递增任务计数器来计算它们。

请求线程然后调用TW-&gt; AwaitCompletion,它解锁互斥锁并等待事件。

同时,池线程正在执行任务run()方法。在run()返回之后,该任务调用TW的'OnCompletion()方法,该方法锁定互斥锁并减少计数。如果计数仍为非零,则会解锁互斥锁并退出。如果计数为零,它将解锁互斥锁,发出事件信号并退出。

当请求者再次运行时,它可以将TW返回到池中(可以保留它们的缓存),或者只是销毁它。

变量是请求者向TW提供'OnCompletion方法,以便完成最后一个任务的池线程可以调用它,因此提供异步通知(可能需要将消息发布到GUI输入)队列)。

这样的机制允许线程池被多个请求者线程使用,或者(使用异步通知)让请求者发出多个任务块,但如果请求者线程本身就是池线程,它会有点混乱在池中运行任务,(如果你想保持对进程实际执行的操作,最好避免这种情况:)。