多处理功能无法写入文件或打印

时间:2018-12-30 16:23:08

标签: python python-3.x raspberry-pi raspberry-pi3 python-multiprocessing

我正在使用Raspberry Pi(3 B +)制作数据收集设备, 尝试生成一个过程来记录传入的数据并将其写入文件。我有一个写作功能,当我直接调用它时效果很好。

但是,当我使用多进程方法进行调用时,似乎什么也没有发生。我可以在Linux的任务监视器中看到,实际上确实产生了该进程,但是没有写入任何文件,并且当我尝试向其传递标志以使其关闭时不起作用,这意味着我最终终止了该进程,却一无所获似乎发生了。

我一直都在研究这个问题,看不到我在做什么错;还有其他人吗?如果相关的话,这些都是父类中的函数,其中一个函数旨在将另一个作为线程生成。

我正在使用的代码:

from datetime import datetime, timedelta
import csv
from drivers.IMU_SEN0 import IMU_SEN0
import multiprocessing, os

class IMU_data_logger:
    _output_filename = ''
    _csv_headers = []
    _accelerometer_headers = ['Accelerometer X','Accelerometer    Y','Accelerometer Z']
    _gyroscope_headers = ['Gyroscope X','Gyroscope Y','Gyroscope Z']
    _magnetometer_headers = ['Bearing']
    _log_accelerometer = False
    _log_gyroscope= False
    _log_magnetometer = False
    IMU = None
    _writer=[]
    _run_underway = False
    _process=[]
    _stop_value = 0

def __init__(self,output_filename='/home/pi/blah.csv',log_accelerometer = True,log_gyroscope= True,log_magnetometer = True):
    """data logging device
    NOTE! Multiple instances of this class should not use the same IMU devices simultaneously!"""        
    self._output_filename = output_filename
    self._log_accelerometer = log_accelerometer
    self._log_gyroscope = log_gyroscope
    self._log_magnetometer = log_magnetometer

def __del__(self):
    # TODO Update this
    if self._run_underway: # If there's still a run underway, end it first
        self.end_recording()

def _set_up(self):        
    self.IMU = IMU_SEN0(self._log_accelerometer,self._log_gyroscope,self._log_magnetometer)
    self._set_up_headers()

def _set_up_headers(self):
    """Set up the headers of the CSV file based on the header substrings at top and the input flags on what will be measured"""
    self._csv_headers = []
    if self._log_accelerometer is not None:
        self._csv_headers+= self._accelerometer_headers
    if self._log_gyroscope is not None:
        self._csv_headers+= self._gyroscope_headers
    if self._log_magnetometer is not None:
        self._csv_headers+= self._magnetometer_headers


def _record_data(self,frequency,stop_value):
    self._set_up() #Run setup in thread

    """Record data function, which takes a recording frequency, in herz, as an input"""
    previous_read_time=datetime.now()-timedelta(1,0,0)
    self._run_underway = True # Note that a run is now going
    Period = 1/frequency # Period, in seconds, of a recording based on the input frequency
    print("Writing output data to",self._output_filename)

    with open(self._output_filename,'w',newline='') as outcsv:
        self._writer = csv.writer(outcsv)
        self._writer.writerow(self._csv_headers) # Write headers to file

        while stop_value.value==0: # While a run continues
            if datetime.now()-previous_read_time>=timedelta(0,1,0): # If we've waited a period, collect the data; otherwise keep looping
                print("run underway value",self._run_underway)
            if datetime.now()-previous_read_time>=timedelta(0,Period,0): # If we've waited a period, collect the data; otherwise keep looping
                previous_read_time = datetime.now() # Update previous readtime
                next_row = []
                if self._log_accelerometer:
                    # Get values in m/s^2
                    axes = self.IMU.read_accelerometer_values()
                    next_row += [axes['x'],axes['y'],axes['z']]

                if self._log_gyroscope:
                    # Read gyro values
                    gyro = self.IMU.read_gyroscope_values()
                    next_row += [gyro['x'],gyro['y'],gyro['z']]

                if self._log_magnetometer:
                    # Read magnetometer value
                    b= self.IMU.read_magnetometer_bearing()
                    next_row += b

                self._writer.writerow(next_row)

        # Close the csv when done
        outcsv.close()

def start_recording(self,frequency_in_hz):        
    # Create recording process
    self._stop_value = multiprocessing.Value('i',0)
    self._process = multiprocessing.Process(target=self._record_data,args=(frequency_in_hz,self._stop_value))

    # Start recording process
    self._process.start()
    print(datetime.now().strftime("%H:%M:%S.%f"),"Data logging process spawned")
    print("Logging Accelerometer:",self._log_accelerometer)
    print("Logging Gyroscope:",self._log_gyroscope)
    print("Logging Magnetometer:",self._log_magnetometer)     
    print("ID of data logging process: {}".format(self._process.pid))

def end_recording(self,terminate_wait = 2):
    """Function to end the recording multithread that's been spawned.
    Args: terminate_wait: This is the time, in seconds, to wait after attempting to shut down the process before terminating it."""
    # Get process id
    id = self._process.pid

    # Set stop event for process
    self._stop_value.value = 1

    self._process.join(terminate_wait) # Wait two seconds for the process to terminate
    if self._process.is_alive(): # If it's still alive after waiting
        self._process.terminate()
        print(datetime.now().strftime("%H:%M:%S.%f"),"Process",id,"needed to be terminated.")
    else:
        print(datetime.now().strftime("%H:%M:%S.%f"),"Process",id,"successfully ended itself.")

================================================ =====================

ANSWER :对于在这里进行后续工作的任何人来说,问题都出在我对VS Code调试器的使用上,该调试器显然不适用于多处理,并且在某种程度上阻止了生成过程的成功。非常感谢下面的Tomasz Swider帮助我解决问题,并最终发现了我的愚蠢之处。非常感谢帮助!

1 个答案:

答案 0 :(得分:0)

我在您的代码中看到了几处错误的地方:

第一件事 stop_value == 0不能作为multiprocess.Value('i',0)!= 0,将该行更改为

while stop_value.value == 0

第二,您永远不会更新previous_read_time,因此它将尽可能快地写入读数,您将很快用完磁盘

第三,尝试使用time.sleep(),这就是忙循环,它很糟糕,不必要地浪费了CPU周期。

四,以self._stop_value = 1终止可能不起作用,必须使用其他方法设置该值,例如self._stop_value.value = 1。

以下是一些示例代码,这些示例代码基于您提供的可以正常工作的代码:

import csv
import multiprocessing
import time
from datetime import datetime, timedelta
from random import randint


class IMU(object):

    @staticmethod
    def read_accelerometer_values():
        return dict(x=randint(0, 100), y=randint(0, 100), z=randint(0, 10))


class Foo(object):

    def __init__(self, output_filename):
        self._output_filename = output_filename
        self._csv_headers = ['xxxx','y','z']
        self._log_accelerometer = True
        self.IMU = IMU()

    def _record_data(self, frequency, stop_value):
        #self._set_up()  # Run setup functions for the data collection device and store it in the self.IMU variable

        """Record data function, which takes a recording frequency, in herz, as an input"""
        previous_read_time = datetime.now() - timedelta(1, 0, 0)
        self._run_underway = True  # Note that a run is now going
        Period = 1 / frequency  # Period, in seconds, of a recording based on the input frequency
        print("Writing output data to", self._output_filename)

        with open(self._output_filename, 'w', newline='') as outcsv:
            self._writer = csv.writer(outcsv)
            self._writer.writerow(self._csv_headers)  # Write headers to file

            while stop_value.value == 0:  # While a run continues
                if datetime.now() - previous_read_time >= timedelta(0, 1,
                                                                    0):  # If we've waited a period, collect the data; otherwise keep looping
                    print("run underway value", self._run_underway)
                if datetime.now() - previous_read_time >= timedelta(0, Period,
                                                                    0):  # If we've waited a period, collect the data; otherwise keep looping
                    next_row = []
                    if self._log_accelerometer:
                        # Get values in m/s^2
                        axes = self.IMU.read_accelerometer_values()
                        next_row += [axes['x'], axes['y'], axes['z']]

                    previous_read_time = datetime.now()
                    self._writer.writerow(next_row)

            # Close the csv when done
            outcsv.close()

    def start_recording(self, frequency_in_hz):
        # Create recording process
        self._stop_value = multiprocessing.Value('i', 0)
        self._process = multiprocessing.Process(target=self._record_data, args=(frequency_in_hz, self._stop_value))

        # Start recording process
        self._process.start()
        print(datetime.now().strftime("%H:%M:%S.%f"), "Data logging process spawned")
        print("ID of data logging process: {}".format(self._process.pid))

    def end_recording(self, terminate_wait=2):
        """Function to end the recording multithread that's been spawned.
        Args: terminate_wait: This is the time, in seconds, to wait after attempting to shut down the process before terminating it."""
        # Get process id
        id = self._process.pid

        # Set stop event for process
        self._stop_value.value = 1

        self._process.join(terminate_wait)  # Wait two seconds for the process to terminate
        if self._process.is_alive():  # If it's still alive after waiting
            self._process.terminate()
            print(datetime.now().strftime("%H:%M:%S.%f"), "Process", id, "needed to be terminated.")
        else:
            print(datetime.now().strftime("%H:%M:%S.%f"), "Process", id, "successfully ended itself.")


if __name__ == '__main__':
    foo = Foo('/tmp/foometer.csv')
    foo.start_recording(20)
    time.sleep(5)
    print('Ending recording')
    foo.end_recording()