Question

我创建了一个将从CSV加载表的类。我需要加载6个登台表，为此，我通过传递登台表的不同参数（例如表名，csv文件名，表模式等）来创建6个对象。

我想并行创建这6个对象，以节省时间，因为没有依赖性。

我想为stg_table_load_6并行创建stg_table_load_1

if __name__ == '__main__':

    stg_table_load_1 = ChannelMinutageMedia("sampletable-1", "test_cm/sampletable-1.json", "gs://abc/test_cm/sample.csv")

    # Execute the extraction process for viewing events
    stg_table_load_1.channel_minutage_load()

    print('Exiting channel minutage load main')

Answer 1

我使用下面的代码，是否一样？


   stg_load_1 = ChannelMinutageMedia("mytable", "test_cm/sample_table.json",
                                          "gs://poc-data/test_cm/sample.csv")

   stg_load_2 = ChannelMinutageMedia("mytable", "test_cm/sample_table.json",
                                          "gs://poc-data/test_cm/sample.csv")
   # creating processes
   p1 = mp.Process(target=stg_load_1.channel_minutage_load())
   p2= mp.Process(target=stg_load_2.channel_minutage_load())

   # starting process 1
   p1.start()
   # starting process 2
   p2.start()

   # wait until process 1 is finished
   p1.join()
   # wait until process 2 is finished
   p2.join()

如何并行创建python对象

1 个答案: