如何动态定义Luigi任务类名称

Question

我有多个查询，我想根据彼此定义为单个Luigi任务。由于BDX_Query_0XX的依赖项（子任务）是基于字典（cmdList）动态定义的，因此我使用了“ yield [Task_Class（klass）]”语句。例如，BDX_Query_0XX具有3个依赖性，即BDX010，BDX020，BDX030，其中BDX010是BDX020的依赖性，而BDX020是BDX030的依赖性。

问题在于，当产生BDX020且Python将BDX010作为依赖项时，Python会抱怨未定义BDX010。

如果我使用“ yield BDX_Task”而不是“ yield klass”，则一切正常，但这使Luigi可视化器将所有动态创建的任务显示为“ BDX_Task”，而不是将其显示为BDX010，.. 020，.. 030。

cmdList = {
        'BDX010': (f'"{bdx_sql}BDX_001_NI_DM 010.sql" -S LWVPDBSQLC070 ',''),
        'BDX020': (f'"{bdx_sql}BDX_001_NI_DM 020.sql"  ','BDX010'),
        'BDX030': (f'"{bdx_sql}BDX_001_NI_DM 030.sql"  ','BDX020')  }


class BDX_Task(SQLTask):
    acctDate = luigi.Parameter()
    ssisDate = luigi.Parameter(default=None)
    queryKey = luigi.Parameter()
    queryCmd = luigi.Parameter()
    runDesc = luigi.Parameter()
    dependQry = luigi.Parameter()

    def __init__(self, *args, **kwargs):
        super(BDX_Task, self).__init__(*args, **kwargs)
        logger.debug(f'BDX_Task.__init__ called for queryKey ="{self.queryKey}"')

        self.trans_id = f"00903_BDX_Query_{self.queryKey}__{self.runDesc}"

    def requires(self):
        cmdListComb = dict(cmdList)
        cmdListComb.update(cmdList2)

        if self.dependQry != '' and self.dependQry in cmdListComb:
            dep_cmd, dep_dep_key = cmdListComb[self.dependQry]
            return [self.__class__(         
                acctDate = self.acctDate,
                ssisDate = self.ssisDate,
                queryKey = self.dependQry,
                queryCmd = dep_cmd,
                runDesc = self.runDesc,
                dependQry = dep_dep_key
            )]
        else:
            return []

    def run(self):
        strQuery_and_args = f""" -i {self.queryCmd} """
        print(strQuery_and_args)
        helpers.call_sqlcmd(self.queryKey,strQuery_and_args )
        self.get_target().touch()


class BDX_Query_0XX(SQLTask):
    acctDate = luigi.Parameter()
    ssisDate = luigi.Parameter()  
    runDesc = luigi.Parameter()

    def __init__(self, *args, **kwargs):
        super(BDX_Query_0XX, self).__init__(*args, **kwargs)

        self.trans_id =  "00902_BDX_Query_0XX" + "__" + self.runDesc  # static.

    def requires(self):
        for queryKey, (queryCmd, dependQry) in cmdList.items():

            klass = type(queryKey, (BDX_Task,),{})

            # I can avoid the error, if I do "yield BDX_Task" below instead.
            # but it causes Luigi Visualizer to show all BDX0?X tasks as "BDX_Task".
            yield klass(   
                acctDate = self.acctDate,
                ssisDate = self.ssisDate,
                queryKey = queryKey,
                queryCmd = queryCmd,
                runDesc = self.runDesc,  
                dependQry = dependQry
            )

    def run(self):
        self.get_target().touch()