Question

我目前正在测试一个使用预制shell的网络抓取工具，在此过程中，我有点陷入这个部分，在那里抱怨的create_data_files部分＆＃34 ;正式的参数名称。

这里引用的是迄今为止代码的一部分（我正在使用PyCharm Community Edition 2017.1.1）。

# Each website is a separate project (folder)
def create_project_dir(directory):
    if not os.path.exists(directory):
        print('Creating directory ' + directory)
        os.makedirs(directory)
create_project_dir('test')

# Create queue and crawled files (if not created)
def create_data_files(test,'www.startlap.com/'):
    queue = os.path.join(project_name , 'queue.txt')
    crawled = os.path.join(project_name,"crawled.txt")
    if not os.path.isfile(queue):
        write_file(queue, base_url)
    if not os.path.isfile(crawled):
        write_file(crawled, '')


# Create a new file
def write_file(path, data):
    with open(path, 'w') as f:
        f.write(data)



# Add data onto an existing file
def append_to_file(path, data):
    with open(path, 'a') as file:
        file.write(data + '\n')


# Delete the contents of a file
def delete_file_contents(path):
    open(path, 'w').close()


# Read a file and convert each line to set items
def file_to_set(file_name):
    results = set()
    with open(file_name, 'rt') as f:
        for line in f:
            results.add(line.replace('\n', ''))
    return results


# Iterate through a set, each item will be a line in a file
def set_to_file(links, file_name):
    with open(file_name,"w") as f:
        for l in sorted(links):
            f.write(l+"\n")

Answer 1

您需要使用def create_data_files(test,'www.startlap.com/'):

之类的内容更改def create_data_files(test, url='www.startlap.com/'):行

编写我的webcrawler时获取正式的参数名称预期错误（Python）

1 个答案: