如何编写快速的for循环?

时间:2019-10-26 16:35:03

标签: python performance for-loop

我只是想知道是否有人知道更快/更有效的方法来完成此操作,并提高它的速度,因为这是一个测试人员,我将主要与20个国家/地区的123个城市打交道

for country in cities:
    for city in cities[country]:
        for job_title in _job_title:
            for start in range(0, max_results_per_city, 10):
                url = urls[country] + \
                    "/jobs?q={}&l={}&sort=date&start={}".format(
                        job_title, city, start)
                print(url)
                time.sleep(1)
                response = requests.get(url)
                data = response.text
                soup = get_soup(data)
                html = soup.find_all(name="div", attrs={"class": "row"})
                for page in html:
                    job = extract_job_title(page)
                    job_title_match = [job_prefix for job_prefix in _job_title if job_prefix in job]
                    if not len(job_title_match) > 0:    
                        pass
                    else:
                        with open(self.file, 'w') as outfile:
                            json.dump(unique(self.data_extracted), outfile, indent=4)

时间

real    0m45.970s
user    0m1.657s
sys 0m0.090s

0 个答案:

没有答案