我有一个包含 100 万个域的数据库中的域列表。 我使用下面的 python 代码过滤掉两个不同 .csv 文件中当前注册的域和过期的域。
但是当我向域名注册商查询时,注册域名列表中大约 15-20% 的域名已过期。
我正在考虑如何进一步改进我的代码。 在 whois 测试之后加入 ping 测试会提高准确性吗?
非常感谢建议...
import requests
import whois
import csv
from csv import reader
import concurrent.futures
import tldextract
AllDomains = []
with open('raw-domains.csv', 'r') as f:
reader = csv.reader(f)
for row in reader:
AllDomains.append(row[0])
def filterdomains (domainname):
try:
a=(tldextract.extract(domainname))
host = a.registered_domain
res = whois.whois(host) # Check Whois info.
# save domain as registered if whois info found
with open('Registered-domains.csv', 'a', encoding="utf-8", newline='') as myfile:
writer = csv.writer(myfile)
writer.writerow([host])
print(host+"--Registered")
except whois.parser.PywhoisError:
# save domain as expired if whois info is not available
with open('Expired-domains.csv', 'a', encoding="utf-8", newline='') as myfile:
writer = csv.writer(myfile)
writer.writerow([host])
print(host+"--Expired")
with concurrent.futures.ThreadPoolExecutor(max_workers=20) as executor:
executor.map(filterdomains, AllDomains)