Ubuntu上的Chromedriver:selenium.common.exceptions.SessionNotCreatedException:消息:未创建会话

时间:2019-11-02 16:52:56

标签: python amazon-web-services ubuntu amazon-ec2 selenium-chromedriver

在AWS(EC2实例)的ubuntu环境中使用Selenium + chromedriver遇到麻烦。

我正在使用chromedriver Linux64版本(wnload chromedriver for Linux: wget https://chromedriver.storage.googleapis.com/78.0.3904.70/chromedriver_linux64.zip)。然后将chromedriver放在/usr/bin中。

使用sudo dpkg -i google-chrome-stable_current_amd64.deb为ubuntu下载了Chrome,如果我使用google-chrome --version验证了chrome的版本,我会看到它是:

Google Chrome 78.0.3904.70 

以下python代码有效,但问题在于它仅偶尔起作用。

options = Options()
options.add_argument('--no-sandbox')
options.add_argument('--window-size=1420,1080')
options.add_argument('--headless')
options.add_argument('--disable-dev-shm-usage')
options.add_argument("--remote-debugging-port=9222")
options.add_argument('--disable-gpu')


driver = webdriver.Chrome(chrome_options=options)

#Set base url (SAN FRANCISCO)
base_url = 'https://www.bandsintown.com/en/c/san-francisco-ca?page='

#Build events array 
events = []
eventContainerBucket = []

for i in range(1,2):

    #cycle through pages in range
    driver.get(base_url + str(i))
    pageURL = base_url + str(i)
    print(pageURL)

虽然上面的代码过去一直没有问题,但是如果我运行几次,最终会收到以下错误:

    Traceback (most recent call last):
  File "BandsInTown_Scraper_SF.py", line 84, in <module>
    driver = webdriver.Chrome(chrome_options=options)
  File "/home/ubuntu/.local/lib/python3.6/site-packages/selenium/webdriver/chrome/webdriver.py", line 81, in __init__
    desired_capabilities=desired_capabilities)
  File "/home/ubuntu/.local/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__
    self.start_session(capabilities, browser_profile)
  File "/home/ubuntu/.local/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session
    response = self.execute(Command.NEW_SESSION, parameters)
  File "/home/ubuntu/.local/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/home/ubuntu/.local/lib/python3.6/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.SessionNotCreatedException: Message: session not created
from disconnected: unable to connect to renderer
  (Session info: headless chrome=78.0.3904.70)

我已阅读到要解决此问题,您可能需要编辑etc/hosts文件。我看过这里,一切看起来都很好:

##
# Host Database
#
# localhost is used to configure the loopback interface
# when the system is booting.  Do not change this entry.
##
127.0.0.1   localhost
255.255.255.255 broadcasthost
::1             localhost 

我也可以使用请求和通过服务器访问URL。例如,以下文字不会给我带来任何问题:

url = 'https://www.bandsintown.com/en/c/san-francisco-ca?page=6'
res = requests.get(url)
html_page = res.content

soup = BeautifulSoup(html_page, 'html.parser')
text = soup.find_all(text=True)
print(text)

我认为可能导致此问题的另一条重要信息是,可能不允许chromedriver在无头模式下运行。例如,如果我在终端中输入chromedriver,则会收到以下消息:

Starting ChromeDriver 78.0.3904.70 (edb9c9f3de0247fd912a77b7f6cae7447f6d3ad5-refs/branch-heads/3904@{#800}) on port 9515
Only local connections are allowed.
Please protect ports used by ChromeDriver and related test frameworks to prevent access by malicious code.

最后,如果我尝试在chmod 777中执行/usr/bin,则会显示operation not permitted。这可能是问题的一部分吗?

因此,看来chrome + chromedriver是相同的版本,所以这不是问题。 Chromedriver和硒似乎被阻止了。我对如何解决这个问题有些困惑。如果有人有建议,我将不胜感激!谢谢。

1 个答案:

答案 0 :(得分:0)

此问题已解决,问题似乎已经解决了。删除此行:options.add_argument("--remote-debugging-port=9222")似乎可以解决此问题。谢谢。