Question

我试图在Python中使用PhantomJS（在Windows中）与Selenium进行网页抓取。
我从网站上下载了最新的PhantomJS版本，然后将其解压缩。之后我尝试了

from selenium import webdriver
browser = webdriver.PhantomJS()

回应是

WebDriverException: 'phantomjs' executable needs to be in PATH.

然后我尝试添加路径，例如

browser = webdriver.PhantomJS('path_to/phantomjs.exe')

我也试过把一个＆＃39; r＆＃39;在路径之前。回复是HTML中的一种例外：

WebDriverException: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>Notification: Gateway Timeout</title>

<style type="text/css">
body {
  font-family: Arial, Helvetica, sans-serif;
  font-size: 14px;
  color:#333333;
  background-color: #ffffff;
}
h1 {
  font-size: 18px;
  font-weight: bold;
  text-decoration: none;
  padding-top: 0px;
  color: #2970A6;
}
a:link {
    color: #2970A6;
  text-decoration: none;
}
a:hover {
    color: #2970A6;
  text-decoration: underline;
}
p.buttonlink {
  margin-bottom: 24px;
}
.copyright {
  font-size: 12px;
  color: #666666;
  margin: 5px 5px 0px 30px;

}
.details {
  font-size: 14px;
  color: #969696;
  border: none;
  padding: 20px 20px 20px 20px;
  margin: 0px 10px 10px 35px;
}

.shadow {
  border: 3px solid #9f9f9f;
  padding: 10px 25px 10px 25px;
  margin: 10px 35px 0px 30px;
  background-color: #ffffff;
  width: 600px;

  -moz-box-shadow: 3px 3px 3px #cccccc;
  -webkit-box-shadow: 3px 3px 3px #cccccc;
  box-shadow: 3px 3px 3px #cccccc;
  /* For IE 8 */
  -ms-filter: "progid:DXImageTransform.Microsoft.Shadow(Strength=5, Direction=135, Color='cccccc')";
  /* For IE 5.5 - 7 */
  filter: progid:DXImageTransform.Microsoft.Shadow(Strength=5, Direction=135, Color='cccccc');
}
.logo {
  border: none;
  margin: 5px 5px 0px 30px;
}
</style>

</head>

<body>
<div class="logo"></div><p>&nbsp;</p>
<div class="shadow">
<h1>This Page Cannot Be Displayed</h1>


<p>
The system cannot communicate with the external server (&nbsp;127.0.0.1&nbsp;).
The Internet server may be busy, may be permanently down, or may be
unreachable because of network problems.
</p>

<p>
Please check the spelling of the Internet address entered.
If it is correct, try this request later.
</p>



<p>
If you have questions, please contact
your corporate network administrator 
and provide the codes shown below.
</p>

</div>

<div class="details"><p>
Date: Mon, 30 May 2016 12:30:14 CEST<br />
Username: <br />
Source IP: 10.202.210.98<br />
URL: POST http://127.0.0.1/wd/hub/session<br />
Category: Uncategorized URLs<br />
Reason: UNKNOWN<br />
Notification: GATEWAY_TIMEOUT
</p></div>
</body>
</html>

我已将此代码打开到Chrome会话中，它会打开我公司的防火墙页面。消息是＆＃34;系统无法与外部服务器（127.0.0.1）通信。＆＃34;。我可以使用Chrome或Firefox驱动程序进行webscrape，但是PhantomJS存在这个问题。你能帮帮我吗？

Answer 1

尝试使用绝对路径，如下所示，并为'127.0.0.1'设置'NO_PROXY'环境

os.environ['NO_PROXY'] = '127.0.0.1'
driver = webdriver.PhantomJS(
 executable_path=r'C:\Python\Python35-32\Lib\site-packages\phantomjs-2.1.1-windows\bin\phantomjs')

Answer 2

我也试图让它在Windows下工作......

我正在对WebDriver进行超类，我在初始化超类时将可执行文件所在的ABSOLUTE路径传递给webdriver的__init__方法。

这让我更进一步 - 现在我正在看

Exception WebDriverException: Message: 'phantomjs' executable may have wrong permissions.

这给我的印象是我在正确的轨道上......这表明你可以将可执行文件所在的路径传递给webdriver对象的构造函数（作为一个简单的字符串）。

来自selenium的PhantomJS - Python

2 个答案: