Question

我正在尝试使用http://www.nasdaqomxnordic.com/shares/listed-companies/nordic-large-cap来抓取它的数据。这是我使用Net :: HTTP发送get请求的代码：

require 'net/http'
require 'uri'

def get_stocks()
    uri = URI.parse('http://www.nasdaqomxnordic.com/aktier/listed-companies/stockholm')
    response = Net::HTTP.get_response(uri)
    puts response
 end

get_stocks()

我测试的其他网站效果很好并且响应200：好，但http://www.nasdaqomxnordic.com/shares/listed-companies/nordic-large-cap返回#<Net::HTTPBadRequest:0x00007ffe8f84ec30>，我无法理解原因。

对于进一步的上下文response.body返回：

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<META HTTP-EQUIV="CONTENT-TYPE" CONTENT="TEXT/HTML; CHARSET=utf-8"/>
<title>400 Bad Request</title></head>
<body>
    <H2>400 Bad Request</H2>
    <p>The request could not be understood by the server due to malformed syntax. The client SHOULD NOT repeat the request without modifications.</p>
    <p>This page can't be displayed.<br/>The incident ID is: 10039581164792379.</p>
    <p>If you would like assistance, please contact the Support for additional information.<br></p>
</body>
</html>

我该怎么做才能获得200:OK？

Answer 1

我认为您需要设置请求User-Agent属性。以下代码有效。

require 'net/http'
require 'uri'

def get_stocks()
  uri = URI.parse("http://www.nasdaqomxnordic.com/shares/listed-companies/nordic-large-cap")
  http = Net::HTTP.new(uri.host, uri.port)
  request = Net::HTTP::Get.new(uri.request_uri)
  user_agent = 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36'
  request.initialize_http_header({"User-Agent" => user_agent})

  response = http.request(request)
  puts response.inspect 
 end

get_stocks() # #<Net::HTTPOK 200 OK readbody=true>

您可以使用response.body

获取回复正文

Ruby Net :: HTTP 400 Bad Request

1 个答案: