curl 302重定向不起作用(命令行)

时间:2014-01-03 13:53:44

标签: bash curl scrape

在浏览器中,导航到此URL会启动302(暂时移动)请求,该请求又会下载文件。

  

http://www.targetsite.com/target.php/?event=download&task_id=123

当我通过Chrome网络工具查看实际发生的情况时,我发现重定向将转到动态生成的路径,该路径会在下载后立即取消。换句话说,即使我知道完整路径,我也没有时间手动调用它。

那么,如何使用命令行模仿浏览器操作?

我试过

  

curl --cookies bin / cookies.txt -O -L“http://www.targetsite.com/target.php/?event=download&task_id=123” - 压缩

但这只会带来胡言乱语。这样做的目的是以编程方式下载此文件,而无需导航到该站点。不幸的是,我不能在这里共享网站,因为它是登录后面的。

1 个答案:

答案 0 :(得分:44)

您需要提供-L--location选项才能启用curl来关注HTTP重定向。

引自man curl

   -L, --location
          (HTTP/HTTPS)  If  the server reports that the requested page has
          moved to a different location (indicated with a Location: header
          and  a  3XX  response code), this option will make curl redo the
          request on the new place. If used together with -i, --include or
          -I, --head, headers from all requested pages will be shown. When
          authentication is used, curl only sends its credentials  to  the
          initial  host.  If a redirect takes curl to a different host, it
          won't be able to intercept the user+password. See  also  --loca‐
          tion-trusted  on how to change this. You can limit the amount of
          redirects to follow by using the --max-redirs option.

          When curl follows a redirect and the request is not a plain  GET
          (for example POST or PUT), it will do the following request with
          a GET if the HTTP response was 301, 302, or 303. If the response
          code  was  any  other  3xx code, curl will re-send the following
          request using the same unmodified method.