Question

我正在尝试从需要登录过程的网站下载文件。此过程可以手动完成，如下所示：

打开浏览器并登录页面
如果您输入的是网址，则可以访问该文件。

我的问题就更复杂了，我必须做一些处理才能获得带有硒的URL。但是我无法通过常见方法下载文件：

获取网址（我听到的吱吱声无法通过try / catch逃脱）。
生成一个javascript元素并单击它会在网站中生成异常。

所以我的新方法是：

使用硒进行登录。
获取在请求中完成的cookie和标头。
使用硒发出请求。

这是我的方法：

use Selenium::Firefox;
use strict;
use warnings;
use utf8;
use Selenium::Waiter qw/wait_until/;

use LWP::UserAgent;
use File::Temp;
use HTTP::Cookies;
use Data::Dumper qw/Dumper/;


my $driver = Selenium::Firefox->new(marionette_enabled => 1 );
$driver->set_implicit_wait_timeout(3000);

$driver->get('https://example.com');

# processing and login

my $uri = 'https://example.com/myfile.tcx';

print "Downloading the following file: $url\n";

my $cookies = $driver->get_all_cookies();

# Create temporary file to download
my $tmp = File::Temp->new( TEMPLATE => 'myTemplateXXXX', SUFFIX=>'.tcx', UNLINK=>0 );

my $cookie_jar_obj = HTTP::Cookies->new(ignore_discard=>1,hide_cookie2=>1);
my $ua = LWP::UserAgent->new();
$ua->cookie_jar( $cookie_jar_obj );

foreach my $cookie_ref (@{$cookies}){
  my %cookie = %{$cookie_ref};
  my $name = $cookie{'name'};# - STRING
  my $value = $cookie{'value'};# - STRING
  my $path = $cookie{'path'};# - STRING
  my $domain = $cookie{'domain'};# - STRING
  my $secure = $cookie{'secure'};# - BOOLEAN

  print "Name: $name ";
  print "Value: $value ";
  print "Path: $path ";
  print "Domain: $domain ";
  print "Secure: $secure \n";

  $cookie_jar_obj->set_cookie(0, $name, $value
                             , $path, $domain, 443
                             , '', $secure, 14400000, 0
                    );
}



print "Cookies to be sent:\n";
print Dumper($cookie_jar_obj->get_cookies( ".myhost.com" ));

$ua->default_header('Accept' => "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8");
$ua->default_header('Accept-Encoding' => "gzip, deflate, br");
$ua->default_header('Accept-Language' => "en-US,en;q=0.5");
$ua->default_header('Connection' => "keep-alive");
$ua->default_header('Host' => "www.example.com");
$ua->default_header('Upgrade-Insecure-Requests' => "1");
$ua->default_header('User-Agent' => "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:64.0) Gecko/20100101 Firefox/64.0");

$ua->show_progress( 1 );

my $response = $ua->get($uri, ':content_file' => $tmp->filename);

print $response->status_line,"\n" if !$response->is_success;
print $tmp->filename . "\n";

<>;
$driver->get('https://example.com');

但我仍然得到：

401未经授权（9s）

是否可以在Selenium和LWP :: UserAgent之间共享会话？

0 个答案: