如何使用AnyEvent :: HTTP只获取页面的一部分?

时间:2017-04-11 19:57:57

标签: perl anyevent

有必要只读取部分页面(n个字节)并关闭连接,如何在AnyEvent :: HTTP上执行此操作?

1 个答案:

答案 0 :(得分:5)

随着块的到来,

on_body被重复调用。从on_body返回false会终止下载。

sub my_http_request {
   my $cb = pop;
   my ($method, $url, %args) = @_;

   croak("Unsupported: on_body")          if $args{on_body};
   croak("Unsupported: want_body_handle") if $args{want_body_handle};

   my $max_to_read = delete($args{max_to_read});

   my $data;
   return http_request(
      $method => $url,
      %args,
      on_body => sub {
         #my ($chunk, $headers) = @_;
         $data .= $_[0];
         return !defined($max_to_read) || length($data) < $max_to_read;
      },
      sub {
         my (undef, $headers) = @_;
         $cb->($data, $headers);
      },
   );
}

使用my_http_request就像http_request一样,但它接受可选的max_to_read参数。

例如,

my $cb = AnyEvent->condvar();
my_http_request(
   GET => 'http://...',
   ...
   max_to_read => ...,
   $cb,
);

my ($data, $headers) = $cb->recv();

例如,

my $done = AnyEvent->condvar();
my_http_request(
   GET => 'http://...',
   ...
   max_to_read => ...,
   sub {
      my ($data, $headers) = @_;
      ...
      $done->send();
   },
);

$done->recv();