LWP::Parallel::RobotUA

LWP::Parallel::RobotUA is a Perl class for Parallel Web Robots.
Download

LWP::Parallel::RobotUA Ranking & Summary

Advertisement

  • Rating:
  • License:
  • Perl Artistic License
  • Price:
  • FREE
  • Publisher Name:
  • Marc Langheinrich
  • Publisher web site:
  • http://search.cpan.org/~marclang/ParallelUserAgent-2.57/lib/LWP/Parallel/UserAgent.pm

LWP::Parallel::RobotUA Tags


LWP::Parallel::RobotUA Description

LWP::Parallel::RobotUA is a Perl class for Parallel Web Robots. LWP::Parallel::RobotUA is a Perl class for Parallel Web Robots.SYNOPSIS require LWP::Parallel::RobotUA; $ua = new LWP::Parallel::RobotUA 'my-robot/0.1', 'me@foo.com'; $ua->delay(0.5); # in minutes! ... # just use it just like a normal LWP::Parallel::UserAgent $ua->register ($request, &callback, 4096); # or $ua->wait ( $timeout ); This class implements a user agent that is suitable for robot applications. Robots should be nice to the servers they visit. They should consult the /robots.txt file to ensure that they are welcomed and they should not make requests too frequently.But, before you consider writing a robot take a look at .When you use a LWP::Parallel::RobotUA as your user agent, then you do not really have to think about these things yourself. Just send requests as you do when you are using a normal LWP::Parallel::UserAgent and this special agent will make sure you are nice. Requirements: · Perl


LWP::Parallel::RobotUA Related Software