LWP::Parallel::RobotUALWP::Parallel::RobotUA is a Perl class for Parallel Web Robots. | |
Download |
LWP::Parallel::RobotUA Ranking & Summary
Advertisement
- License:
- Perl Artistic License
- Price:
- FREE
- Publisher Name:
- Marc Langheinrich
- Publisher web site:
- http://search.cpan.org/~marclang/ParallelUserAgent-2.57/lib/LWP/Parallel/UserAgent.pm
LWP::Parallel::RobotUA Tags
LWP::Parallel::RobotUA Description
LWP::Parallel::RobotUA is a Perl class for Parallel Web Robots. LWP::Parallel::RobotUA is a Perl class for Parallel Web Robots.SYNOPSIS require LWP::Parallel::RobotUA; $ua = new LWP::Parallel::RobotUA 'my-robot/0.1', 'me@foo.com'; $ua->delay(0.5); # in minutes! ... # just use it just like a normal LWP::Parallel::UserAgent $ua->register ($request, &callback, 4096); # or $ua->wait ( $timeout ); This class implements a user agent that is suitable for robot applications. Robots should be nice to the servers they visit. They should consult the /robots.txt file to ensure that they are welcomed and they should not make requests too frequently.But, before you consider writing a robot take a look at .When you use a LWP::Parallel::RobotUA as your user agent, then you do not really have to think about these things yourself. Just send requests as you do when you are using a normal LWP::Parallel::UserAgent and this special agent will make sure you are nice. Requirements: · Perl
LWP::Parallel::RobotUA Related Software