scrapelib

A library for scraping things
Download

scrapelib Ranking & Summary

Advertisement

  • Rating:
  • License:
  • BSD License
  • Price:
  • FREE
  • Publisher Name:
  • Michael Stephens
  • Publisher web site:
  • http://mikej.st

scrapelib Tags


scrapelib Description

A library for scraping things scrapelib is a Python library for scraping things.Installationscrapelib is available on PyPI and thus can be downloaded installed via pip install scrapelib or easy_install scrapelib.To install from a source distribution run python setup.py install.Example Usageimport scrapelibs = scrapelib.Scraper(requests_per_minute=10, allow_cookies=True, follow_robots=True)# Grab Google front pages.urlopen('http://google.com')# Will raise RobotExclusionErrors.urlopen('http://google.com/search')# Will be throttled to 10 HTTP requests per minutewhile True: s.urlopen('http://example.com')


scrapelib Related Software

About SoftwareSea