.. crawley documentation master file, created by sphinx-quickstart on Wed Sep 14 10:05:07 2011. You can adapt this file completely to your liking, but it should at least contain the root `toctree` directive. Crawley's Documentation =================================== Crawley is a pythonic Scraping / Crawling Framework intended to make easy the way you extract data from web pages into structured storages such as databases. Features ================= - High Speed WebCrawler built on Eventlet. - Supports databases engines like Postgre, Mysql, Oracle, Sqlite. - Command line tools. - Extract data using your favourite tool. XPath or Pyquery (A Jquery-like library for python). - Cookie Handlers. - Very easy to use (see the ``example``). Table of Contents ================= .. toctree:: example settings reference more_examples