Welcome to Dragline’s documentation!

What is Dragline?

Dragline is a pure pythonic library that intended to create the crawling applications in python.Builtin crawler is capable of scraping any no of pages and fetches the URL.The main target of dragline is to create custom spiders on the web. The creative usage of the Dragline remains in the hands of the developer.This documentation leads a developer to easily come up with all the tools available and how they can be used to build a custom spider in few minutes.

Features

There are some crawling packages available in the community.Effieciency must be given the utmost priority since the emergence of large projects.Dragline is different from others in many aspects.The most significant feautures of dragline those makes it powerful:

  1. Built from scratch.
  2. redis backend for persistant storage.

First steps

Installation guide
Get Dragline installed on your computer.
Dragline Tutorial
Write your first Dragline project.

Indices and tables