.. _plugin:spider:

======
SPIDER
======
| 

about
-----
| 

:author:  adapted for JSONBOT,FBFBOT by FeedBackLoop <feedbackloop@gmail.com>
:contact: FREENODE/#fbf
:distribution: core
:license:  

| 

description
-----------
| 

 
    Spider plugin.. Spider websites and makes an index into them.

    taken from http://code.activestate.com/recipes/576551-simple-web-crawler/

    -- BHJTW 15-11-2011 Adapted for JSONBOT
    -- BHJTW 14-09-2012 ported to FBFBOT





| 

commands
--------
| 


    :commands in this plugin: spider-stop .. spider

| 

1) *spider .. [handle_spider]*

    :description: []

    :permissions: OPER

    :code: :ref:`fbf.plugs.extra.spider_spider_command`.

    :examples:

    ::

        <user> ;spider http:///docs/fbfbot/handbook
        <output> calling fetcher on Tue Oct 2 19:38:29 2012


2) *spider-stop .. [handle_spiderstop]*

    :description: []

    :permissions: OPER

    :code: :ref:`fbf.plugs.extra.spider_spider-stop_command`.

    :examples:

    ::

        <user> ;spider-stop
        <output> stopped 1 spiders