Welcome to Spidy’s documentation!

The documentation explains what is Spidy and how it’s used and also provides a few real-life examples.

Contents

• What’s Spidy?
  • A Very Basic Example
• Installation Instructions
  • Mac OS X
  • Windows
    • Prerequisites
    • Installation
• Gearing Up for Scraping
  • Tools Complementing Spidy
  • Getting Data Selectors
  • Things to Keep in Mind
• Writing Scripts
  • Typical Script
  • Documents and Formats
  • News Example
• Cleaner Scripts with Templates
  • Currencies Example
  • Getting More from Strings
• Consuming JSON
  • JSON Weather API Example
• Working with Spidy Shell
  • Shell Commands
  • Validating Scripts
  • Running Scripts
  • A Word About Logging
• Relesase Notes
  • 0.2 beta (27-09-2014)
  • 0.1 pre-alpha (07-04-2014)

Appendix

• Architecture Overview
• General Syntax Rules
• Syntax Reference
  • Spidy Commands
    • get
    • skip
    • traverse
    • for...in
    • while
    • break
    • continue
    • if...else
    • merge
    • log
    • return
  • Spidy Operators
    • Containment Test
    • Lists
    • Type Conversion
    • XPath
    • Regex
    • Comments
  • Grammar Definition
• Useful Links
• Authors and Maintainers Contacts