Scraping
=========

PyQuery is able to load html document from urls::

  >>> pq('http://duckduckgo.com/')
  [<html>]

By default it use python's urllib.

If `requests`_ is installed then it will use it. This allow you to use most of `requests`_ parameters::

  >>> pq('http://duckduckgo.com/', headers={'user-agent': 'pyquery'})
  [<html>]

  >>> pq('https://duckduckgo.com/', {'q': 'foo'}, method='post', verify=True)
  [<html>]

.. _requests: http://docs.python-requests.org/en/latest/