Scraping ========= PyQuery is able to load html document from urls:: >>> pq('http://duckduckgo.com/') [<html>] By default it use python's urllib. If `requests`_ is installed then it will use it. This allow you to use most of `requests`_ parameters:: >>> pq('http://duckduckgo.com/', headers={'user-agent': 'pyquery'}) [<html>] >>> pq('https://duckduckgo.com/', {'q': 'foo'}, method='post', verify=True) [<html>] .. _requests: http://docs.python-requests.org/en/latest/