Scraping ========= PyQuery is able to load html document from urls:: >>> pq('http://duckduckgo.com/') [] By default it use python's urllib. If `requests`_ is installed then it will use it. This allow you to use most of `requests`_ parameters:: >>> pq('http://duckduckgo.com/', headers={'user-agent': 'pyquery'}) [] >>> pq('https://duckduckgo.com/', {'q': 'foo'}, method='post', verify=True) [] .. _requests: http://docs.python-requests.org/en/latest/