botlib.url
functions that fetch data from url
-
get_encoding(data)[source]
-
get_feed(url)[source]
fetch a feed.
-
get_url(*args, **kwargs)[source]
-
get_url2(url, myheaders={}, postdata={}, keyfile=None, certfile='', port=80)[source]
-
need_redirect(resp)[source]
-
parse_url(*args, **kwargs)[source]
Attribute Index Value Value if not present
scheme 0 URL scheme specifier empty string
netloc 1 Network location part empty string
path 2 Hierarchical path empty string
query 3 Query component empty string
fragment 4 Fragment identifier empty string
-
parse_urls(*args, **kwargs)[source]
-
strip_html(text)[source]
-
unescape(text)[source]
-
useragent()[source]