Crawler
Search Crawler and Top Keywords Crawler
-
class crawler.SearchResults(q, total, lists, malls, ads, cats, keywords)[source]
Search Results Object
-
class crawler.Cat(id, url, title, amount)[source]
The category object in search results
-
class crawler.Item(id, summary, photo, attrs, legends=None)[source]
The item object in search results
-
class crawler.ItemAttr(price, transaction, shipment_fee=None, location=None, seller=None, seller_id=None)[source]
The item’s attributs object in search results
-
class crawler.Ad(**kwargs)[source]
The advertisement object in search results
-
class crawler.Crawler(proxies=[])[source]
General Crawler for Taobao Site.
-
cat_top_keywords(cat, level3='', up=True, offset=0, offsets=[])[source]
Get top keywords in a specific category
-
get_cats()[source]
Get top keywords categories
-
get_top_keywords(cats=None, parent=None, up=True)[source]
Get top keywords for all the categories
-
search(keyword)[source]
Get search results for a specific keyword