Crawler¶

Search Crawler and Top Keywords Crawler

class pyTOP.crawler.SearchResults(q, total, lists, malls, ads, cats, keywords)¶: Search Results Object

class pyTOP.crawler.Cat(id, url, title, amount)¶: The category object in search results

class pyTOP.crawler.Item(id, summary, photo, attrs, legends=None)¶: The item object in search results

class pyTOP.crawler.ItemAttr(price, transaction, shipment_fee=None, location=None, seller=None, seller_id=None)¶: The item’s attributs object in search results

class pyTOP.crawler.Ad(**kwargs)¶: The advertisement object in search results

class pyTOP.crawler.Crawler(proxies=[])¶

General Crawler for Taobao Site.

cat_top_keywords(session, cat, up=True, offset=0, offsets=[])¶: Get top keywords in a specific category

get_cats()¶: Get top keywords categories

get_top_keywords(up=True)¶: Get top keywords for all the categories

search(keyword)¶: Get search results for a specific keyword