Scrapy: python module to web crawling and scrapying

Use scrapy to crawl the amazon products’ comments:

Install the ipython first:
Tip1: use these two lines to implement the python autocomplete

autocomplete for python command linelink
import rlcompleter, readline
readline.parse_and_bind('tab:complete')