Scrapy 学习笔记二 Command line tool

Creating projects：

scrapy startproject /projectname/ [project_dir]

This command will create new project under the project_dir directory.

Controlling projects:

1.create new spider:

scrape genspider spidername spider 

This command will create new spider in your project;

Command List：

startproject :

scrape startproject <project_name> [project_dir]

Create a new Scrapy project.The project under the project_dir directory.

genspider:

scrape genspider [-t template] <name> <domain>

Create a new spider in current folder.

example:

scrapy spider -t crawl scrapyard scrapy.org # create spider ‘ scrapyard’ using template ‘crawl’

crawl:

scrapy crawl <spider>

Start crawling using a spider.

check:

scrapy check [-l] <spider>

Run contract checks.

list:

scrapy list

List all spiders in current project.

edit:

scrapy edit <spider>

fetch:

scrapy fetch <url>

Downloads the given URL using the Scrapy downloader and writes the contents to standard output.

shell:

scrapy shell [url]

Starts the Scrapy shell.

settings:

scrapy settings [options]

Get value of a Scrapy setting.If you run this command in your project ,You will get project setting value, otherwise you will get default Scrapy value for that setting.