Navigation
index
modules
|
Scrapy v0.9 documentation
»
Global Module Index
S
S
scrapy
scrapy.conf
Settings manager
scrapy.contrib.closespider
Close spider extension
scrapy.contrib.corestats.corestats
Core stats collection
scrapy.contrib.debug
Extensions for debugging Scrapy
scrapy.contrib.downloadermiddleware
scrapy.contrib.downloadermiddleware.cookies
Cookies Downloader Middleware
scrapy.contrib.downloadermiddleware.defaultheaders
Default Headers Downloader Middleware
scrapy.contrib.downloadermiddleware.httpauth
HTTP Auth downloader middleware
scrapy.contrib.downloadermiddleware.httpcache
HTTP Cache downloader middleware
scrapy.contrib.downloadermiddleware.httpcompression
Http Compression Middleware
scrapy.contrib.downloadermiddleware.httpproxy
Http Proxy Middleware
scrapy.contrib.downloadermiddleware.redirect
Redirection Middleware
scrapy.contrib.downloadermiddleware.retry
Retry Middleware
scrapy.contrib.downloadermiddleware.robotstxt
robots.txt middleware
scrapy.contrib.downloadermiddleware.stats
Downloader Stats Middleware
scrapy.contrib.downloadermiddleware.useragent
User Agent Middleware
scrapy.contrib.exporter
Item Exporters
scrapy.contrib.exporter.jsonlines
JsonLines Item Exporter
scrapy.contrib.linkextractors
Link extractors classes
scrapy.contrib.linkextractors.sgml
SGMLParser-based link extractors
scrapy.contrib.loader
Item Loader class
scrapy.contrib.loader.processor
A collection of processors to use with Item Loaders
scrapy.contrib.memdebug
Memory debugger extension
scrapy.contrib.memusage
Memory usage extension
scrapy.contrib.pipeline
Item Pipeline manager and built-in pipelines
scrapy.contrib.pipeline.fileexport
scrapy.contrib.pipeline.images
Images Pipeline
scrapy.contrib.schedulermiddleware
scrapy.contrib.schedulermiddleware.duplicatesfilter
Duplicates Filter Scheduler Middleware
scrapy.contrib.spidermiddleware
scrapy.contrib.spidermiddleware.depth
Depth Spider Middleware
scrapy.contrib.spidermiddleware.httperror
HTTP Error Spider Middleware
scrapy.contrib.spidermiddleware.offsite
Offiste Spider Middleware
scrapy.contrib.spidermiddleware.referer
Referer Spider Middleware
scrapy.contrib.spidermiddleware.requestlimit
Request limit Spider Middleware
scrapy.contrib.spidermiddleware.urlfilter
URL Filter Spider Middleware
scrapy.contrib.spidermiddleware.urllength
URL Length Spider Middleware
scrapy.contrib.spiders
Collection of generic spiders
scrapy.contrib.statsmailer
StatsMailer extension
scrapy.contrib.webservice
Built-in web service resources
scrapy.contrib.webservice.enginestatus
Engine Status JSON resource
scrapy.contrib.webservice.extensions
Extension Manager JSON-RPC resource
scrapy.contrib.webservice.manager
Execution Manager JSON-RPC resource
scrapy.contrib.webservice.spiders
Spider Manager JSON-RPC resource
scrapy.contrib.webservice.stats
Stats JSON-RPC resource
scrapy.contrib_exp.crawlspider.matchers
Matchers
scrapy.contrib_exp.crawlspider.reqext
Request Extractors
scrapy.contrib_exp.crawlspider.reqproc
Request Processors
scrapy.contrib_exp.crawlspider.rules
Rules
scrapy.contrib_exp.crawlspider.spider
CrawlSpider
scrapy.contrib_exp.djangoitem
scrapy.core.exceptions
Core exceptions
scrapy.core.signals
Signals definitions
scrapy.extension
The extension manager
scrapy.http
Request and Response classes
scrapy.item
Item and Field classes
scrapy.log
Logging facility
scrapy.mail
Email sending facility
scrapy.management.telnet
The Telnet Console
scrapy.selector
XPath selectors classes
scrapy.spider
Spiders base class, spider manager and spider middleware
scrapy.stats.collector
Basic Stats Collectors
scrapy.stats.collector.simpledb
Simpledb Stats Collector
scrapy.stats.signals
Stats Collector signals
scrapy.telnet
Telnet console
scrapy.utils.trackref
Track references of live objects
scrapy.webservice
Web service
Quick search
Enter search terms or a module, class or function name.
Navigation
index
modules
|
Scrapy v0.9 documentation
»