fix a reference to unexistent engine.slots.

downloaderMW doc typo (spiderMW doc copy remnant)

localhost666 is resolvable if the host running the tests contains a
"search mydomain.com" in /etc/resolv.conf and a wildcard dns entry
exists for *.mydomain.com

[WIP] Handle cases when inspect.stack() fails

[MRG] testing PIL dependency is removed because there is a new mitmproxy version

Fix wrong checks on subclassing of deprecated classes

Fix HtmlParserLinkExtractor and tests after #485 merge

Docs: 4-space indent for final spider example

make 'basic' the default template spider in genspider, and added info with next steps to startproject. closes #488

SgmlLinkExtractor: Fixed link text when there is an inner tag

OffsiteMiddleware: add 2 stats counters

[MRG] Fix tests for Travis-CI build

DOC Fixed HTTPCACHE_STORAGE typo in the default value which is now Files...

replace unencodeable codepoints with html entities

Expose current crawler in the scrapy shell.

Make `ItemLoader` ignore `None` values from processors.

RegexLinkExtractor: encode URL unicode value when creating Links

Also updated the shell example with a reproducible code example.