add instructions about how to define output file when running scrapy …

* Update statscollectors.py

* Update statscollectors.py

* Update statscollectors.py

* Update crawler.py

* Update crawler.py

* corrected tests

* Update test_utils_log.py

* Update crawler.py

* Update crawler.py

* interchanged order

* correced

Deprecate scrapy.utils.datatypes.MergeDict in favor of collections.ChainMap

Prevent deprecation warnings

* assertRegexpMatches -> assertRegex

* assertRegexpMatches -> assertRegex
* invalid escape sequence \[

Remove docs/topics/ubuntu.rst

Extend the topic about broad crawls with information about memory usage

Added section on how to treat memory consumption problems of broad crawls.

Add a setting to use active mode in FTPFeedStorage

FTP servers can be configured in active and passive mode, by default
Python and Scrapy use passive mode and there was no way to use active.

This commit adds a setting FEED_STORAGE_FTP_ACTIVE to allow a feed
to be exported to a FTP server configured in active mode.

Increase the documentation coverage of exceptions

[Docs] CrawlSpider: update Rule docs

Document that the crawl order is BFO for small numbers of start requests

Add a FAQ entry about splitting items in item pipelines

Skip scrapy.downloadermiddlewares private APIs in the documentation c…

PEP8 in cmdline.py

More deprecations