提交 6a50af05 编写于 作者: P Pablo Hoffman

removed useless SpiderReloader extension

上级 79851aef
......@@ -232,17 +232,6 @@ The telnet console must be enabled by the :setting:`TELNETCONSOLE_ENABLED`
setting, and the server will listen in the port specified in
:setting:`WEBCONSOLE_PORT`.
Spider reloader extension
~~~~~~~~~~~~~~~~~~~~~~~~~
.. module:: scrapy.contrib.spider.reloader
:synopsis: Spider reloader extension
.. class:: scrapy.contrib.spider.reloader.SpiderReloader
Reload spider objects once they've finished scraping, to release the resources
and references to other objects they may hold.
.. _topics-extensions-ref-memusage:
Memory usage extension
......
......@@ -492,7 +492,6 @@ Default::
'scrapy.contrib.webconsole.spiderctl.Spiderctl': 0,
'scrapy.contrib.webconsole.enginestatus.EngineStatus': 0,
'scrapy.contrib.webconsole.stats.StatsDump': 0,
'scrapy.contrib.spider.reloader.SpiderReloader': 0,
'scrapy.contrib.memusage.MemoryUsage': 0,
'scrapy.contrib.memdebug.MemoryDebugger': 0,
'scrapy.contrib.closedomain.CloseDomain': 0,
......
......@@ -81,7 +81,6 @@ EXTENSIONS_BASE = {
'scrapy.contrib.webconsole.spiderctl.Spiderctl': 0,
'scrapy.contrib.webconsole.enginestatus.EngineStatus': 0,
'scrapy.contrib.webconsole.stats.StatsDump': 0,
'scrapy.contrib.spider.reloader.SpiderReloader': 0,
'scrapy.contrib.memusage.MemoryUsage': 0,
'scrapy.contrib.memdebug.MemoryDebugger': 0,
'scrapy.contrib.closedomain.CloseDomain': 0,
......
"""
Reload spider modules once they are finished scraping
This is to release any resources held on to by scraping spiders.
"""
import sys
from scrapy.xlib.pydispatch import dispatcher
from scrapy.core import signals
from scrapy import log
class SpiderReloader(object):
def __init__(self):
dispatcher.connect(self.domain_closed, signal=signals.domain_closed)
def domain_closed(self, domain, spider):
module = spider.__module__
log.msg("reloading module %s" % module, domain=domain)
reload(sys.modules[module])
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册