scrapy.utils.defer.iter_errback

Here are the examples of the python api scrapy.utils.defer.iter_errback taken from open source projects. By voting up you can indicate which examples are most useful and appropriate.

1 Examples 7

3 Source : scraper.py
with MIT License
from autofelix

    def handle_spider_output(self, result, request, response, spider):
        if not result:
            return defer_succeed(None)
        it = iter_errback(result, self.handle_spider_error, request, response, spider)
        dfd = parallel(it, self.concurrent_items,
            self._process_spidermw_output, request, response, spider)
        return dfd

    def _process_spidermw_output(self, output, request, response, spider):