scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware.from_crawler

Here are the examples of the python api scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware.from_crawler taken from open source projects. By voting up you can indicate which examples are most useful and appropriate.

1 Examples 7

Example 1

Project: scrapy Source File: test_downloadermiddleware_defaultheaders.py
    def get_defaults_spider_mw(self):
        crawler = get_crawler(Spider)
        spider = crawler._create_spider('foo')
        defaults = {
            to_bytes(k): [to_bytes(v)]
            for k, v in crawler.settings.get('DEFAULT_REQUEST_HEADERS').items()
        }
        return defaults, spider, DefaultHeadersMiddleware.from_crawler(crawler)