question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

set_crawler not working neither warning deprecated?

See original GitHub issue
class test(scrapy.Spider):
    name = 'test'

    start_urls = ['http://httpbin.org']

    def set_crawler(self, crawler):
        super(test, self).set_crawler(crawler)
        print(999999999999999)

    def parse(self, response):
        print('ok')

considering fixing or removing it?

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
kmikecommented, Jul 11, 2019

The code never issues a warning, because it is not an user who should call set_crawler - Scrapy used to call it. Now Scrapy uses from_crawler method instead of set_crawler. If user defined set_crawler method in a Spider subclass, this method just stopped working as a mean to do some work on spider init, without any deprecation warnings - warning is only displayed when a method is called, but Scrapy stopped to call it. This happened a while ago though, I don’t think we need to fix that.

0reactions
NewUserHacommented, Jul 12, 2019

don’t remember, maybe from scrapy’s source code or other’s comments. I might open this issue to say there's old code need to remove. but it’s not in the master branch now.

maybe mistake and this issue can be closed. thanks.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How can I get rid of deprecated warnings in ... - Stack Overflow
-Wno-deprecated will remove all deprecated warnings ... I get the warning only on return b(); and if someone was using a they will...
Read more >
org.jbake.app.configuration.DefaultJBakeConfiguration ... - Tabnine
@Deprecated public Renderer(ContentStore db, File destination, File templatesPath, CompositeConfiguration config) { this(db, new JBakeConfigurationFactory() ...
Read more >
glue - Go Packages
Package glue provides the client and types for making API requests to AWS Glue. Defines the public endpoint for the Glue service.
Read more >
Magento 2 Cache Warmer Extension User Guide - Mirasvit
This functionality will work only for Built-in mode (will not work for Varnish). Go to System > Page Cache Warmer > Efficiency Report....
Read more >
LiteSpeed Cache – WordPress plugin
+ This service is not provided by the LSCache plugin, nor is it guaranteed to be installed by your service provider. However, the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found