scrapy LOG_LEVEL setting in Spider.custom_settings does not work

I set the LOG_LEVEL setting to INFO in the Spider class via the custom_settings attribute but I still see the DEBUG messages in the console.

When I set it on the settings.py file or via the command line option --loglevel, it works.

I thought any settings could be set via the custom_settings attribute. Is that a bug? (Scrapy 1.0.3 and python 2.7.10)

class TestSpider(scrapy.Spider):
    name = "Test"
    ...
    custom_settings = {
        'LOG_LEVEL': 'INFO',
    }

[kmike]

+1 to fix it; it looks like a bug for me.

[ianhhhhhhhhe]

About settings, i think maybe you setup but you don’t know how to import or activate them. And that’s why your logging doesn’t work.

So here are some solutions might help.

You need to sure that settings url is corret in root/scrapy.cfg. Then you can set your logging in settings.py. I suggest at least setup LOG_FILE and LOG_LEVEL.

Then you can run scrapy crawl crawler_name

If you want to run the spider from a script, you will need from scrapy.utils.project import get_project_settings and from scrapy.utils.log import configure_logging . Then put configure_logging(get_project_settings) to where you need to activating logging.