problem with 'mailto' links

Mandatory

• I read the documentation (readme and wiki).
• I searched other issues (including closed issues) and could not find any to be related. If you find related issues post them below or directly add your issue to the most related one.

Related issues:

• I did not find any related issues in news-please and scrapy

Describe your question I trying to crawl from its url “http://www.ladigetto.it” and I get the following error from scrapy

  File "/usr/local/lib/python3.6/dist-packages/scrapy/http/request/__init__.py", line 25, in __init__
    self._set_url(url)
  File "/usr/local/lib/python3.6/dist-packages/scrapy/http/request/__init__.py", line 69, in _set_url
    raise ValueError('Missing scheme in request url: %s' % self._url)
ValueError: Missing scheme in request url: mailto:[e-mail]

By looking at the content of the initial page of the url, I actually see the href generating the error. <a href="mailto:[e-mail]">[e-mail]</a>

Is it possible to force news-please not to follow this kind of link. Is it possible to do it through the configuration file?

Versions (please complete the following information):

• OS: Ubuntu 16.04.6 LTS
• Python Version: 3.6.8
• news-please Version: 1.5.3

Intent (optional; we’ll use this info to prioritize upcoming tasks to work on)

• personal
• academic
• business
• other
• Some information on your project:

[tobiasstrauss]

For me the problem was solved by defining an ignore_regex in the config.cfg ignore_regex = "(mail[tT]o)|([jJ]avascript)|(tel)|(fax)"

[fhamborg]

added it 😃