Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Avoid returncode 429 (MultipleRequestsError) by passing customizable user-agent and from fields

See original GitHub issue

I just ran into an issue along the lines of the one described here. The Overpass API would suddenly return 429 where it had previously just worked. As it turns out, this may be due to a (temporary) restriction, which can be avoided by sending custom user-agent and from headers.

I solved it by modifying the following bit of code in overpass like this:

        try:
            r = requests.post(
                self.endpoint,
                data=payload,
                timeout=self.timeout,
                headers={
                    'Accept-Charset': 'utf-8;q=0.7,*;q=0.7',
                    'From': 'somebody@website.xyz',
                    'Referer': 'http://www.website.xyz/',
                    'User-Agent': 'overpass-api-python-wrapper (Linux x86_64)'
                    }
            )

I’d love it if those fields were customizable through the API class constructor.

Issue Analytics

State:
Created 6 years ago
Comments:9 (3 by maintainers)

Top GitHub Comments

1reaction

mmd-osmcommented, Mar 15, 2018

HTTP 429 means that you’re hitting the rate limiter by sending too many and/or too expensive queries. Check /api/status to find out how many seconds you need to wait before sending the next request.

Obviously, putting in a suitable User Agent is always a plus, but won’t affect the overall HTTP 429 logic in any way.

BTW: Issue was reported here (#38) before, but closed again as noone was picking it up for quite a while. Great, that there’s some follow up now!

0reactions

mvexelcommented, Mar 22, 2022

With comment from @mmd-osm, closing this issue for now. Feel free to re-open if you see a good path forward with this.