question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Proxy Tunnel Error message length

See original GitHub issue

Summary

Proxy TunnelError message length shouldn’t be truncated to 32 bytes

Motivation

Often there might be some Proxy TunnelErrors which are currently truncated to 32 characters by these lines of code: https://github.com/scrapy/scrapy/blame/master/scrapy/core/downloader/handlers/http11.py#L170 / https://github.com/scrapy/scrapy/blame/master/scrapy/core/downloader/handlers/http11.py#L125

Describe alternatives you’ve considered

Is there a legitimate reason why this should be truncated?

Additional context

I’m getting this exception raised scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy zproxy.lum-superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error No pe'}] instead of scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy zproxy.lum-superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error No peers available'}]

Tried out by removing the 32 character truncation in my specific use-case and it seems to work.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:7 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
kmikecommented, Mar 3, 2021

1K? 😃

1reaction
Bhavesh0327commented, Feb 23, 2021

@akinad3 I don’t think the length of 64 will be short for any error message here. Should I make the change?

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to Solve Proxy Error Codes - The Ultimate Guide!
Typically, webservers are setting fairly generous genuine URLs limits on length. In case that a long URL is valid and you are still...
Read more >
503 Service Unavailable - Proxy tunnel creation failed with 403
The client application gets an HTTP status code of 503 Service Unavailable with the error code protocol.http.ProxyTunnelCreationFailed as a response for API ...
Read more >
Stuck with Proxy Error? Ways to Solve It - Smartproxy
411 – Length Required. This status code implies that the server rejected the request because the content length does not meet the requirements....
Read more >
Proxy Error Meaning - http Status Codes - Bright Data
A 407 error code refers to a tunnel connection failing or proxy authentication being required. When using a proxy, this means the credentials...
Read more >
Proxy Server Error Response Messages
A large number of 407 request errors from one particular proxy server, while requests through other proxy servers are working correctly, may ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found