question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Handling Cloudflare based sites

See original GitHub issue

It looks like Sherlock is unable to handle Cloudflare based sites?

Ex: Steemit - They use Cloudflare and CF has DDoS protection due to which it automatically does a brower check and sets a cookie which is then used with all subsequent requests.

I think maybe Sherlock should start supporting headers option which would let us set the mandatory HTTP Headers like Cookie or Origin in another case (#256). CF’s cookies are valid for quite a long period of time and they work well if you pass them while making a request.

I tested the aforementioned site with Sherlock to do a simple status code based check and it hits the CF’s roadblock and fails as a result (false positive).

Issue Analytics

  • State:open
  • Created 4 years ago
  • Comments:7 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
darvellcommented, Nov 3, 2020

Old but: https://pypi.org/project/cloudscraper/ could be a good solution.

1reaction
irazasyedcommented, Aug 3, 2019

@TheYahya Sounds good. I can join in that case 😃

I’ll let you know when I’m ready to make the PHP implementation public so you could create a new repo then.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Best Practices: DDoS preventative measures
Learn best practices to secure your Cloudflare-enabled site from DDoS attacks. ... Handle a false negative or an incomplete mitigation.
Read more >
Abuse approach - Cloudflare
Cloudflare offers security and reliability services to millions of websites, helping prevent online abuse and make the Internet more secure.
Read more >
How to keep a website from going down | Cloudflare
When a website is down, SEO optimization and conversion rates can suffer. We outline how to maximize uptime.
Read more >
Cloudflare challenges · Cloudflare Fundamentals docs
Managed challenges are where Cloudflare dynamically chooses the appropriate type of challenge based on the characteristics of a request. This ...
Read more >
Spice up your sites on Cloudflare Pages with Pages Functions ...
As on Cloudflare Workers, we've built a simple way for you to watch your functions as it processes requests – the faster you...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found