question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Before creating an issue, first upgrade cfscrape with pip install -U cfscrape and see if you’re still experiencing the problem. Please also confirm your Node version (node --version or nodejs --version) is version 10 or higher.

Make sure the website you’re having issues with is actually using anti-bot protection by Cloudflare and not a competitor like Imperva Incapsula or Sucuri. And if you’re using an anonymizing proxy, a VPN, or Tor, Cloudflare often flags those IPs and may block you or present you with a captcha as a result.

Please confirm the following statements and check the boxes before creating an issue:

  • [ ✓] I’ve upgraded cfscrape with pip install -U cfscrape
  • [ ✓] I’m using Node version 10 or higher
  • [ ✓] The site protection I’m having issues with is from Cloudflare
  • [ ✓] I’m not using Tor, a VPN, or an anonymizing proxy

Python version number

Run python --version and paste the output below:

Python 3.6.8

cfscrape version number

Run pip show cfscrape and paste the output below:

Name: cfscrape
Version: 2.1.1
Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information.
Home-page: https://github.com/Anorov/cloudflare-scrape
Author: Anorov
Author-email: anorov.vorona@gmail.com
License: UNKNOWN
Location: c:\users\long\appdata\local\programs\python\python36\lib\site-packages
Requires: requests
Required-by:

Code snippet involved with the issue

import cfscrape

scraper = cfscrape.CloudflareScraper(delay=5)
url="https://masiro.moe"
res=scraper.get(url)

Complete exception and traceback

(If the problem doesn’t involve an exception being raised, leave this blank)

Traceback (most recent call last):
  File "C:\Users\long\AppData\Local\Programs\Python\Python36\lib\site-packages\cfscrape\__init__.py", line 255, in solve_challenge
    javascript, flags=re.S
AttributeError: 'NoneType' object has no attribute 'groups'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\long\Desktop\tes.py", line 13, in <module>
    res=scraper.get(url)
  File "C:\Users\long\AppData\Local\Programs\Python\Python36\lib\site-packages\requests\sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "C:\Users\long\AppData\Local\Programs\Python\Python36\lib\site-packages\cfscrape\__init__.py", line 129, in request
    resp = self.solve_cf_challenge(resp, **kwargs)
  File "C:\Users\long\AppData\Local\Programs\Python\Python36\lib\site-packages\cfscrape\__init__.py", line 204, in solve_cf_challenge
    answer, delay = self.solve_challenge(body, domain)
  File "C:\Users\long\AppData\Local\Programs\Python\Python36\lib\site-packages\cfscrape\__init__.py", line 292, in solve_challenge
    % BUG_REPORT
ValueError: Unable to identify Cloudflare IUAM Javascript on website. Cloudflare may have changed their technique, or there may be a bug in the script.

Please read https://github.com/Anorov/cloudflare-scrape#updates, then file a bug report at https://github.com/Anorov/cloudflare-scrape/issues."

URL of the Cloudflare-protected page

[https://masiro.moe]

URL of Pastebin/Gist with HTML source of protected page

[LINK GOES HERE]

Issue Analytics

  • State:open
  • Created 3 years ago
  • Comments:17

github_iconTop GitHub Comments

1reaction
lovekrissh143commented, Apr 23, 2020

You are a hero @edarbieto

I have also gone through the HTML of that site with Cloudflare protection and it seemed changed but I never realized this was so small. Well, I’m not that good debugger. I was quite confused about this javascript challenge because it involves lots of things that are hard to understand. But you came here like a godly hand. How could you do that? I mean there could be a number of other things which can cause this problem. How the hell this small space .? regex. Haahahahahahahahhahahaha Really you are phenomenal. 😃

0reactions
fblgitcommented, Jun 3, 2020

useless. this project is always same poor maintain…

pip3 install cloudscraper

import cloudscraper as cfscrape

and that was all…

Read more comments on GitHub >

github_iconTop Results From Across the Web

"An Unexpected Error Occurred" Error Message When You ...
Cause. This issue may occur if there is low memory on the computer. As a result, the computer may lose the network bridge...
Read more >
4 Ways to Fix the "An Unexpected Error Occurred" Error When ...
The most common causes for ""An Unexpected Error Occurred" when opening the Ethernet settings are due to a Windows build update or a...
Read more >
Unexpected error messages - IBM
The unexpected error messages that might be issued during an audit are explained in this topic. MSG 900. ERROR ON ADDVOL OF VOLUME(...
Read more >
Fix an Unexpected Error Has Occurred the Troubleshooting ...
Fix an Unexpected Error Has Occurred the Troubleshooting Wizard Can't Continue.While the very efficient & effective inbuilt Windows ...
Read more >
Is there a general solution to the problem of "sudden ...
Even though it looks scary at first, it's typically just a pretty simple fix, and it's typically really just ONE error, which cascades...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found