Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
How to package scrapy program
See original GitHub issueI used scrapy to write a spider,now I want to run in server,so I use pyinstaller to package it.I add a setup.py
from scrapy import cmdline
cmdline.execute("scrapy crawl Spiderl".split())
use
pyinstaller -F setup.py
succeed get a exe,but run it get a error “Unknown command: crawl”. the document said “crawl must run in the root of project directory”. So how can I package a scrapy-program with out copy the source code of project to server
Issue Analytics
- State:
- Created 8 years ago
- Comments:15 (6 by maintainers)
Top Results From Across the Web
Scrapy Tutorial — Scrapy 2.7.1 documentation
Scrapy schedules the scrapy.Request objects returned by the start_requests method of the Spider. Upon receiving a response ...
Read more >Python Tutorial: Web Scraping with Scrapy (8 Code Examples)
In this Python tutorial, we'll go over web scraping using Scrapy — and we'll work through a sample e-commerce website scraping project.
Read more >Web Scraping in Python using Scrapy (with multiple examples)
Scrapy supports both versions of Python 2 and 3. If you're using Anaconda, you can install the package from the conda-forge channel, which...
Read more >How To Crawl A Web Page with Scrapy and Python 3
Scrapy, like most Python packages, is on PyPI (also known as pip ). PyPI, the Python Package Index, is a community-owned repository of...
Read more >Implementing Web Scraping in Python with Scrapy
Step 1 : Creating virtual environment · Step 2 : Installing Scrapy module · Step 3 : Creating Scrapy project · Step 4...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
I made it! PyInstaller packages scrapy spider on Windows7 successfully.
Fixed. https://stackoverflow.com/questions/55331478/how-to-create-a-single-executable-file-in-windows-10-with-scrapy-and-pyinstaller/55410079#55410079