Switch all dependencies to pure python and release ArchiveBox pip package

I originally thought moving to Python-only dependencies would be intractable, but after some more research I now realize this is quite straightforward.

• apt install curl -> pip install requests archivenow (requests docs, archivenow docs)
• apt install wget -> pip install wpull pywb (wpull docs, pywb docs)
• apt install git -> pip install GitPython (docs)
• apt install youtube-dl -> pip install youtube-dl (docs)
• apt install chromium-browser -> pip install pyppeteer (docs)

Then we wont need users to install any system dependencies anymore, and we can move to using only requirements.txt and setup.py to install ArchiveBox via pip.

[pirate]

Yeah I looked at wpull recently and came to the same conclusion. Wget2 looks more promising than wpull.

I think I’m going to close this issue for now, as we start to expand the suite of archiving methods it’s looking more and more like many of them will be node-based. Considering we already support pip install archivebox now to get the bulk of archivebox’s functionality, and we offer all the methods out-of-the-box via docker, making everything python-only is no longer a priority.

[007]

Anything you’re fetching with curl should be replaced with wget or vice versa, and that’ll cut down on some dependencies in the pip translation.