Question: Customize wget extractor cli arguments
See original GitHub issueIs there a way to customize the extractor option ( the default ones ), and not an individual from snapshots?
I’m using pihole and I’m running into some issues with wget
. It gets stuck when downloading some blocked DNS records. Keeps trying IPv6. I would like to add flag -4
or --inet4-only
to force skip those urls, and not keep looping or stuck trying IPv6 that I don’t even have.
PS; I’m using docker-compose.
Issue Analytics
- State:
- Created a year ago
- Comments:9 (9 by maintainers)
Top Results From Across the Web
GNU Wget 1.21.1-dirty Manual
Features of Wget. • Invoking, Wget command-line arguments. • Recursive Download, Downloading interlinked pages. • Following Links ...
Read more >How to extract the last line from the wget command output?
So my questions are: How can I redirect (with pipe line operator) the wget output to one or more filter-enabled commands such as...
Read more >Wget Command in Linux with Examples - nixCraft
This page explains how to use the wget command with valuable examples and comprehensive explanations of the most common options to become a...
Read more >How to Download and Extract Tar Files with One Command
In this article, we will show you how to download tar archives using two well known command line downloaders – wget or cURL...
Read more >How to redirect output of wget as input to unzip?
I have a .zip -file here that contains files with executable permissions. When I download and pipe into bsdtar , the exec bits...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@pirate I’ve found your own answer by luck looking into another problem. Thank you. I’m closing.
https://github.com/ArchiveBox/ArchiveBox/issues/865
Edit: Does not work with docker-compose, but at the least works on the Archivebox.conf
WGET_ARGS expects a json formatted list, pass it like this:
WGET_ARGS="[\"--inet-only\"]"
. Also it overrides the default args, so if you want any of those you have to add them to the list too.