question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Question: Customize wget extractor cli arguments

See original GitHub issue

Is there a way to customize the extractor option ( the default ones ), and not an individual from snapshots?

I’m using pihole and I’m running into some issues with wget. It gets stuck when downloading some blocked DNS records. Keeps trying IPv6. I would like to add flag -4 or --inet4-only to force skip those urls, and not keep looping or stuck trying IPv6 that I don’t even have.

PS; I’m using docker-compose.

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:9 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
akhilleusuggocommented, Mar 28, 2022

@pirate I’ve found your own answer by luck looking into another problem. Thank you. I’m closing.

https://github.com/ArchiveBox/ArchiveBox/issues/865

Edit: Does not work with docker-compose, but at the least works on the Archivebox.conf

1reaction
piratecommented, Mar 24, 2022

WGET_ARGS expects a json formatted list, pass it like this: WGET_ARGS="[\"--inet-only\"]". Also it overrides the default args, so if you want any of those you have to add them to the list too.

Read more comments on GitHub >

github_iconTop Results From Across the Web

GNU Wget 1.21.1-dirty Manual
Features of Wget. • Invoking, Wget command-line arguments. • Recursive Download, Downloading interlinked pages. • Following Links ...
Read more >
How to extract the last line from the wget command output?
So my questions are: How can I redirect (with pipe line operator) the wget output to one or more filter-enabled commands such as...
Read more >
Wget Command in Linux with Examples - nixCraft
This page explains how to use the wget command with valuable examples and comprehensive explanations of the most common options to become a...
Read more >
How to Download and Extract Tar Files with One Command
In this article, we will show you how to download tar archives using two well known command line downloaders – wget or cURL...
Read more >
How to redirect output of wget as input to unzip?
I have a .zip -file here that contains files with executable permissions. When I download and pipe into bsdtar , the exec bits...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found