wget2

wget2 copied to clipboard

Hello I saw there are 10 error codes in wget2 could one be added for a timeout? eg if this --timeout=3 occurs https://manpages.debian.org/testing/wget2/wget2.1.en.html

coinhubs

Most added files don't get downloaded

1

I try to crawl a website with wget2 v2.1.0. According to the log, lots of files get "Added", but only for a small percentage of them a "Downloading" thread starts....

page200

Wishlist/Enhancement - Add support for new option to only update existing file if etag has changed

4

This could help when an file's content has not changed but the timestamp has since changed and as such it downloads a existing file unnecessarily but how could this be...

nutterthanos

Wrong links generated with -k option

4

Original page http://localhost:7000/Empresa/EmFoco/Noticias/Pages/default.aspx had a link to http://localhost:7000/EMPRESA/TOMENOTA/Pages/default.aspx wget2 for some reason, when adapting links with -k, generated the following link, containing the original page link : http://localhost:7000/EMPRESA/EMFOhttp://ept.telecom.pt/Empresa/EmFoco/Noticias/Pages/CO/TOMENOTA/Pages/default.aspx

brunommarques

wget2 stopped working with proxychains-ng (wget/curl still work)

3

I am trying to understand why wget2 fails to connect when being run through proxychains-ng. Prior versions of wget2 (& current versions of curl & wget) work as expected. Running...

koedx

Can i create a index for readme.md file

2

Durgesh4993

How to build static wget2 binary for Linux?

1

`./wget2: error while loading shared libraries: libwolfssl.so.32: cannot open shared object file: No such file or directory` I've tried the `./configure --enable-static --disable-shared`, `./configure --enable-static --disable-shared CFLAGS="-static -static-libgcc"` and more...

yfdyh000

Eliminate all SOCKET_TO_FD usage in wolfcrypt, more error checking around invalid sockets

1

OK between this and the poll fixes in gnulib I am unable to recreate any deadlocks or faults even with a dozen+ transfers with concurrency. The big thing here is...

mitchcapper

Add config.h/libgnu to all example compiles for gnulib

6

in #280 you mentioned these additions be gated to _WIN32 but I haven't quite done so. Mainly because if you include a gnulib header accidentally you can end up getting...

mitchcapper

Extract embedded URLs from JavaScript files

2

From what I understand, based on the [source code](https://github.com/rockdaboot/wget2/blob/master/src/wget.c#L143-L149), the parser doesn't extract embedded URLs from JavaScript files. Is there any particular reason for not supporting this? Maybe because wget...

goelayu