urlhunter
urlhunter copied to clipboard
Using a multiline keywords file breaks the output
When keywords.txt has a single word as its content:
code
C:\Users\REDACTED\Desktop>main.exe -k C:\Users\REDACTED\Documents\GitHub\urlhunter\keywords.txt -d 2022-01-01:2022-01-04 -o test.txt -a C:\Users\REDACTED\Documents\GitHub\urlhunter\archives
o Utku Sen's
\_/\o
( Oo) \|/
(_=-) .===O- ~~U~R~L~~ -O-
/ \_/U' hunter /|\
|| |_/
\\ | utkusen.com
{K || twitter.com/utkusen
Search starting for: 2022-01-01
[+]: Couldn't find an archive with that date.
Search starting for: 2022-01-02
[+]: urlteam_2022-01-02-11-17-02 already exists locally. Skipping download..
[+]: Searching: "code" in C:\Users\REDACTED\Documents\GitHub\urlhunter\archives\urlteam_2022-01-02-11-17-02\goo-gl\______.txt
^C
When keywords.txt has multiple lines as its content:
code
auth
token
C:\Users\REDACTED\Desktop>main.exe -k C:\Users\REDACTED\Documents\GitHub\urlhunter\keywords.txt -d 2022-01-01:2022-01-04 -o test.txt -a C:\Users\REDACTED\Documents\GitHub\urlhunter\archives
o Utku Sen's
\_/\o
( Oo) \|/
(_=-) .===O- ~~U~R~L~~ -O-
/ \_/U' hunter /|\
|| |_/
\\ | utkusen.com
{K || twitter.com/utkusen
Search starting for: 2022-01-01
[+]: Couldn't find an archive with that date.
Search starting for: 2022-01-02
[+]: urlteam_2022-01-02-11-17-02 already exists locally. Skipping download..
" in C:\Users\REDACTED\Documents\GitHub\urlhunter\archives\urlteam_2022-01-02-11-17-02\goo-gl\______.txt
^C
you need to change the newline char from CRLF to LF (that is to say windows format to linux format), so many tools could achieve this, such as VSCode, or linux command dos2unix <filepath>