suckit icon indicating copy to clipboard operation
suckit copied to clipboard

os error 22 thread '<unnamed>' panicked when i attempt a crawl

Open The-Stellaris-Effect opened this issue 4 years ago • 4 comments

seemed to work for a while but then was suddenly hit with this error. -c switch doesn't seem to help [ERROR] Couldn't create /run/media/path/to/website/"f.txt": Invalid argument (os error 22) thread '' panicked at 'Couldn't create /run/media/path/to/website/"f.txt": Invalid argument (os error 22)', src/logger.rs:42:9 note: run with RUST_BACKTRACE=1 environment variable to display a backtrace thread 'main' panicked at 'called Result::unwrap() on an Err value: Any', src/scraper.rs:208:10

The-Stellaris-Effect avatar Dec 20 '20 19:12 The-Stellaris-Effect

@The-Stellaris-Effect which website was it that you tried to download?

CohenArthur avatar Dec 20 '20 19:12 CohenArthur

Also it would be nice to have the exact details on the error. This error means that the OS couldn't create a file, because the path input is not valid. Is the file you're trying to download really named "f.txt"?

CohenArthur avatar Dec 21 '20 08:12 CohenArthur

I was attempting to crawl a site known as phys.org, it's a scientific news site essentially. also yes the file was actually called "f.txt" according to the error idk what exactly the issue was however i'm either suspecting it's an env difference of the server and my device where "" is allowed server side but not client side. or it was because i was adding to a directory a program previously wrote to it. i have been transitioning away from httrack due to issues regarding crashes and just general instability

The-Stellaris-Effect avatar Dec 30 '20 04:12 The-Stellaris-Effect

Ok. Could you provide how you invoked SuckIT? If possible, tune the URL in order for us to get the error the fastest way possible.

I have been transitioning away from httrack due to issues regarding crashes and just general instability.

Suckit might not be the way to go as of now, a lot of website configurations are not handled yet and you might crash often

Skallwar avatar Dec 30 '20 09:12 Skallwar