svalbard icon indicating copy to clipboard operation
svalbard copied to clipboard

Published 20 hours ago • verified publisher icon dat-ecosystem-archive

FTP metadata crawler

Open max-mapper opened this issue 8 years ago • 0 comments

Work in progress by @clkao https://gist.github.com/clkao/cd5975e4a136269f092bb001b95627cd

Goal is to be able to continuously monitor an FTP server and produce URL lists with its contents (file names, urls, file sizes, mime types if it's available from the .listings metadata)

max-mapper avatar Feb 15 '17 23:02 max-mapper