fscrawler
fscrawler copied to clipboard
Read from any FS Provider using the REST Service
Is your feature request related to a problem? Please describe.
We want to be able to send commands to FSCrawler which could fetch a file from any provider like the local FS where FSCrawler is running or S3...
Describe the solution you'd like
curl -XPOST http://127.0.0.1:8080/fscrawler/_upload -d '{
"type": "fs",
"fs": {
"url": "file://foo/bar.txt"
}
}
curl -XPOST http://127.0.0.1:8080/fscrawler/_upload -d '{
"type": "s3",
"s3": {
"url": "s3://foo/bar.txt"
}
}
This could also solve may be #805