io
io copied to clipboard
Support Hadoop Compatible Filesystem interface using config instead of hard-code
Why
In our internal env, we develop a new filesystem implementing HCFS. To serve for users better, we hope users could use tf dataset api to read new filesystem storage like before. So it's necessary to support HCFS in tensorflow io.
@yongtang @burgerkingeater @oliverhu Any ideas on it? If this issue is OK, i can finish it.
@zuston I think this can be very helpful to the community. Contributions are welcomed 👍
We are having similar issues to support federated clusters with a different schema! Sounds great, please create a mini design before you start?
@oliverhu Got it. Maybe PR will be submitted later after mini design attached here.