io icon indicating copy to clipboard operation
io copied to clipboard

azfs not implemented

Open dineshvelmuruga opened this issue 3 years ago • 3 comments

tensorflow_io.version '0.20.0' tensorflow.version
'2.6.0'

Code: import os import tensorflow as tf import tensorflow_io. as tfio

os.environ[ "TF_AZURE_STORAGE_KEY" ] = "<access_key>" account_name = "<account_name"

pathname = "az://{}/".format(account_name)

data_path = pathname + "/data/taxi/data.csv"

with tf.io.gfile.GFile(data_path, mode="r") as r: print(r.read())

Error: tensorflow.python.framework.errors_impl.UnimplementedError: File system scheme 'az' not implemented

Please let me know if I am missing something

dineshvelmuruga avatar Aug 19 '21 16:08 dineshvelmuruga

@dineshvelmuruga Which OS system are you using? Is it on Windows?

yongtang avatar Aug 20 '21 16:08 yongtang

@yongtang yes. its on windows. But when I install tensorflow-io on linux issue resolved. But another issue

I am tryin out the example given in the documentation. But can not read/write to azure blob storage Error: InternalError: Failed to create directory az://<account_name>/test

Please not I am using access keys for TF_AZURE_STORAGE_KEY.

However, code is working with emulator.

It is really painful to fix without the error trace

dineshvelmuruga avatar Aug 23 '21 03:08 dineshvelmuruga

@dineshvelmuruga The Windows issue is caused by https://github.com/tensorflow/tensorflow/issues/49515 , which will be resolved once PR https://github.com/tensorflow/tensorflow/pull/49520 is merged and pull into tfio.

Will take a look at the other error you encounter.

yongtang avatar Aug 23 '21 13:08 yongtang