graphrag icon indicating copy to clipboard operation
graphrag copied to clipboard

IO error in lancedb write operation

Open pratham16cse opened this issue 1 year ago • 4 comments

Facing an IOError in the lancedb write operation in the store_entity_semantic_embeddings call during local search (https://github.com/microsoft/graphrag/blob/main/examples_notebooks/local_search.ipynb).

I was able to reproduce the error with following code:

import lancedb
import pandas as pd
import pyarrow as pa

uri = "data/sample-lancedb"
db = lancedb.connect(uri)
data = [
    {"vector": [3.1, 4.1], "item": "foo", "price": 10.0},
    {"vector": [5.9, 26.5], "item": "bar", "price": 20.0},
]
tbl = db.create_table("my_table", data=data)

Is there any standard way to fix this that I might have missed? Any authentication I need to do with lancedb?

pratham16cse avatar Jun 25 '24 09:06 pratham16cse

Hello, I'm from LanceDB team. What error are you seeing?

AyushExel avatar Jul 02 '24 20:07 AyushExel

Thanks @AyushExel. Attaching the screenshot of the error with the above code.

image

pratham16cse avatar Jul 03 '24 06:07 pratham16cse

the error seems to be related to write permission in the folder. Can you double check that

AyushExel avatar Jul 03 '24 18:07 AyushExel

Yes, the error is due to write permission. However, I am getting the same error in other machine as well. I am using Azure VM. Any configuration or settings that I might have missed?

pratham16cse avatar Jul 04 '24 05:07 pratham16cse

In Azure VM, lancedb does not have write permission in the directory /home/<username>/cloudfiles, hence the error. By changing the write path to /home/<username>/localfiles, the issue is resolved. Similar issue here.

Closing the issue for now, will reopen if needed. Thanks.

pratham16cse avatar Jul 07 '24 09:07 pratham16cse

@pratham16cse How can I change the write path from /home//cloudfiles to /home//localfiles in Azure ML Studio?

georgeliang0821 avatar Aug 14 '24 03:08 georgeliang0821