visuallayer icon indicating copy to clipboard operation
visuallayer copied to clipboard

[Request] How to access local dataset locally?

Open meet-minimalist opened this issue 2 years ago • 4 comments

Hi, Thanks for amazing work. You have many predefined datasets in your library. My usecase is that I have a dataset which is not listed in your repo. Also, I dont want to upload the dataset to your servers as it is of huge size and also privacy concerns.

Can you show me a way how can I analyze the dataset locally?

meet-minimalist avatar Jun 26 '23 15:06 meet-minimalist

Hello @meet-minimalist thanks for reaching out. We would be happy to get in touch with you to work on a solution. Let's schedule a session so we can understand more? We can be reached at [email protected]

dnth avatar Jun 27 '23 02:06 dnth

Hi, i am in similar situation. is there a solution?

ShSi1001 avatar Sep 27 '23 14:09 ShSi1001

Hello @ShSi1001 you can try out fastdup - https://github.com/visual-layer/fastdup

dnth avatar Sep 28 '23 11:09 dnth

Hi @dnth. Thanks for the reply. I have been working with fastdup.

On windows 10 and python 3.10 version, i am getting the error ERROR: Could not find a version that satisfies the requirement fastdup (from versions: none) ERROR: No matching distribution found for fastdup

On windows 10 python 3.9 version, I am not getting the above error however, the command fd.vis.stats_gallery(metric='dark') is not being implemented properly

ShSi1001 avatar Sep 29 '23 12:09 ShSi1001