azure-search-openai-demo icon indicating copy to clipboard operation
azure-search-openai-demo copied to clipboard

[Feature Request] - [Data Ingestion] - Need a managed solution for file uploads either through UI or custom solution

Open pelonchasva opened this issue 7 months ago • 3 comments

This issue is for a: (mark with an x)

  • [ ] bug report -> please search issues before submitting
  • [X] feature request
  • [ ] documentation issue or request
  • [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

OS and Version

Windows 10 Pro 22H2 19045.5608

Azd Version

azd version 1.12.0 (commit dc37b930ef8b80340a510c09a6e657ef5bda4f55)

Mention other details that might be useful

Hi @pamelafox,

I'm working on a custom solution using this project and so far everything is good, but now I'm facing a possible blocker. I have enabled the user file upload feature, so that users can upload their own files, but the problem is that those files are only available for the user that uploaded them.

I know that if I want to add files to be available for everyone, I must do so running the manageacl.py script and not specify any OID to it, but the thing is that I do that manually from my local computer, I'm looking for a managed solution either through the app UI or using a custom solution.

I found this other issue (#2215) where you mention that some developers use Azure Functions with a Blob Storage trigger to run the prepdocs.py script to process the files. Is that available in another branch so I can take a look at it? or can you point me where to find such details as I would like to explore that option as well.

In my mind, it would be great to have some sort of Admin page in the app where only certain users with a specific role can access it and then manage the files for these scenarios:

  • GLOBAL: Files that are uploaded for everyone who has access to the app
  • GROUP: Files that are uploaded for a specific azure group, of course this implies adding logic to retrieve the list of groups that are associated with the app and then the administrator will select the group from a dropdown and then upload the files
  • USERS: Files that are uploaded for specific users

I appreciate your time and will be happy to hear from you.

Thank you!

pelonchasva avatar Mar 26 '25 22:03 pelonchasva

Admin function to upload files with ACL is a great idea. We also need to add enhancement to save user setting preferences. Currently the settings are back to default for each session.

Cortex1-NeuroIQ-AI avatar Apr 09 '25 10:04 Cortex1-NeuroIQ-AI

I have managed to develop a first working (maybe not most optimal) implement the ability for the user to upload documents only for himself or for a group he is a member of. I have done this through ensuring that the create groups are added to the app settings variables so the app can see which groups are of interest. Then I added a frontend feature which enables the user to see which groups he is a member of which are related to this app (not other groups in azure) and when the user wants to upload he can select a group if i wanted to upload for everyone in the group then I will add that group id in the acls in the ingestion.

moelk-atea avatar Apr 29 '25 22:04 moelk-atea

@moelk-atea Sounds good- but rather telling - show the code 😆

cforce avatar Apr 29 '25 23:04 cforce