azure-search-openai-demo icon indicating copy to clipboard operation
azure-search-openai-demo copied to clipboard

How to upload our own content and start query against our docs

Open lotuskannan2007 opened this issue 2 years ago • 8 comments
trafficstars

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

Any log messages given by the failure

Expected/desired behavior

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

Versions

Mention any other details that might be useful


Thanks! We'll be in touch soon.

lotuskannan2007 avatar Mar 22 '23 13:03 lotuskannan2007

you can put your documents in the .\data folder and launch again the .\prepdocs.ps1 script which process all the new documents, chunks and index them and upload to the blob storage.

macalb69 avatar Mar 23 '23 07:03 macalb69

i found out that the blob can be update after changing to my own doc and run .\prepdocs.ps1 script but the search index remain the same, so when i ask question they will continue show demo doc

sissimonster avatar Mar 23 '23 08:03 sissimonster

I had the exact same issue. I was able to get around it by starting fresh: delete my local directory and all of my cloud deployments.

Steps to take after you've deleted everything:

  1. Run azd init to download the current repo to my local directory.
  2. go into the ./data directory, delete all of the existing docs, and copy your own.
  3. run azd up to continue with the fresh deployment.

This will rebuild your search index with your new content and deploy the new index along with all of the other components.

Later, you can then modify the landing page UX to include your custom new example queries under .\app\frontend\src\pages

george-moore avatar Mar 23 '23 21:03 george-moore

This PR: https://github.com/Azure-Samples/azure-search-openai-demo/pull/35 would allow to add files directly from the web. You can also try it out.

vhvb1989 avatar Mar 24 '23 18:03 vhvb1989

This PR: #35 would allow to add files directly from the web. You can also try it out.

Thanks! have you pull #35 into any branch?

sissimonster avatar Mar 26 '23 12:03 sissimonster

while adding a new pdf, running prepdocs.ps1 works for me . How about removing some pdfs? Not only from the blob storage but also from the index etc. Any idea?

EDIT: ok there is a --remove argument. It works.

dev-pawel avatar Jun 15 '23 20:06 dev-pawel

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this issue will be closed.

github-actions[bot] avatar Jan 03 '24 01:01 github-actions[bot]

We've documented the data ingestion process here: https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/docs/data_ingestion.md

I'll leave this issue open as a request to upload documents from the UI, though I'm not sure that was the original question.

pamelafox avatar Feb 12 '24 20:02 pamelafox

Closing this issue. If you're interested in user document upload, follow: https://github.com/Azure-Samples/azure-search-openai-demo/issues/1393

pamelafox avatar Mar 08 '24 18:03 pamelafox