GenAIExamples
GenAIExamples copied to clipboard
UI Enhancement needed
I brought up ChatQnA UI with all the containers.
Issue 1. Huggingface download update
Huggingface TGI container was downloading model, it took so much time around ~12min for Intel/Neural chat model. Meanwhile, I was entering text in chatbox and nothing was happening. (Is there a way to show that model is being download?)
Issue 2: Document upload and parcing
I uploaded a document (there was no button for submit), I assumed it got submitted. Then I started asking questions related to doc but model responded with no context provided. Then I checked dataprep logs and it was still starting inside container. (How to know this without looking at logs?)
Once the start completed, dataprep showed this log
Parsing document ./uploaded_files/myfile.pdf.
Using CPU. Note: This module is much faster with a GPU.
Done preprocessing. Created 13 chunks of the original pdf (0 + 1) / 1]
Even parsing took so much time on CPU. (Display a progress bar or something so that user knows that their documents are still being procesed).