phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

docs: Add Phoenix Llamaindex RAG Demo notebook + chunks + questions

Open saikolasani opened this issue 1 year ago • 1 comments

saikolasani avatar Aug 09 '24 17:08 saikolasani

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

nit: can we rename to demo_llama_index just to keep track of demo data creation notebooks?

mikeldking avatar Aug 13 '24 13:08 mikeldking

resolves #4240

cjunkin avatar Aug 14 '24 22:08 cjunkin

Cohesive use case questions fixture: https://console.cloud.google.com/storage/browser/arize-phoenix-assets/demos?pageState=(%22StorageObjectListTable%22:(%22f%22:%22%255B%255D%22))&project=phoenix-202055

RAG demo traces and evals (demo_llama_index_rag_): https://console.cloud.google.com/storage/browser/arize-phoenix-assets/traces?pageState=(%22StorageObjectListTable%22:(%22f%22:%22%255B%255D%22))&project=phoenix-202055

cjunkin avatar Aug 14 '24 23:08 cjunkin

Demo traces available on hosted phoenix

image

cjunkin avatar Aug 16 '24 23:08 cjunkin

However, seems like document relevance eval fixtures have some formatting problems. This isn't an issue with the code, however, and seems to be how the doc relevance eval spans were generated. Seems like rerunning the demo and uploading new fixtures to GCS would fix the issue. Merging PR image

cjunkin avatar Aug 16 '24 23:08 cjunkin