Implement ephemeral store for prompts and responses

[TheRealVish]

Implement ephemeral store to store prompts and response to extract telemetrics to purpose it to identify the quality of responses (including but not limited to)

[mmirman]

I think we need more details but I like the direction this is going!

[lucylililiwang]

Hi, can I please work on this issue? Thank you!

[lucylililiwang]

Maybe we can use reddis? https://github.com/lucylililiwang/LLM-VM/blob/lucylililiwang-EphemeralStore/EphemeralStore.py