Mikyo King

From what I can tell you can pass a template into an LLMEvaluator (https://arize-phoenix.readthedocs.io/en/latest/api/evals.evaluators.html#evals.evaluators.LLMEvaluator) @AparnaDhinakaran Does this not satisfy your use-case? https://github.com/Arize-ai/phoenix/blob/a3ff0f6b1c90f126db1249e877d2369ab9bffe02/packages/phoenix-evals/src/phoenix/evals/evaluators.py#L22

Hi @arthurbrenno sorry you are facing issues. At first glance I'm not 100% sure what's wrong. Could you try using https://github.com/Arize-ai/openinference/tree/main/python/instrumentation/openinference-instrumentation-llama-index directly? The errors seem very odd. Will dig in...

Hey @Blackskyliner we heavily recommend running phoenix as a separate process or container. Best to sandbox things this way as we don't want to be a bottleneck on your application...

we just got image generation tools too.

putting it back on triage.

Hey @Howie-Arup thanks for the report. The double counting is definitely incorrect but I believe from looking at your screenshot above it's due to you having both openAI instrumentation and...

Scheduling for next sprint

removing from phoenix

Hey @daavoo - this makes a ton of sense. Will bring it up with the team this week. cc @caroger @Jgilhuly

@daavoo really appreciated you taking a first stab - it really helped us understand the direction that ADK was going in