Add Arize OSS Phoenix integration
Self Checks
- [X] I have searched for existing issues search for existing issues, including closed ones.
- [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
- [X] Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell me about your story.
There's a good set of llm observability platforms out there right now. Dify currently integrates with Langfuse and Langsmith. This issue is to propose adding integration with Arize OSS Phoenix to give Dify users another option. Note: I work with the Phoenix team.
This has also been requested by the community in an issue on the Phoenix repo: https://github.com/Arize-ai/phoenix/issues/5299 (also mentioned by the same user in the dify repo: https://github.com/langgenius/dify/issues/10434).
Happy to take this one on myself :)
2. Additional context or comments
No response
3. Can you help us with this feature?
- [X] I am interested in contributing to this feature.
Just following up this, I'm not sure if there's a specific person I should ping, but I'm happy to start working on this if someone wants to assign it to me. Thanks!
Hello if you would like to add integration to our repo, I figure you could take a look at this https://github.com/langgenius/dify/pull/11501 as well.
@nate-mar
Hi, @nate-mar. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.
Issue Summary:
- You suggested adding an integration with Arize OSS Phoenix to the Dify platform.
- You expressed willingness to contribute to this development.
- Crazywoola provided guidance by directing you to a related pull request.
Next Steps:
- Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
- If there is no further activity, this issue will be automatically closed in 15 days.
Thank you for your understanding and contribution!
I'll be working on this starting next week
@takatost, the user @nate-mar has indicated they will be working on the integration with Arize OSS Phoenix starting next week. Could you please assist them with this issue?
@nate-mar Hey please use this doc https://docs.dify.ai/plugins/introduction to start building :)
Gotcha! Thanks for the pointer @crazywoola -- I'll take a look at that, but just for my own reference, is this going to be different than the approach taken for the existing observability platforms? I'm currently in progress on implementing Phoenix in a similar way.
Thanks!
hey @nate-mar , I think Arize should be integrated in a similar way to other platforms. https://github.com/langgenius/dify/pull/11501 should indeed be the reference point.
Hi, @nate-mar. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.
Issue Summary:
- You proposed integrating Arize OSS Phoenix with Dify for LLM observability.
- Currently, Dify supports Langfuse and Langsmith for observability.
- Crazywoola and guchenhe suggested referring to a related pull request and documentation for plugin development.
- You confirmed your commitment to start working on the integration and are seeking clarification on the approach.
Next Steps:
- Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here.
- If no updates are provided, the issue will be automatically closed in 15 days.
Thank you for your understanding and contribution!