dify icon indicating copy to clipboard operation
dify copied to clipboard

Add Arize OSS Phoenix integration

Open nate-mar opened this issue 1 year ago • 9 comments

Self Checks

  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

There's a good set of llm observability platforms out there right now. Dify currently integrates with Langfuse and Langsmith. This issue is to propose adding integration with Arize OSS Phoenix to give Dify users another option. Note: I work with the Phoenix team.

This has also been requested by the community in an issue on the Phoenix repo: https://github.com/Arize-ai/phoenix/issues/5299 (also mentioned by the same user in the dify repo: https://github.com/langgenius/dify/issues/10434).

Happy to take this one on myself :)

2. Additional context or comments

No response

3. Can you help us with this feature?

  • [X] I am interested in contributing to this feature.

nate-mar avatar Dec 26 '24 23:12 nate-mar

Just following up this, I'm not sure if there's a specific person I should ping, but I'm happy to start working on this if someone wants to assign it to me. Thanks!

nate-mar avatar Jan 09 '25 02:01 nate-mar

Hello if you would like to add integration to our repo, I figure you could take a look at this https://github.com/langgenius/dify/pull/11501 as well.

@nate-mar

crazywoola avatar Jan 10 '25 04:01 crazywoola

Hi, @nate-mar. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You suggested adding an integration with Arize OSS Phoenix to the Dify platform.
  • You expressed willingness to contribute to this development.
  • Crazywoola provided guidance by directing you to a related pull request.

Next Steps:

  • Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Feb 10 '25 16:02 dosubot[bot]

I'll be working on this starting next week

nate-mar avatar Feb 11 '25 20:02 nate-mar

@takatost, the user @nate-mar has indicated they will be working on the integration with Arize OSS Phoenix starting next week. Could you please assist them with this issue?

dosubot[bot] avatar Feb 11 '25 20:02 dosubot[bot]

@nate-mar Hey please use this doc https://docs.dify.ai/plugins/introduction to start building :)

crazywoola avatar Mar 05 '25 01:03 crazywoola

Gotcha! Thanks for the pointer @crazywoola -- I'll take a look at that, but just for my own reference, is this going to be different than the approach taken for the existing observability platforms? I'm currently in progress on implementing Phoenix in a similar way.

Thanks!

nate-mar avatar Mar 05 '25 02:03 nate-mar

hey @nate-mar , I think Arize should be integrated in a similar way to other platforms. https://github.com/langgenius/dify/pull/11501 should indeed be the reference point.

guchenhe avatar Mar 27 '25 22:03 guchenhe

Hi, @nate-mar. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You proposed integrating Arize OSS Phoenix with Dify for LLM observability.
  • Currently, Dify supports Langfuse and Langsmith for observability.
  • Crazywoola and guchenhe suggested referring to a related pull request and documentation for plugin development.
  • You confirmed your commitment to start working on the integration and are seeking clarification on the approach.

Next Steps:

  • Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If no updates are provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Apr 27 '25 16:04 dosubot[bot]