VLMEvalKit icon indicating copy to clipboard operation
VLMEvalKit copied to clipboard

dify support

Open iamsk opened this issue 10 months ago • 2 comments

And, you don't need to implement other llms.

iamsk avatar Apr 19 '24 03:04 iamsk

Hi, @iamsk, Thanks for helping to implement DifyVision API in VLMEvalKit. Some further steps are required to be accomplished before merging:

  1. I cannot find any information about DifyVision on the Internet, a modelcard that introduce the API model is required.
  2. Since we do not own a key of DifyVision, please share us a key (with small amounts of quota) for verification.
  3. The content of the PR should be modified: demo.py should be removed from the PR.
  4. Please follow the development guide (https://github.com/open-compass/VLMEvalKit/blob/main/Development.md) last section to format your code.

kennymckormick avatar Apr 19 '24 09:04 kennymckormick

Hi, @iamsk , Is there any updates? Just a kind reminder.

kennymckormick avatar Apr 27 '24 10:04 kennymckormick

Close the PR since there is no response during a long time.

kennymckormick avatar Aug 22 '24 04:08 kennymckormick