promptflow icon indicating copy to clipboard operation
promptflow copied to clipboard

[Feature Request]Export the eval result.

Open random-yang opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? Please describe. Export the Output as json or some format like that.

Additional context Group 1

random-yang avatar May 22 '24 02:05 random-yang

Hi @random-yang, Can you please elaborate on your ask here? Do you want to export the outputs of any flow run or just evaluation run(your title says eval result)? Is the provided picutre the outputs of your flow? Can you tell us why you need this feature to help us better underdstanding your scenario?

0mza987 avatar May 22 '24 07:05 0mza987

Hi @random-yang, Can you please elaborate on your ask here? Do you want to export the outputs of any flow run or just evaluation run(your title says eval result)? Is the provided picutre the outputs of your flow? Can you tell us why you need this feature to help us better underdstanding your scenario?

For example, I want to export the table data to a local file with format json, csv... For a further process. What should I do or do you have a better advice? image

random-yang avatar May 29 '24 05:05 random-yang

Hi @random-yang, Can you please elaborate on your ask here? Do you want to export the outputs of any flow run or just evaluation run(your title says eval result)? Is the provided picutre the outputs of your flow? Can you tell us why you need this feature to help us better underdstanding your scenario?

For example, I want to export the table data to a local file with format json, csv... For a further process. What should I do or do you have a better advice? image

@random-yang sorry for the delayed response first.

Regarding to the data in your screenshot, currently our UI page does not support an export button to support dump to a file; we might add, but I cannot promise - we can use this issue to track. But there should be a workaround for this.

This UI page is rendered via some API calls, so you can manually call the API to get these data in memory, and dump to your expected format. The API is /v1.0/LineRuns/list, and you shall find more details (such as parameters) from these lines.

NOTE that this is only a workaround as I cannot promise we will not make any change in either API signature or response in the future, please leverage this API carefully; and I believe the better solution is the UI page supports export with a button, which needs some discussions, and time to implementation.

Feel free to give it a try, and let me know if this works for your scenario, thank you!

zhengfeiwang avatar Jun 20 '24 07:06 zhengfeiwang

Hi @random-yang, Can you please elaborate on your ask here? Do you want to export the outputs of any flow run or just evaluation run(your title says eval result)? Is the provided picutre the outputs of your flow? Can you tell us why you need this feature to help us better underdstanding your scenario?

For example, I want to export the table data to a local file with format json, csv... For a further process. What should I do or do you have a better advice? image

@random-yang sorry for the delayed response first.

Regarding to the data in your screenshot, currently our UI page does not support an export button to support dump to a file; we might add, but I cannot promise - we can use this issue to track. But there should be a workaround for this.

This UI page is rendered via some API calls, so you can manually call the API to get these data in memory, and dump to your expected format. The API is /v1.0/LineRuns/list, and you shall find more details (such as parameters) from these lines.

NOTE that this is only a workaround as I cannot promise we will not make any change in either API signature or response in the future, please leverage this API carefully; and I believe the better solution is the UI page supports export with a button, which needs some discussions, and time to implementation.

Feel free to give it a try, and let me know if this works for your scenario, thank you!

Sounds like it will solve my problem, I'll try it.

random-yang avatar Jun 20 '24 08:06 random-yang