ci: add performance diff test in github CI

[liuq19]

We need add a performance diff test through the bench.py or other tools, and make it in github workflow.

[sswastik02]

Hi @liuq19 ! I noticed this issue has been open for a while without any activity. I'd be interested in working on this. I'd love to contribute and help move this forward.

[liuq19]

Thanks, welcome to try it ~

[sswastik02]

Thank you for providing this opportunity to contribute.

We need add a performance diff test through the bench.py or other tools, and make it in github workflow.

However, it seems that the provided URL for the bench.py file does not lead to a valid GitHub file location. I have found bench.py, Just wanted to confirm if this is the one.

[liuq19]

@sswastik02 yes, the file is bench.py

[sswastik02]

Hey @liuq19 , I tried running the file on my system, it takes a really long time to execute, is there specific flags that i need to pass to it ? Also is the performance diff mainly for the pull requests? as in the performance diff between branches ?

[liuq19]

pls provide more details, maybe capture or some logs. To make me can reproduce that