ianvs icon indicating copy to clipboard operation
ianvs copied to clipboard
verified publisher icon kubeedge

add a proposal of Smart Coding benchmark suite

Open safe-b opened this issue 1 year ago • 4 comments

Smart Coding benchmark suite: built on KubeEdge-lanvs

What type of PR is this? /kind test /kind design

What this PR does / why we need it: The PR is a proposal to enhance a dataset by annotating the core code of the classic Python project, and then add project problems and App projects, etc., to finally complete the creation of the dataset and conduct test evaluation. Which issue(s) this PR fixes: #98 Fixes #

safe-b avatar Jul 17 '24 14:07 safe-b

The PR should further elaborate on how to implement this feature in Ianvs.

hsj576 avatar Jul 18 '24 10:07 hsj576

The logic of the subject is basically consistent with Meng Zhuo's government affairs model. The comment data set of the code model is basically the same as that of the government model. The difference lies in the content of the issue data set. One question may have multiple answers. The next step is training and testing.

safe-b avatar Sep 11 '24 15:09 safe-b

/lgtm

MooreZheng avatar Sep 20 '24 14:09 MooreZheng

/lgtm

MooreZheng avatar Oct 31 '24 08:10 MooreZheng

/approve

MooreZheng avatar Oct 31 '24 08:10 MooreZheng

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hsj576, MooreZheng

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

kubeedge-bot avatar Oct 31 '24 08:10 kubeedge-bot