MetaGPT icon indicating copy to clipboard operation
MetaGPT copied to clipboard

SoftwareDev dataset

Open yuanhao2023 opened this issue 11 months ago • 4 comments

Hello Developer, May I ask where I can obtain the contents of the SoftwareDev dataset? Or is this dataset a closed-source dataset?

yuanhao2023 avatar Jan 10 '25 03:01 yuanhao2023

Sorry, I don't quite understand what the SoftwareDev dataset is used for. To avoid any misunderstanding, could you please describe it in detail?

iorisa avatar Jan 11 '25 07:01 iorisa

抱歉,我不太明白 this 是做什么用的。为避免任何误解,您能详细描述一下吗?SoftwareDev dataset

Thanks for your reply. According to the MetaGPT paper, the performance comparison between MetaGPT and ChatDev is based on the SoftwareDev dataset. I am currently working on a research project based on MetaGPT and would like to evaluate its performance using the official dataset provided by the MetaGPT team. Table 8 in the paper presents some examples from this dataset.

Could you please clarify if this dataset is publicly available or if there is a way to request access to it?

Thank you for your assistance.

yuanhao2023 avatar Jan 11 '25 08:01 yuanhao2023

The SoftwareDev related to the MetaGPT paper is not open to the public. After the release of MetaGPT 1.0 and MGX, we will open an open-source version similar to SoftwareDev.

iorisa avatar Jan 18 '25 03:01 iorisa

This issue has no activity in the past 30 days. Please comment on the issue if you have anything to add.

github-actions[bot] avatar Feb 18 '25 00:02 github-actions[bot]

This issue was closed due to 45 days of inactivity. If you feel this issue is still relevant, please reopen the issue to continue the discussion.

github-actions[bot] avatar Mar 04 '25 00:03 github-actions[bot]

Where is the software dev dataset?

wangjvjie avatar Nov 13 '25 05:11 wangjvjie