data-juicer

data-juicer copied to clipboard

Cathy0908

data-juicer 有计划支持流式或微批计算么

8

### Search before continuing 先搜索，再继续 - [x] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 比如：kafka->filter1->filter2->mapper1->files or kafka...

xiedeyantu

Evalscope evaluator & MedEval evaluator for dj-sandbox

3

Add EvalscopeEvaluator and MedEvaluator to EvaluateModelHook in DJ-Sandbox. Implement the following features: - Enable LLM evaluation through [evalscope](https://github.com/modelscope/evalscope) capabilities - One-stop solution to launch MedEval workflow and generate corresponding radar...

lingzhq

[NewOp] Add generate_challenging_qa_mapper based on MindGYM principles

1

​​Introduces a novel QA generation module based on self-challenging mechanisms, designed to autonomously synthesize high-quality reasoning-focused question-answer pairs, inspired by the [MindGYM paper](https://arxiv.org/abs/2503.09499).​​

Bat-Reality

### Before Asking 在提问之前 - [x] I have read the [README](https://github.com/alibaba/data-juicer/blob/main/README.md) carefully. 我已经仔细阅读了 [README](https://github.com/alibaba/data-juicer/blob/main/README_ZH.md) 上的操作指引。 - [x] I have pulled the latest code of main branch to run again and...

JunyuanLi0408

如何实现两个算子的逻辑运算关系

1

### Before Asking 在提问之前 - [x] I have read the [README](https://github.com/alibaba/data-juicer/blob/main/README.md) carefully. 我已经仔细阅读了 [README](https://github.com/alibaba/data-juicer/blob/main/README_ZH.md) 上的操作指引。 - [x] I have pulled the latest code of main branch to run again and...

DietDietDiet

### Search before continuing 先搜索，再继续 - [x] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 In the current...

pan-x-c