Zengzhi Wang

icon indicating a website link https://sinclaircoder.github.io/

icon location China icon location PhD student. #NLProc A data engineering boy: MathPile (2023), 🫐 ProX (2024)

Results 14 comments of Zengzhi Wang

Memory overhead in multiprocessing

Got it. Typically, I started n of tasks to process data (a pipeline could consist of the WARC reader, URL filter, Text Extractor, and Writer). However, several tasks even more...

Any plan for releasing a docker environment

this image works well: `docker://nvidia/cuda:12.2.0-devel-ubuntu22.04`

Feature: One-Click Testing with a Ready-to-Use Docker Image and a gradio app

This docker image works for me: `docker://nvidia/cuda:12.2.0-devel-ubuntu22.04`

Evaluation with OpenCompass

Any progress on it?