DeepSeek-Coder
DeepSeek-Coder copied to clipboard
deepseek-ai
请问可以发布更多关于数据清洗的细节吗？
We also are closely paying attention to how to preprocessing code dataset, especially how to handle the dependencies among code file
- Step 2: Parsing the dependencies of files within the same repository to rearrange the file positions based on their dependencies.
- Step 3: Concatenating dependent files to form a single example and employ repo-level minhash for deduplication.
期待发布这两部分的更多细节
