Yuxiang Wei

icon indicating a website link https://yuxiang.cs.illinois.edu icon indicating an email [email protected]

icon company University of Illinois at Urbana-Champaign icon location Champaign, IL icon location PhD student @illinois. Code LLM training.

Results 14 comments of Yuxiang Wei

A scaling law of instruction-code-data would be very interesting...

Yeah we are doing some relevant follow-ups. Stay tuned for future updates:)

Text-gen prompt template?

Thanks for asking. I'm not very familiar with ooba. Would you mind providing more context?

Text-gen prompt template?

Here is the normal text-generation prompt for Magicoder: ``` MAGICODER_PROMPT = """You are an exceptionally intelligent coding assistant that consistently delivers accurate and reliable responses to user instructions. @@ Instruction...

Meta data `file_name` in the GitHub part of The Pile a bit off

I have the same issue after inspecting the data downloaded from http://eaidata.bmk.sh/data/github_small.jsonl.zst. It seems the value of the 'file_name' key is identical for every repo.