starcoder
starcoder copied to clipboard
Question about Improving Code Generation with Promting
It shows on the paper (Section E.3) that we can put prompt prefixes with the <filename>
token.
My Question is, how do we handle this when the prompt we are making is a Fill-in-middle one?
Should the prompt prefix come before the <fim_prefix>
token or after?
Which one is correct, A or B? :
- A.
<filename>
data<fim_prefix>
content<fim_suffix>
content<fim_middle>
- B.
<fim_prefix>
<filename>
data + content<fim_suffix>
content<fim_middle>