starcoder
starcoder copied to clipboard
Question about Improving Code Generation with Promting
trafficstars
It shows on the paper (Section E.3) that we can put prompt prefixes with the <filename> token.
My Question is, how do we handle this when the prompt we are making is a Fill-in-middle one?
Should the prompt prefix come before the <fim_prefix> token or after?
Which one is correct, A or B? :
- A.
<filename>data<fim_prefix>content<fim_suffix>content<fim_middle> - B.
<fim_prefix><filename>data + content<fim_suffix>content<fim_middle>