EAGLE
EAGLE copied to clipboard
What's the relationship between total token and depth
Hi, my question is: if I adjusted depth, do I also need to adjust total tokens? If so, what's the formula I should use, is it (depth+1) x topk?
Let me try to answer this. It should be that there is no need to expand the total-tokens, but you need to ensure that the total tokens of the modified depth tree (complete k-ary tree, k is the value of top-k) are greater than the total-tokens you set, such as the original 60.