zengxy20 issues

Repositories
Issues
Comments

Results 1 issues of


                                            zengxy20

Garbled characters decoding on Mistral-7b-v0.1-instruct

I have followed the sharing setting in https://github.com/SafeAILab/EAGLE/issues/79 to change the cache into your customized kv_cache (MistralAttention, MistralDecoderLayer, MistralModel, MistralForCausalLM, MistralForSequenceClassification) and not used the tree_mask after causal_mask. But the...