noiji issues

Repositories
Issues
Comments

Results 2 issues of


                                            noiji

Support MistralV2 Format

# What does this PR do? Supports MistralV2 format, which adds the system prompt prior to the last user message. https://github.com/mistralai/mistral-common/blob/main/src/mistral_common/tokens/tokenizers/sentencepiece.py#L282 ## Before submitting - [x] Did you read the...

pending

[LLMLingua2] Fix wrong key storage during filtering

# What does this PR do? This PR modifies the code to store retrieval in `res_pt` instead of `kept`, addressing potential issues that could arise during data verification. This change...