executorch icon indicating copy to clipboard operation
executorch copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

allow models to use customized token ids during export

Open helunwencser opened this issue 6 months ago • 4 comments

LLama3.1's bos and eos are different from what is hardcoded in the code. This PR updates the export flow to allow read customized token ids instead of hardcoded ones.

It also deletes a few metadata entries that are not used by the runner.

Test Plan: verified llama3 still can be exported and run

helunwencser avatar Aug 09 '24 20:08 helunwencser