torchchat icon indicating copy to clipboard operation
torchchat copied to clipboard

should have the ability to output debug artifacts when exporting to a .pte file

Open byjlw opened this issue 5 months ago • 0 comments

🚀 The feature, motivation and pitch

should be able to use --generate_etrecord to get the artifacts for debugging like this. python3 torchchat.py export llama3.1 --quantize torchchat/quant_config/mobile.json --output-pte-path llama3.1.pte --generate_etrecord

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

byjlw avatar Sep 03 '24 21:09 byjlw