Mark Lin issues

Repositories
Issues
Comments

Results 3 issues of


                                            Mark Lin

How to get prediction result with identification information(e.g. ID)?

**Describe the question(问题描述)** How to get prediction result with identification information(e.g. ID)? I think it's a very common scenario we want to know each prediction belongs to whom(e.g user id)....

question

[BUG]: Failed to train the OPT-13b model due to OOM

### 🐛 Describe the bug I am running the example in "examples/tutorial/opt/opt/run_clm.sh" to train a OPT-13b model. But it failed due to OOM. Could you give a report about how...

bug

The size of output model is very large when exporting to ONNX format.

I am exporting Embedder to ONNX format. But the size of output model is so large(~7G) that I doubt there are many duplications of weights. How to export Embedder correctly?...