Bijay Regmi
Results
1
comments of
Bijay Regmi
i had same issue and figured it only generates when `num_predict` is set (i set it to 128). Some way like following ``` { "model": "your llama3 tag name", "messages":...
Bijay Regmi
i had same issue and figured it only generates when `num_predict` is set (i set it to 128). Some way like following ``` { "model": "your llama3 tag name", "messages":...