Carlos Echevarria comments

Repositories
Issues
Comments

Results 2 comments of


                                            Carlos Echevarria

[PlayGround] Long generating cannot be done

> For now, there is a hard limitation of 2048 input tokens and a maximum of 1920 output tokens. We might consider increasing these numbers in the future. Is there...

[PlayGround] Long generating cannot be done

> Hey - could you elaborate a bit? static context length is kind of a intrinsic thing to transformer based LLMs. Sorry. Dependent on the models, the context can be...