AnyangAngus comments

Repositories
Issues
Comments

Results 4 comments of


                                            AnyangAngus

trafficstars

[Enhancement]: Loading speed optmization in the serverless mode

meet same issue about loadding connection very slow. Did you slove this problem?

[Enhancement]: Loading speed optmization in the serverless mode

> > meet same issue about loadding connection very slow. Did you slove this problem? > > what problem are you facing? I don't think you are facing similar issue...

[Enhancement]: Loading speed optmization in the serverless mode

> > > > meet same issue about loadding connection very slow. Did you slove this problem? > > > > > > > > > what problem are you...

[Doc] Add `projects` section in README which is developed based on FasterTransformer

@lvhan028 Cool！ I see TurboMind can support llama-2-70b with GQA now. I would like to ask if there will be any support plans for LMDeploy to support Llama-2-7b and Llama-2-13b...