Sheena Wang comments

Repositories
Issues
Comments

Results 3 comments of


                                            Sheena Wang

Setting tensor name in python bls

Hi, Has this issue been resolved?

Exception has occurred: TypeError object of type 'NoneType' has no len() in learner_cls.py when do Model inference

Hi @ruianlc I encountered the same problem after I upgraded the fast-bert package. It may be caused by upgrading this package, but I am not sure how I should change...

High Queue Latency With BLS

Hi @MatthieuToulemont Thanks for your reply. Your explanation makes sense. Has Triton considered optimizing BLS to achieve similar performance to ensemble? In fact, we have 3 steps A, B, and...