Donald Szeto comments

Repositories
Issues
Comments

Results 5 comments of


                                            Donald Szeto

Develpg: Implementation of evaluation algorithm

Hi @goliasz , is this still work in progress or ready to merge?

[PIO-193] Async support for predict method and storage access, blocking code wrapped in blocking construct

Thank you @longliveenduro ! Fingers crossed for your update. :)

Improve readability

@testflyjets Thank you for your contribution! Friendly reminder about this PR. ;)

Does this support Advanced Markers?

+1 on this. Bumping up.

context-free grammars example does not work with vLLM integration

I actually run into a similar issue as well when trying to add CFG support to https://github.com/huggingface/text-generation-inference. Same error message with the same code path towards the last 3 function...