Yong Huang

Results 2 comments of Yong Huang

Great to see this. For current C# API, can you expose LLModelPromptContext in GetPredictionAsync and other methods? LLModelPromptContext.PastNum is an important variable that will be modified inside C++, and it's...

Thanks @mvenditto. Using GetPredictionStreamingAsync allows me to handle more low level things that Chat style API, so I need to access LLModelPromptContext there. In my local branch I simply change...