Amey Agrawal

We might not be able to reuse the existing stats logger. The Sarathi logging framework has the following properties: 1. It is designed for tracking several different kinds of metrics...

@robertgshaw2-neuralmagic sorry for the delay. We have been mostly using it for offline analysis, but the data structures are designed such that they should be relatively easy to extend them...

@greenify Surely the need for core arises only in certain use cases, certainly most of which would become redundant with developing web components specs as pointed by @emepyc . But...

Sure, I would try to build a basic example of what I want to build.

I have tried do some experimentation thought could not finish them as i wished. Considering the time constraints I should discuss the conclusions. When we have native support for web...

Okay, I would try those. Thanks.

@yzh119 is this PR good to use? This would be extremely useful for some of my work.

@yzh119 looking forward to it! I would be happy to help accelerate this, please let me know if I can help in any way.

Amazing, thanks a lot for the awesome work! 🙏

Hi @yzh119! I have one implementation in sarathi-serve which tries to list different combinations, and capture them. But with increasing batch size and big variance in input sequences, the number...