George

Got comment to move the folder structure from git-server to general pathway

> Could this be made to be more in-line with the already existing validation check, or perhaps, just use that check instead? See https://github.com/neuralmagic/deepsparse/blob/main/src/deepsparse/engine.py#L108 > > Separately, while not a...

Can you include simple test or a starter code and have an example of how to access the timings please! I think if you can set max_tokens arg in vLLM...