Eric Buehler

Add opentelemetry support

7

Refs #1471. @sempervictus what metrics would you like to see? The following is currently logged: 1) Forward Operation (target: paged_attention): - operation: "forward" - query_shape, key_shape, value_shape - batch_size -...

Refactor model examples

2

## Summary - consolidate vision and text examples - use CLI args for choosing model IDs - remove redundant per-model demo folders - update documentation links ## Testing - `cargo...

Improved prefix caching for paged attention

3

## Summary - fix `LogicalTokenBlock::pop_token` so block size stays constant - re-enable paged prefix caching now that it works ## Testing - `cargo test -p mistralrs-core --no-run` *(fails: extern location...