Hugo Larcher

feat: Add load tests

4

# What does this PR do? This PR adds automated load tests in CI using [Grafana k6](https://k6.io/). Two tests are performed: * **Constant virtual users (VUs) load test**: It simulates...

Nightly load test results

4

This issue collects load test results runs on nightly builds.

doc: Add metrics documentation and add a 'Reference' section

1

# What does this PR do? Adds metrics description in the `/metrics` endpoint and in the documentation. Helps https://github.com/huggingface/text-generation-inference/issues/2227 ## Before submitting - [X] This PR fixes a typo or...

Feat/trtllm cancellation dev container

1

# What does this PR do? Add DevContainer to build TRTLLM backend.

feat: allow TESTCONTAINERS_HOST_OVERRIDE to override docker host

1

This PR adds the option to customize Docker hostname detection with the `TESTCONTAINERS_HOST_OVERRIDE` environment variable. It replicates the behavior of the Java testcontainer package (https://java.testcontainers.org/features/configuration/)