Dipika Sikka

Discrepancy between discover_api.json and content.py in routes

3

The file `discover_api.json` contains three possible actions: create, update, and get. Is there an example of how the update API call can be made for a client or sample data?...

# Summary - Update our docs to be reflective of some of the defaults which have been updated for text generation - Not a requirement for 1.7 but for completeness,...

Question - should this script include some sort of metric generation for zeroshot classification on some dataset? Right now, the script just takes in local samples ## Summary - Validation...

Padding text inputs to `TextTransformation` results in incorrect captions

4

Hello, I am trying to run the caption generation workflow and was wondering what I have to do if the inputs to the TextTransformer model are always padded to a...

# Summary - Add a workflow which based on the conditions, will create a nightly, dev or release container - So far, the workflows rely on a cuda-based Python 3.8...

# Summary - Add a workflow which based on the conditions, will create a nightly, dev or release wheel - The workflows make use of the actions in `nm-actions` and...

# Summary - Update obcq tests into separate integration tests - Add/Update `test_sparsities --> test_obcq_sparsity.py`; now tests LLama-7b using gpu and "auto" using the same sparsity recipe as TInyStories -...

# Summary - Initial implementation for Compressed Config support + Activation Quantization for static per tensor w8a8 - Includes fused kernels added by @varun-sundar-rabindranath # Testing/Sample Script: ```python from vllm...