tensorzero

tensorzero copied to clipboard

GabrielBianconi

Notebook using TRL for SFT

GabrielBianconi

Add a 'typing resolution wrapper function' to our Python client when we have mixed return types

1

It seems that some type checkers can't infer the return type from functions returning a `Union` because the specialization happens in the Rust layer: ``` @classmethod def build_http( cls, *,...

GabrielBianconi

GabrielBianconi


GabrielBianconi

UI incorrectly assumes that any text content block that parses as a JSON object is `arguments`

1

In the UI, if a text content block parses as a JSON object, we assume it's "arguments". But this is not necessarily true! The user could have simply sent JSON...

GabrielBianconi

After #2577, we'll only have `Input` in the datapoint page. `Input` doesn't support files and other specialized content blocks. We need to get rid of it.

GabrielBianconi

Integrate Nvidia NIM microservices into TensorZero

6

### Discussed in https://github.com/tensorzero/tensorzero/discussions/764 Originally posted by **Gimmyalex** January 15, 2025 Overview: Nvidia NIM provides a robust framework for managing GPU-based microservices. Integrating it with TensorZero will enhance its scalability...

Gimmyalex

Start using exhaustive switch statements in the UI

2

We should start being more careful about exhaustiveness in switch statements. For example, `ui/app/components/inference/Input.tsx` doesn't handle `raw_text` (see #2587). This pattern makes the compiler complain about exhaustiveness (rather than the...

GabrielBianconi

See https://github.com/tensorzero/tensorzero/pull/2588 for early work.

GabrielBianconi