Andrew Jesson

Results 13 issues of Andrew Jesson

This recipe demonstrates how to do supervised fine tuning on demonstrations with unsloth. ---- > [!IMPORTANT] > Adds a new recipe for supervised fine-tuning using Unsloth, including a Jupyter notebook,...

Added notebook for failure mode analysis: - builds a dataset from clickhouse database. - generates root cause proposals for each failure case (t0 function: root_cause_analysis) - gets text embeddings for...

This PR adds a notebook recipe for metrics supervised fine tuning using Google Vertex AI Inference using the fine-tuned model is currently blocked by #2235 ---- > [!IMPORTANT] > Adds...

Inference using fine tuned models through Google Vertex does not follow the same url pattern as gemini models. The path is `/locations//endpoints/` instead of `/locations//models/` There is currently no TensorZero...

priority-high
rust

This recipe demonstrates how to do supervised fine tuning using metrics filtering with [Axolotl](https://docs.axolotl.ai). ---- > [!IMPORTANT] > Adds a recipe for supervised fine-tuning using Axolotl with metrics filtering, including...

This recipe demonstrates how to do supervised fine tuning using metrics filtering with [torchtune](https://docs.pytorch.org/torchtune/main/api_ref_models.html). - enables multi-gpu fine-tuning ---- > [!IMPORTANT] > Add a new recipe for supervised fine-tuning with...

Remove specific GCP variables ---- > [!IMPORTANT] > Replaces hardcoded GCP variables with placeholders in `google_vertex_nb.py` to make the script more generic. > > - **Behavior**: > - Replaces hardcoded...

This PR adds live tests for the GEPA optimization algorithm, covering both chat and JSON function types. ## Changes ### New Test Functions - `test_gepa_optimization_chat()` - Live test for GEPA...

Description: - GEPA launch now seeds and maintains a Pareto frontier with validation datapoint IDs, samples parents via frontier frequencies, gates child validation on minibatch Pareto improvement, and returns only...

This PR implements the GEPA mutate function for template optimization and fixes template handling to maintain unified template representation throughout the optimization pipeline. ## Changes ### Core Functionality **Built-in Mutate...