Obi Ekekezie

Cache appears to be permanently turned on in dspy-ai-2.4.5

1

In this version of DSPy, this looks like a bug in the file "dsp/modules/cache_utils.py": ```python cache_turn_on = True ``` It should probably be: ```python cache_turn_on = os.environ.get('DSP_CACHEBOOL', 'True').lower() != 'false'...

Why is uploading a dataset to Weave being counted towards the ingestion usage?

3

The pricing page seems to suggest that the ingestion usage is supposed to reflect how much data is used by tracing activities: https://wandb.ai/site/pricing/ However, my account is clearly counting uploading...

Clarification or Improvement: Should preprocess_model_input Also Affect Inputs to Scorer Functions?

1

### Description Currently, in the Weave evaluation framework (`weave.flow.eval`), the `preprocess_model_input` function provided by users only transforms inputs passed into the model's prediction function. Scorer functions, however, always receive the...