Thomas Capelle
Thomas Capelle
cc @tssweeney
Ok, now it is working but... - Had to change some things in the `accumulator.py` like being able to subclass the `_IteratorWrapper` - This is kind of brittle, but I...
I think this is ready for review @tssweeney
I have failing tests outside of my scope:
The integration is merged now; I think token usage should be there: https://github.com/wandb/weave/pull/2399
Maybe @NiWaRe you can refactor and test this?
same issues...
> I think I hit the same issue, sample output from an example based on that in [snakemake/snakemake#3151](https://github.com/snakemake/snakemake/issues/3151) but modified so the background commands print to stdout and stderr: >...
For OpenAI compatible endpoints I use this: ```python async def longer_create(messages=None, max_tokens=4096, **kwargs): """ longer_create is a function that extends the max_tokens beyond the default 4096 by recursively calling the...