openai-python icon indicating copy to clipboard operation
openai-python copied to clipboard

[0.26.1] Error syncing to wandb

Open thehappydinoa opened this issue 2 years ago • 2 comments

When running the following command I receive the following warning.

$ openai wandb sync --project project
wandb: Currently logged in as: me (company). Use `wandb login --relogin` to force relogin
wandb: Tracking run with wandb version 0.13.9
wandb: Run data is saved locally in project/wandb/run-20230117_161328-ft-upiwOdAB20VtkGN7uHW5TFv2
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run ft-upiwOdAB20VtkGN7uHW5TFv2
wandb: ⭐️ View project at https://wandb.ai/me/project
wandb: 🚀 View run at https://wandb.ai/me/project/runs/ft-upiwOdAB20VtkGN7uHW5TFv2
File file-ISyZKcogrCzx59ftjGPWOUs1 could not be read as a valid JSON file
File file-3GjQ844dqjAY6hYuQKpMf7mQ could not be read as a valid JSON file

When I check in wandb, only system metrics are synced. I do not see any of the metrics related to the fine-tuning such as validation loss and token usage.

I am running the following versions.

python==3.10.8
openai==0.26.1
wandb==0.13.9

thehappydinoa avatar Jan 17 '23 22:01 thehappydinoa

Hi,

Can you try to log only latest fine-tune run to see if it's an issue with this specific one:

openai wandb sync -n 1 --project my_project

borisdayma avatar Jan 18 '23 20:01 borisdayma

Hey @borisdayma , I tried it with the last one and the last two with the same error.

thehappydinoa avatar Jan 18 '23 22:01 thehappydinoa

It looks like this will be fixed later today. Follow the discussion in https://github.com/openai/openai-python/pull/185

thehappydinoa avatar Jan 25 '23 15:01 thehappydinoa

0.26.3 just got released if you'd like to try it out for this issue

hallacy avatar Jan 25 '23 15:01 hallacy