Track query tokens and save them to CSV

[bauersimon]

Problem

With the release of OpenAI o1-preview and o1-mini, the costs also include internal reasoning tokens. Therefore, pricing comparisons with classical one-shot models is not possible. I.e. o1-mini costs $15 and Sonnet 3.5 costs $18 but Sonnet is so much cheaper cause it does not have intermediate reasoning.

Solution (optional)

Track the actual tokens of each query from the model response according to https://platform.openai.com/docs/api-reference/chat/object and save them to the CSV.