openllmetry-js icon indicating copy to clipboard operation
openllmetry-js copied to clipboard

Feature: OpenAI Assistants API

Open michael-hhai opened this issue 1 year ago • 6 comments

The instrumentation-openai package should be able to capture calls to the OpenAI Assistants API. Specifically, it should be able to trace this program taken from the linked quickstart documentation:

import OpenAI from "openai";
const openai = new OpenAI({ apiKey: OPENAI_KEY });

async function main() {
  const assistant = await openai.beta.assistants.create({
    name: "Math Tutor",
    instructions: "You are a personal math tutor. Write and run code to answer math questions.",
    tools: [{ type: "code_interpreter" }],
    model: "gpt-4o"
  });
  const thread = await openai.beta.threads.create();
  const message = await openai.beta.threads.messages.create(
    thread.id,
    {
      role: "user",
      content: "I need to solve the equation `3x + 11 = 14`. Can you help me?"
    }
  );
  let run = await openai.beta.threads.runs.createAndPoll(
    thread.id,
    {
      assistant_id: assistant.id,
      instructions: "Please address the user as Jane Doe. The user has a premium account."
    }
  );
  if (run.status === 'completed') {
    const messages = await openai.beta.threads.messages.list(
      run.thread_id
    );
    for (const message of messages.data.reverse()) {
      console.log(`${message.role} > ${message.content[0].text.value}`);
    }
  } else {
    console.log(run.status);
  }
}

main();

michael-hhai avatar Jun 06 '24 15:06 michael-hhai

Yes @michael-hhai! Do you plan on working on this?

nirga avatar Jun 06 '24 16:06 nirga

Not immediately, which is why I made the issue instead of a PR. I should be able to get around to it soon-ish. If I'm not able to get to this within a week, then I'll update this issue.

michael-hhai avatar Jun 06 '24 16:06 michael-hhai

Great @michael-hhai, I'll post it on slack as well maybe someone will want it

nirga avatar Jun 06 '24 16:06 nirga

To be clear, if someone else wants to grab this then they can be my guest.

michael-hhai avatar Jun 06 '24 16:06 michael-hhai

hey @nirga @michael-hhai I would like to work on this.

vr-varad avatar Aug 16 '24 05:08 vr-varad

Yes please @vr-varad go ahead!

nirga avatar Aug 16 '24 07:08 nirga