NeMo-Curator icon indicating copy to clipboard operation
NeMo-Curator copied to clipboard

Fixed bug: changed to correct model name

Open ByteWrite opened this issue 1 year ago • 2 comments
trafficstars

Description

changed model name from meta/llama3.1-405b-instruct and stg/meta/llama3.1-405b-instruct to meta/llama-3.1-405b-instruct.

Usage

# Add snippet demonstrating usage
async def generate_subtopics(client, topic, n_subtopics):
    prompt = TOPIC_GENERATION_PROMPT_TEMPLATE.format(topic=topic, n_subtopics=n_subtopics)
    response = await client.chat.completions.create(
        model="meta/llama-3.1-405b-instruct",
        messages=[
            {"role" : "user",
             "content" : prompt}
        ],
        temperature=0.2,
        top_p=0.7,
        max_tokens=1024,
    )
    return response

Checklist

  • [ ] I am familiar with the Contributing Guide.
  • [ ] New or Existing tests cover these changes.
  • [x] The documentation is up to date with these changes.

ByteWrite avatar Aug 06 '24 08:08 ByteWrite