Curator icon indicating copy to clipboard operation
Curator copied to clipboard

Fixed bug: changed to correct model name

Open ByteWrite opened this issue 1 year ago • 2 comments

Description

changed model name from meta/llama3.1-405b-instruct and stg/meta/llama3.1-405b-instruct to meta/llama-3.1-405b-instruct.

Usage

# Add snippet demonstrating usage
async def generate_subtopics(client, topic, n_subtopics):
    prompt = TOPIC_GENERATION_PROMPT_TEMPLATE.format(topic=topic, n_subtopics=n_subtopics)
    response = await client.chat.completions.create(
        model="meta/llama-3.1-405b-instruct",
        messages=[
            {"role" : "user",
             "content" : prompt}
        ],
        temperature=0.2,
        top_p=0.7,
        max_tokens=1024,
    )
    return response

Checklist

  • [ ] I am familiar with the Contributing Guide.
  • [ ] New or Existing tests cover these changes.
  • [x] The documentation is up to date with these changes.

ByteWrite avatar Aug 06 '24 08:08 ByteWrite

Fixed bug: Previous given model names "meta/llama3.1-405b-instruct" and "stg/meta/llama3.1-405b-instruct" was not working. So, changed model name from "meta/llama3.1-405b-instruct" and "stg/meta/llama3.1-405b-instruct" to "meta/llama-3.1-405b-instruct" and this is working nicely.

ByteWrite avatar Aug 06 '24 08:08 ByteWrite

Thanks for opening @ByteWrite. To pass the DCO and merge requirements, NeMo-Curator requires all commits to be signed and signed-off. More information on how to do so is described in the section here: https://github.com/NVIDIA/NeMo-Curator/blob/main/CONTRIBUTING.md#pull-requests-pr-guidelines

Happy to followup if you run into any issues with commit signing.

ayushdg avatar Aug 06 '24 16:08 ayushdg

This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or update or this will be closed in 7 days.

github-actions[bot] avatar Jul 28 '25 02:07 github-actions[bot]

This PR was closed because it has been inactive for 7 days since being marked as stale.

github-actions[bot] avatar Aug 04 '25 02:08 github-actions[bot]