NeMo-Curator
NeMo-Curator copied to clipboard
Fixed bug: changed to correct model name
trafficstars
Description
changed model name from meta/llama3.1-405b-instruct and stg/meta/llama3.1-405b-instruct to meta/llama-3.1-405b-instruct.
Usage
# Add snippet demonstrating usage
async def generate_subtopics(client, topic, n_subtopics):
prompt = TOPIC_GENERATION_PROMPT_TEMPLATE.format(topic=topic, n_subtopics=n_subtopics)
response = await client.chat.completions.create(
model="meta/llama-3.1-405b-instruct",
messages=[
{"role" : "user",
"content" : prompt}
],
temperature=0.2,
top_p=0.7,
max_tokens=1024,
)
return response
Checklist
- [ ] I am familiar with the Contributing Guide.
- [ ] New or Existing tests cover these changes.
- [x] The documentation is up to date with these changes.