AWS: Region is not getting setup

[pankajjainChainThat]

I am setting the AWS_REGION but it is taking default 'us-west-2' region. I tried to set in system environment variables also, but code doesn't pick it up and give error "An error occurred (AccessDeniedException) when calling the Converse operation: You don't have access to the model with the specified model ID." Although if I create my own program then it is working fine.

import aisuite as ai import os from dotenv import load_dotenv, find_dotenv

def configure_environment(additional_env_vars=None): load_dotenv(find_dotenv()) if additional_env_vars: for key, value in additional_env_vars.items(): os.environ[key] = value

additional_keys = { 'AWS_ACCESS_KEY_ID': 'xxxx', 'AWS_SECRET_ACCESS_KEY': 'xxxxx', 'AWS_REGION': 'us-east-1' }

configure_environment(additional_env_vars=additional_keys)

client = ai.Client()

messages = [ {"role": "system", "content": "Respond in Pirate English."}, {"role": "user", "content": "Tell me a joke."}, ]

model = "aws:anthropic.claude-3-5-sonnet-20240620-v1:0" response = client.chat.completions.create(model=model , messages=messages) print(response.choices[0].message.content)

[rohitprasad15]

Are you using the above code snippet ? additional_keys is overriding your env variables. Can you remove the additional_keys or make it empty. Can you retry and let me know if it works.

[pankajjainChainThat]

It is not working after removing the additional keys. Refer the below code which gives me error ->botocore.errorfactory.AccessDeniedException: An error occurred (AccessDeniedException) when calling the Converse operation: You don't have access to the model with the specified model ID. I have set "region = us-east-1" in system param.

import aisuite as ai

#aws bedrock with AI suite - NOT working client = ai.Client() messages = [ {"role": "system", "content": "Respond in Pirate English."}, {"role": "user", "content": "Tell me a joke."}, ]

model = "aws:anthropic.claude-3-5-sonnet-20240620-v1:0" response = client.chat.completions.create(model=model, messages=messages) print(response.choices[0].message.content)

To check the access to model I have executed below code which is working. In both cases AWS Keys and Region is coming from system parameters. #direct AWS bedrock code - Working import boto3 client = boto3.client("bedrock-runtime") messages = [ {"role": "user", "content": [{"text": "Who is the PM of India?"}]}, {"role": "assistant", "content": [{"text": "You are an advisor."}]}, {"role": "user", "content": [{"text": "Who is the PM of India?"}]} ] response = client.converse( modelId="anthropic.claude-3-5-sonnet-20240620-v1:0",
messages=messages ) print (response)