jupyter-ai
jupyter-ai copied to clipboard
AWS profile doesn't work for inline completions
trafficstars
Description
When using Jupyter AI with AWS Bedrock, there appears to be an authentication issue specifically with the inline completions model. While the main language model works with the configured AWS credentials, the inline completion model fails to authenticate.
Reproduce
- Obtain AWS credentials
- Configure AWS credentials and profile (ai-test) in the system by adding credentials to ~/.aws/credentials
- Set up Jupyter AI with the following configuration:
- Language model: Amazon Bedrock Chat :: anthropic.claude-v2 (Can be any models supported by BedRock)
- AWS profile: ai-test
- Region: us-east-1
- Embedding model: Bedrock :: amazon.titan-embed-text-v1 (Can be any models supported by BedRock)
- Inline completions model: Amazon Bedrock Chat :: anthropic.claude-v2 (Can be any models supported by BedRock)
- Try to use the inline completion feature
- Observe the error "Could not load credentials to authenticate with AWS client"
Expected behavior
The inline completions model should authenticate successfully as it uses the same AWS credentials that work for the main language model.