auto-code-rover icon indicating copy to clipboard operation
auto-code-rover copied to clipboard

Published 20 hours ago • verified publisher icon nus-apr

feat: Amazon Bedrock support ⛰️

Open JGalego opened this issue 9 months ago • 0 comments

Overview

This PR adds support for the following models available on Amazon Bedrock:

  • Claude 3 Haiku
  • Claude 3 Sonnet
  • Claude 3 Opus

Instructions

  1. Build image

    docker build --rm -f Dockerfile -t acr .

  2. Set up AWS credentials

    # See https://litellm.vercel.app/docs/providers/bedrock
export AWS_REGION_NAME=...
export AWS_ACCESS_KEY_ID=...
export AWS_SECRET_ACCESS_KEY=...

  3. Start image

    docker run -it $(env | grep AWS_ | xargs printf ' -e %s') -p 3000:3000 -p 5000:5000 acr

  4. Start web UI

    cd /opt/auto-code-rover/demo_vis/
sed -i 's/gpt-4-0125-preview/bedrock\/anthropic.claude-3-sonnet-20240229-v1:0/g' main.py
bash run.sh

  5. Head over to http://localhost:3000

  6. Click 💡 Try example? 💡

  7. Click 🚀 Boot Now! 🚀

    bedrock-acr

JGalego avatar May 07 '24 13:05 JGalego