langchain-aws icon indicating copy to clipboard operation
langchain-aws copied to clipboard

Add support for amazon-bedrock-guardrailConfig

Open supreetkt opened this issue 1 year ago • 10 comments

Add support for amazon-bedrock-guardrailConfig

  • Adds guardrailConfig to hold values for this field within the guardrails property for Bedrock classes and this is passed to the bedrock invoke model calls via the amazon-bedrock-guardrailConfig field in the body. amazon-bedrock-guardrailConfig allows adding a tagSuffix [documentation] and different streaming response behaviors [documentation]
  • Also cleaned up some documentation, error messages and tests
  • Added a conftest file for common fixtures that can be used across tests

Closes: #52

supreetkt avatar May 24 '24 22:05 supreetkt

@3coins: can we trigger the workflow checks on this PR? Thanks.

supreetkt avatar May 27 '24 20:05 supreetkt

is there any idea when this might be released?

nbaillie avatar Jun 11 '24 16:06 nbaillie

is there any idea when this might be released?

I haven't heard back from @3coins yet, but hopefully soon!

supreetkt avatar Jun 17 '24 18:06 supreetkt

@3coins any updates on this PR? I need this feature ASAP. Please let me know if I can help :)

paulonasc avatar Jun 24 '24 21:06 paulonasc

@supreetkt Can you fix conflicts and rebase from main.

3coins avatar Jun 24 '24 23:06 3coins

hey guys! Is there any chance this is going to be released soon?

fpSpindola avatar Jul 15 '24 17:07 fpSpindola

Does this actually work with streaming? I'm finding that even with these changes, whether I use asynchronous or synchronous streaming with the Anthropic bedrock models in langchain, as soon as I include guardrails I get the results in a single chunk rather than streaming out the response in smaller chunks gradually.

john-mihailescu avatar Aug 05 '24 14:08 john-mihailescu

I really hope this gets implemented soon.

KimYongKuk avatar Aug 06 '24 11:08 KimYongKuk

@supreetkt Can you fix conflicts and rebase from main.

yes, I can resolve the conflicts. Missed notifications on this.

supreetkt avatar Nov 04 '24 15:11 supreetkt

Is there any idea when this might be released?

jarvis0 avatar Dec 02 '24 17:12 jarvis0