Takehiro Suzuki
Takehiro Suzuki
@dezhouc2 Sorry, I misunderstood. The concepts of context window and max tokens are different. The context window (currently 200K) pertains to the input to the LLM, while max tokens (the...
@ggallo We'll make USE_STREAMING be deprecated because it's hard to maintain the option with keeping backward compatibility to add new features. Thank you for your understanding.
Related: #434 The SQS massage size limit is [256KiB](https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/quotas-messages.html). As you mentioned, we need to split into chunks or put on external storage temporarily.
Sorry, I misunderstood. Yes surely they utilize the same logic but there is a implementation difference. Published api uses [chat](https://github.com/aws-samples/bedrock-claude-chat/blob/v1/backend/app/usecases/chat.py#L259) method and the other uses [process_chat_input](https://github.com/aws-samples/bedrock-claude-chat/blob/v1/backend/app/websocket.py#L39). If the same message...
Thank you for the detail. The log shows that the bot looks like using Knowledge a.k.a. RAG but your chat screen does not look like using Knowledge. Could you describe...
@okamoto-aws Could you describe a sample to imagine this feature? Any information such as concrete usecases, images and draft codes would be appreciated.
Thanks for reporting this issue. Your detailed debugging helped identify this problem. The initial 200 response is expected (API is asynchronous), but you're right that the backend is failing silently...
#862 merged. Please check if the problem resolved. Thank you
The problem is caused by [youtube-transcript-api](https://github.com/jdepoix/youtube-transcript-api) library. Issues: - https://github.com/jdepoix/youtube-transcript-api/issues/293 - https://github.com/jdepoix/youtube-transcript-api/issues/303 We may remove the youtube feature in the future for [KnowledgeBase integration](https://github.com/aws-samples/bedrock-claude-chat/issues/440). Thank you for your understanding.
Implemented "Continue Generate" on https://github.com/aws-samples/bedrock-claude-chat/pull/401