AutoGPT icon indicating copy to clipboard operation
AutoGPT copied to clipboard

Large embedding fix

Open pabstaaron opened this issue 2 years ago • 10 comments
trafficstars

Fixes a crash that occurs when Auto tries to create an embedding for a very large text input.

On receiving a large string, create_embedding now recursively divides the text into overlapping windows and averages the output embeddings together. (Not a perfect approach and may result in some loss of context, but it preserves the relationship between the original text's words reasonably well.)

pabstaaron avatar Apr 30 '23 05:04 pabstaaron

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
docs ⬜️ Ignored (Inspect) May 1, 2023 11:35pm

vercel[bot] avatar Apr 30 '23 05:04 vercel[bot]

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

github-actions[bot] avatar Apr 30 '23 05:04 github-actions[bot]

Conflicts have been resolved! 🎉 A maintainer will review the pull request shortly.

github-actions[bot] avatar Apr 30 '23 16:04 github-actions[bot]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

github-actions[bot] avatar Apr 30 '23 16:04 github-actions[bot]

Duplicate of https://github.com/Significant-Gravitas/Auto-GPT/pull/3222

k-boikov avatar Apr 30 '23 18:04 k-boikov

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

github-actions[bot] avatar May 01 '23 18:05 github-actions[bot]

Conflicts have been resolved! 🎉 A maintainer will review the pull request shortly.

github-actions[bot] avatar May 01 '23 23:05 github-actions[bot]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

github-actions[bot] avatar May 01 '23 23:05 github-actions[bot]

This is a mass message from the AutoGPT core team. Our apologies for the ongoing delay in processing PRs. This is because we are re-architecting the AutoGPT core!

For more details (and for infor on joining our Discord), please refer to: https://github.com/Significant-Gravitas/Auto-GPT/wiki/Architecting

p-i- avatar May 05 '23 00:05 p-i-

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

github-actions[bot] avatar May 13 '23 23:05 github-actions[bot]

This one can also be closed. It duplicates #3222 that fixed the issue. Thanks for your contribution! Please reopen if mistaken.

kinance avatar May 26 '23 15:05 kinance

@Pwuts I closed this, as it's duplicate. Trying to help close some obsolete PRs/issues. The issue has been fixed in master. Please reopen if disagree.

kinance avatar May 26 '23 15:05 kinance