Sideways Thought

icon indicating a website link https://sidewaysthought.net

icon location Content creation in every manor: video, code, social media, whatever else my brain wants me to do. That is why I chose Sideways Thought LLC.

Results 8 comments of Sideways Thought

Fix the maximum context length issue by chunking

I've written code that uses Numpty to count characters, and spacy to count tokens--count characters to create blocks of text that mix down to the number of tokens for an...

Fix the maximum context length issue by chunking

Merging vectors it is!

Fix the maximum context length issue by chunking

I pushed code last night into the associated branch that concatenates rather than averages.

Fix the maximum context length issue by chunking

https://github.com/sidewaysthought/Auto-GPT/tree/read_file-fix-character-length-%233222

Fix the maximum context length issue by chunking

> @sidewaysthought we can't process your contribution if you don't create a PR This was the PR https://github.com/Significant-Gravitas/Auto-GPT/pull/3262

Chat With User

The requirements.txt file will need to be hand sorted out. I don't want to mess things up more than I have.

Prompt overflows aren't handled gracefully

I've drafted code that chunks, combines by averaging, then returning that combined embedding. I won't do anything with it if you've already done all the things @Pwuts.

UTF8 files unsupported

The code as-is only functions with UTF-8. If it is in any other format, the code falls over. I've updated the code to detect the file encoding, then use that...