Catalog of many inconsistencies on the AI. V0.2

[makrse]

Duplicates

• [ ] I have searched the existing issues
• [x] Try put every common encounter issues and sumarize.
• [ ] Rely on the past posted issues and try to replicate if still happen again and report it on time.
• [x] Try every scenario possible to catch bad arguments that the AI used to be corrected in a future patch.

Summary 💡

I want to write all the issues I encounter when trying understand how autogpt works:

1

Theres error when auto-gpt trying to clone a git :

• NEXT ACTION: COMMAND = google ARGUMENTS = {'input': 'repository URL for <repository_name>'}

The AI uses literally 'repository URL' like an actual URL, that makes an infinite loop trying to clone a respository.

---

2

Similar error :

 - NEXT ACTION:  COMMAND = clone_repository ARGUMENTS = {'repository_url': '<repository_url>', 'clone_path': '<clone_path>'}

The AI does not take actual <repository_url>, and the <clone_path> literally as a path that does not exist, making it another infinite loop.

---

3

When call it to analize self code :

 - NEXT ACTION:  COMMAND = analyze_code ARGUMENTS = {'code': '<insert self code here>'}

It takes literally as an argumment to the own code in witch does not exist such file and cannot determine this is a major failure despite to mention it before after 2 failed attempts to do not repeat same action.

---

4

When Json object invalid: related to https://github.com/Significant-Gravitas/Auto-GPT/issues/21

- NEXT ACTION:  COMMAND = Error: ARGUMENTS = Missing 'command' object in JSON
- SYSTEM:  Command Error: threw the following error: Missing 'command' object in JSON

When try to on his own to fix this bug it does not be able to do it making another infinite loop.

---

5

When after many fail attemps get the actual URL of an git :

• NEXT ACTION: COMMAND = clone_repository ARGUMENTS = {'repository_url': 'https://github.com/ElementAI/ggml.git', 'clone_path': '/app/nbs/ai_platform/auto_gpt_workspace/ggml'} SYSTEM: Command clone_repository returned: Error: Attempted to access path 'D:\app\nbs\ai_platform\auto_gpt_workspace\ggml' outside of workspace 'D:\AI\Auto-GPT\auto_gpt_workspace'.

It does not aware the only path that can have access its auto_gpt_workspace, that its because the AI copy other sources files path or literally "disk:/path/to/this/" , making it having cause failures trying many arguments to realize the right path, sometimes does not.

---

6. The env file even changed the default search motor to firefox, opera, ME, it still use chrome.
7. Giving permission to work outside of workspace also does not work.
8. Giving the username of Github and " personal access token (classic)' as a key does not work.

---

9

When try to analize code:

• NEXT ACTION: COMMAND = analyze_code ARGUMENTS = {'code': '<full_code_string>'}

It literally takes the request to find a way to download a unkown package to analize code, using "analize_code_package" as an actual sources to analize, and takes code: <full_code_string> literally as a hole, in witch the code to be analize its : literally <full_code_string>as a phrase and not an actual file with real code inside.

---

10

When try to analize an actual py file :

• Use the 'execute_python_file' command to run the 'discord_analysis.py' script. CRITICISM: I need to make sure that the script is properly executed and that any errors are handled appropriately.
• NEXT ACTION: COMMAND = execute_python_file ARGUMENTS = {'filename': 'Somecode_analysis.py'}
• Executing file 'Somecode_analysis.py' in workspace 'D:\AI\Auto-GPT\auto_gpt_workspace' Could not run the script in a container. If you haven't already, please install Docker https://docs.docker.com/get-docker/ SYSTEM: Command execute_python_file returned: Error: Error while fetching server API version: (2, 'CreateFile', 'System could not find the file.')

Theres have issues when try to analize a file itself.

---

11

When try to search, read, execute a concrete file.

• NEXT ACTION: COMMAND = search_files ARGUMENTS = {'directory': '.', 'filename': 'Somecode_analysis.py'}
• SYSTEM: Command search_files returned: Error: search_files() got an unexpected keyword argument 'filename'

- NEXT ACTION:  COMMAND = read_file ARGUMENTS = {'filename': '<filename>'}
- SYSTEM:  Command read_file returned: Error: [Errno 22] Invalid argument: 'D:\\AI\\Auto-GPT\\auto_gpt_workspace\\<filename>'

- NEXT ACTION:  COMMAND = execute_python_file ARGUMENTS = {'filename': '<filename>'}
 Executing file '<filename>' in workspace 'D:\AI\Auto-GPT\auto_gpt_workspace'
- SYSTEM:  Command execute_python_file returned: Error: Invalid file type. Only .py files are allowed.

The main issue it's take '' literally as a actual file that does not exist and do not able to be aware or able to find the right file, even if the file being found, theres some bad argument, incluiding dont be able to recongnize the file type even with the file extension.

---

12

Major flag trying to let own Auto-GPT to run self code test :

First scenario: THOUGHTS: I should write tests for my code to ensure that it is working as expected. REASONING: Writing tests will help me identify any errors in my code and ensure that it is working as expected. CRITICISM: I need to make sure that my tests are comprehensive and cover all possible scenarios. NEXT ACTION: COMMAND = write_tests ARGUMENTS = {'code': '<full_code_string>', 'focus': '<list_of_focus_areas>'} SYSTEM: Command write_tests returned: Error: The model: gpt-4 does not exist

Second scenario: THOUGHTS: I should try to get suggestions for improving my code. CRITICISM: I need to make sure that the suggestions are relevant and applicable to my code. NEXT ACTION: COMMAND = improve_code ARGUMENTS = {'suggestions': '<list_of_suggestions>', 'code': '<full_code_string>'

The main point its AI continue trying to execute bad code argument in order to analize an non existent code. even with not having gp4 model key, it incluides 3.5 too.

---

13

When try to do write an existent file :

- NEXT ACTION:  COMMAND = write_to_file ARGUMENTS = {'filename': 'phrases.txt', 'text': 'an example of phrases'}

First scenario: It seems when re open the auto-gpt to continue the task discovered theres already made file, then when try to make an update of the file uses "write_to_file " argument but gives error, so then after many fail attempts use the "append_to_file" to rewrite the file.

Second scenario: When happen the same and does not be able to recall itself to use "append_to_file" to update the file with new stuff, begin an infinite loop on make use between "delete_file" and "write_to_file" commands.

Third scenario: When happen to after delete and made new file on a loop also emerge a big major failure trying to use again already searched sources on the web, making the loop of : DELETE FILE ---- SEARCH GOOGLE SOURCE----WRITE FILE, this loop can seems its progresing to done the task but its a false-positive waste of money loop.

Cause : : Failure to use write_to_file to an existent file to update content :

• SYSTEM: Command write_to_file returned: Error: File has already been updated.

Motivation 🔦

Trying to provide more feedback to improve.

[philliplastcall]

I have experienced all of these same issues and i think it all relates to a previously ignored issue i brought up with improper escape characters somewhere in the coding

[makrse]

I have experienced all of these same issues and i think it all relates to a previously ignored issue i brought up with improper escape characters somewhere in the coding

We need to bring all the incoming issues and do as a hole thing better do a catalog and give it a solution 1 by 1 on one topic and link it to the relative solution being found.

[makrse]

I'm trying each time I found some consistent failures to do update on the catalog, so if someone got same issue you can bump this thread and tell what number above you got. (if theres already made thread let me know and I will link it too)

We need avoid post and open already know bug and put it as a hole and cooperate to make the place less messy.

[luxlube]

Hi,

I am getting following errors on chatgpt-3.5 when autogpt is trying to perform actions. Is it related to the current issue or should I open a new issue?

NEXT ACTION: COMMAND = search_files ARGUMENTS = {'directory': './', 'pattern': '(story|ghost|pets)'} SYSTEM: Command search_files returned: Error: search_files() got an unexpected keyword argument 'pattern'

NEXT ACTION: COMMAND = search_files ARGUMENTS = {'directory': './', 'query': '(story|ghost|pets)'} SYSTEM: Command search_files returned: Error: search_files() got an unexpected keyword argument 'query'

NEXT ACTION: COMMAND = search_files ARGUMENTS = {'directory': './', 'regex': '(story|ghost|pets)'} SYSTEM: Command search_files returned: Error: search_files() got an unexpected keyword argument 'regex'

NEXT ACTION: COMMAND = search_files ARGUMENTS = {'directory': './', 'query': '(story OR ghost OR pets)'} SYSTEM: Command search_files returned: Error: search_files() got an unexpected keyword argument 'query'

Best regards

[3265]

I got this error

Command search_files returned: Error: search_files() got an unexpected keyword argument 'query'

[github-actions[bot]]

This issue has automatically been marked as stale because it has not had any activity in the last 50 days. You can unstale it by commenting or removing the label. Otherwise, this issue will be closed in 10 days.

[github-actions[bot]]

This issue was closed automatically because it has been stale for 10 days with no activity.