rengine icon indicating copy to clipboard operation
rengine copied to clipboard

Add llama2 llm

Open ErdemOzgen opened this issue 6 months ago • 5 comments

  • Added ollama with docker container
  • GPTVulnerabilityReportGenerator : Retrieves an OpenAI API key and sets the model to 'gpt-3.5-turbo'. If the API key is not available, it initializes an Ollama instance for local use.
  • GPTAttackSuggestionGenerator: Similar to the GPTVulnerabilityReportGenerator, it retrieves an OpenAI API key and sets the model to 'gpt-3.5-turbo', or initializes an Ollama instance if the API key is not available.
  • Changed makefile make up and make down sections.
  • After docker container up it will run command to pull llama2-uncensored llm model and serve model.

This PR fixes #1035.

ErdemOzgen avatar Dec 07 '23 18:12 ErdemOzgen

Based on my understanding, the two failed GitHub Actions are facing distinct issues. The problem does not pertain to a Pull Request (PR). The issue with pulling the Docker image is due to an Error: Username and password required. Meanwhile, the Auto Comment action is encountering a different problem, which could potentially be resolved by ensuring that the GitHub token being used has the appropriate permissions.

ErdemOzgen avatar Dec 08 '23 12:12 ErdemOzgen

Uhm, I compared with https://github.com/yogeshojha/rengine/pull/1096, but what's the difference? I can't spot any difference when I tried to compare it using the GitHub feature.

AnonymousWP avatar Dec 08 '23 13:12 AnonymousWP

Based on my understanding, the two failed GitHub Actions are facing distinct issues. The problem does not pertain to a Pull Request (PR). The issue with pulling the Docker image is due to an Error: Username and password required. Meanwhile, the Auto Comment action is encountering a different problem, which could potentially be resolved by ensuring that the GitHub token being used has the appropriate permissions.

Would you be able to fix this by a new PR? I understand some can't be fixed due to insufficient permissions, though.

AnonymousWP avatar Dec 08 '23 13:12 AnonymousWP

Based on my understanding, the two failed GitHub Actions are facing distinct issues. The problem does not pertain to a Pull Request (PR). The issue with pulling the Docker image is due to an Error: Username and password required. Meanwhile, the Auto Comment action is encountering a different problem, which could potentially be resolved by ensuring that the GitHub token being used has the appropriate permissions.

Would you be able to fix this by a new PR? I understand some can't be fixed due to insufficient permissions, though.

@AnonymousWP You can check this PR Also fetch my current PR; needs to workflow approval again.

ErdemOzgen avatar Dec 09 '23 08:12 ErdemOzgen

This need to be tested, @yogeshojha You could test it ?

psyray avatar Dec 16 '23 17:12 psyray

Hi @ErdemOzgen,

Thank you for the excellent work.

I am closing this as I have already merged your changes through this MR https://github.com/yogeshojha/rengine/pull/1259

Thanks

yogeshojha avatar May 12 '24 13:05 yogeshojha