Add custom prompt or build a prompt plugin mechanism for user.

[Undertone0809]

Introduction

Sometime, we need some custom prompt to drive our LLM. Currently, there is no convenient mechanism to handle it in chatGPTBox.

We can also see other relevant demands:

#261 This issue show the problem: The extension is not prompt-engineer friendly. I have much better prompts that do a much better job than the default ones with no way to plug them in anywhere. I'm also willing to share those prompts. It suggests: I'd like to be able to enter my prompts and possibly an icon name of choice into a JSON file or into some box or something in the settings menu and then have the prompts that appear when I select text updated.

#395 This issue suggests: I think a menu could be added to the settings page of the plugin. This menu can support customizable right click menu and custom prompt.

#209 This issue suggests provide every prompt can custom and edit.

Expectation

• let user can build a custom prompt
• user can manage custom prompt
• user can manage all prompt (Like website summary, but this is a further matter that can be done at the next stage)

More flexible

A more interesting design approach would be to build a plugin system that provides users with custom prompts and a plugin market. This system would allow users to define complex functionalities through plugins, instead of just customizing prompts. For example, a plugin could be created to summarize bullet comments on Bilibili, which would require specific code implementation rather than just a prompt.

User oriented The plugin mechanism can make it more convenient for users who want to build custom handles to use. ref: #360 #425 #467

In terms of implementation:

By creating a template-based repository, every user can easily define their own plugins and dynamically import them through configuration files. The plugin market could be built on platforms like GitHub, where users can share their developed plugins through dedicated issues or discussions, creating a healthy ecosystem.

Additional context

I am the author of Promptulate, which is a LLM Application development framework. I also enjoy doing some intersting LLM application development.

I have many interesting ideas, and I believe you too. We look forward to further discussions or the opportunity to engage in in-depth project cooperation. My email: [email protected]

Do we have a communication group? @josStorer

[josStorer]

I have indeed seen many people hoping to add the custom prompt feature, and I also intend to implement it. However, I am busy with other real-life work, so I have not yet been able to complete it. I will implement it, but I cannot provide an exact time.

[Undertone0809]

That's a pity. Can we build a community of developers to try to push this forward?

[josStorer]

v2.5.6

The Plugin System I envisioned previously is somewhat complex, and due to my limited time and energy, I am unable to implement it temporarily. However, considering that many users require custom prompt functionality, I have now implemented a simplified version. The implementation of this feature is not complex, but it had been missing for the past year, for which I apologize.

Simple custom selection tools is now supported