pulsar icon indicating copy to clipboard operation
pulsar copied to clipboard

[feat][pip] PIP-420: Provide ability for Pulsar clients to integrate with third-party schema registry service

Open gaoran10 opened this issue 6 months ago • 2 comments

Motivation

The Pulsar client is better has the ability to access third-party schema registry service to manage the schema (register schema, get schema, validate schema, etc.). The schema registry service can be an independent service, if using an external schema registry service, the Pulsar broker doesn't need to care about the schema of the messages while creating producer or adding consumer subscription.

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

  • [ ] Dependencies (add or upgrade a dependency)
  • [x] The public API
  • [ ] The schema
  • [ ] The default values of configurations
  • [ ] The threading model
  • [ ] The binary protocol
  • [ ] The REST endpoints
  • [ ] The admin CLI options
  • [ ] The metrics
  • [ ] Anything that affects deployment

Documentation

  • [ ] doc
  • [ ] doc-required
  • [x] doc-not-needed
  • [ ] doc-complete

gaoran10 avatar May 21 '25 16:05 gaoran10

BTW, you can leverage AI tool (e.g. Copilot) to improve the documents with more professional expression.

image

BewareMyPower avatar Jun 05 '25 12:06 BewareMyPower

BTW, you can leverage AI tool (e.g. Copilot) to improve the documents with more professional expression.

image

@BewareMyPower @gaoran10

Before this, a small trick by @lhotari inspired me.(https://github.com/apache/pulsar/pull/23794#issuecomment-2569093501)

Now, I wrote PIP documentation through LLM.


CleanShot 2025-06-13 at 20 05 18@2x


  • First, we need a good system prompt that can directly generate content output that meets the format requirements based on the article title in the PIP document.
  • We need to provide sufficient contextual information (e.g., code patches, the motivation for writing this PIP), so that the generated draft can reach a basic usable level. After multiple rounds of dialogue adjustments or manual modifications, the document will become very professional.

This approach saves a lot of time, allowing us to focus on code development.

The system prompt is as follows:

https://gist.github.com/Denovo1998/163e55b3a612873364a00cf0df5a1b95

Denovo1998 avatar Jun 13 '25 12:06 Denovo1998

@BewareMyPower @gaoran10

Before this, a small trick by @lhotari inspired me.(https://github.com/apache/pulsar/pull/23794#issuecomment-2569093501)

Now, I wrote PIP documentation through LLM.

@Denovo1998 Nice work, I also improved the document with AI tools. /cc @BewareMyPower

gaoran10 avatar Jun 18 '25 03:06 gaoran10