fluvio icon indicating copy to clipboard operation
fluvio copied to clipboard

Tracking: Custom Partition mapping

Open sehz opened this issue 3 years ago • 3 comments

To support chatbot example that @ajhunyady is working on, we need following capability:

  • [ ] Incremental partition creation (adding more partition)

  • [ ] Declarative Partition key mapping

Declarative partition mapping allow user to map fields in record to partition key. We should extend CLI/API to

  • display mapping
  • update mapping

sehz avatar Nov 06 '20 15:11 sehz

Ideally I should have the ability to name the partitions to match session id:

5282645fae22c226da3d4cbd4953ed89a573355a
09daabf4ddbce1fdc1b7d71ba18226a666d3be5f

ajhunyady avatar Nov 06 '20 16:11 ajhunyady

Yes, we can add logical id partition and map to storage id

0   <=> 5282645fae22c226da3d4cbd4953ed89a573355a
1   <=> 09daabf4ddbce1fdc1b7d71ba18226a666d3be5f

In the CLI and API, we can provide producer and consumer based on logical partition id instead of storage id

sehz avatar Nov 06 '20 16:11 sehz

Stale issue message

github-actions[bot] avatar Sep 11 '21 11:09 github-actions[bot]