components-contrib icon indicating copy to clipboard operation
components-contrib copied to clipboard

Event Hub components should expose initialOffset in manifest to control starting position (like Kafka)

Open oising opened this issue 1 year ago • 15 comments

Describe the feature

When an PubSub or Binding component starts up with an empty/new checkpoint store, it starts at the latest position in the backing store. There should be an option to allow starting at the earliest.

Kafka supports this with initialOffset

image

See https://github.com/Azure/azure-event-hubs-go/blob/3dc3aeb6144e5d79a70d32f023f9d5990f81569d/persist/checkpoint.go#L29 in the azure SDK go SDK for the mechanism to support this.

Release Note

RELEASE NOTE:

oising avatar Oct 16 '24 14:10 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Nov 15 '24 14:11 github-actions[bot]

Bump.

oising avatar Nov 15 '24 15:11 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Dec 18 '24 16:12 github-actions[bot]

Bump

oising avatar Dec 18 '24 18:12 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Jan 17 '25 18:01 github-actions[bot]

This is an important one, imho.

oising avatar Jan 17 '25 21:01 oising

Hello @yaron2 -- this seems like a simple one, any chance we can get it into 1.15? Not being able to start from the beginning of a partition means there's a hightened risk of message loss if an app goes offline during an upgrade and you want to replay possibly seen messages to catch up.

oising avatar Jan 29 '25 18:01 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Mar 06 '25 16:03 github-actions[bot]

Bump.

oising avatar Mar 06 '25 17:03 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Apr 05 '25 17:04 github-actions[bot]

Bump.

oising avatar Apr 05 '25 23:04 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar May 05 '25 23:05 github-actions[bot]

/stale-extend

oising avatar May 06 '25 13:05 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Jun 05 '25 13:06 github-actions[bot]

la-la-la-la-la

oising avatar Jun 05 '25 14:06 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Jul 05 '25 15:07 github-actions[bot]

Not stale.

oising avatar Jul 05 '25 16:07 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Aug 04 '25 16:08 github-actions[bot]

Still important.

oising avatar Aug 04 '25 19:08 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Sep 10 '25 22:09 github-actions[bot]

@mikeee

oising avatar Sep 11 '25 13:09 oising

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

github-actions[bot] avatar Oct 11 '25 14:10 github-actions[bot]

This issue has been automatically closed because it has not had activity in the last 37 days. If this issue is still valid, please ping a maintainer and ask them to label it as pinned, good first issue, help wanted or triaged/resolved. Thank you for your contributions.

github-actions[bot] avatar Oct 18 '25 14:10 github-actions[bot]