kafka-go updates to support Tiered Storage (KIP-405)

[snalvi]

There are upcoming changes to Kafka to include Tiered Storage. The API changes can be found here. Would the API changes mentioned in the KIP require modifications on kafka-go?

Supporting documentation

• KIP 405

[snalvi]

this should be labeled as a question to start

[achille-roussel]

Hello @snalvi, thanks for starting this discussion.

From what I read of KIP-405 there are no protocol changes required to support tiered storage, it seems to be implemented in the backend only?

There is a mention of being able to support topics by id in KIP-516 and an error code which is only used by replication? (OFFSET_MOVED_TO_TIERED_STORAGE)