feldera icon indicating copy to clipboard operation
feldera copied to clipboard

adapters and feldera-types: secrets rework

Open snkas opened this issue 8 months ago • 1 comments

  • Secret references can now be used in the value strings of the connector configuration JSON for transport.config and format.config
  • New Kubernetes Secret reference syntax: ${secret:kubernetes:<name>/<data key>}
  • Syntax allows selecting a specific data key of a Kubernetes Secret
  • Potential expansion to more secret providers in the future
  • Documentation page for secret references
  • Secrets are now mounted under /etc/feldera-secrets

Remaining tasks:

  • [ ] Pass over connector printing in adapters
  • [x] Check that documentation works
  • [x] Determine interaction with suspend-and-resume

snkas avatar Apr 17 '25 15:04 snkas

Updated PR to incorporate feedback from @blp :

  • Resolution limited to transport.config and format.config
  • Use try_exists for file check
  • Add error kind to the resolution error
  • Typo fix

snkas avatar Apr 22 '25 10:04 snkas

Really looking forward to this

brurucy avatar Apr 29 '25 07:04 brurucy