airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

[connector builder design] Schema auto detection

Open girarda opened this issue 2 years ago • 7 comments

  • what is the UI experience if the user runs their first test, before they ever specified the stream schema?
  • What is the experience if they run a request whose schema does not exactly match the currently defined schema?
  • How can connector developer amend the detected schema?

Link to prototype

girarda avatar Dec 19 '22 21:12 girarda

Image

Upmitt avatar Dec 20 '22 14:12 Upmitt

Schema detection research: https://www.figma.com/file/F1ljvrJerLoVbNvtejBWid/LOW-CODE-CONNECTOR-BUILDER?node-id=3589%3A124527

Upmitt avatar Jan 10 '23 09:01 Upmitt

comments from today's sync:

  • it would be useful to add a warning in the defined schema text box when there is a diff with the inferred one

girarda avatar Jan 11 '23 00:01 girarda

Is it a warning we should also display in the left menu, next to the stream name?

Upmitt avatar Jan 17 '23 13:01 Upmitt

Update from today's sync:

  • We should only add a warning to the left-side and middle panels if the user's schema is incompatible with the detected schema
  • The right-side testing panel can always have a warning if the user schema does not match the detected schema

girarda avatar Jan 17 '23 21:01 girarda

Figma updated: https://www.figma.com/file/F1ljvrJerLoVbNvtejBWid/LOW-CODE-CONNECTOR-BUILDER?node-id=3589%3A124527

Upmitt avatar Jan 31 '23 14:01 Upmitt

Update from today's sync:

  • Make the schema difference warning "info" color instead of "warning" color, since it might be wanted by the user
  • Only show an icon for schema differences on the left-sidebar once we have the ability to determine if the declared and detected schemas are actually incompatible. Don't show the icon if the declared schema is just broader than the detected.

lmossman avatar Feb 01 '23 16:02 lmossman

closing in favor of https://github.com/airbytehq/airbyte/issues/25321

girarda avatar May 01 '23 21:05 girarda