airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Implement AIP-60 Dataset URI formats

Open uranusjr opened this issue 1 year ago • 1 comments

I’m struggling with documentation, and have yet to implement actual sanitisation logic. And it seems like a lot of the URIs (especially file-like ones) don’t actually need any validation at all? But this implements a basic structure.

uranusjr avatar Jan 25 '24 04:01 uranusjr

Finally got this to a point I’m somewhat satisfied with. The logic should be mostly there. Not exactly sure about docs yet, please provide some ideas on where to add things.

uranusjr avatar Feb 02 '24 05:02 uranusjr

The providers will be fine even if we release this with 2.9—since URIs without a registered scheme is silently treated as plain strings, they will work like they did in 2.8 and prior, aside from some new additional validations (e.g. no auth in the URI—but you shouldn’t do that in the first place anyway).

Good point about the fragment, I’ll add one.

uranusjr avatar Feb 22 '24 08:02 uranusjr

I expanded the documentation a bit, and added a news fragment as suggested above.

uranusjr avatar Feb 22 '24 10:02 uranusjr