datalab
datalab copied to clipboard
Suggestion: Index or registry of deployments
It might be nice to encourage deployments to announce themselves, via an (opt-out?) feature that pings some "datalab registry" somewhere with a daily heartbeat containing the public deployment stats. This is somewhat required to ensure that prefixes are unique across deployments.
This registry can display metadata about that deployment (who is running it, who can use it etc.) and could eventually become a way of sharing custom schemas between all instances.
This could just run as a simple open-source app hosted somewhere like Fly so people can transparently see what we're doing with the data (see e.g., https://github.com/marda-alliance/metadata_extractors_registry as a template)
This essentially exists as https://github.com/datalab-org/datalab-federation