datalab icon indicating copy to clipboard operation
datalab copied to clipboard

Suggestion: Index or registry of deployments

Open ml-evs opened this issue 2 years ago • 1 comments

It might be nice to encourage deployments to announce themselves, via an (opt-out?) feature that pings some "datalab registry" somewhere with a daily heartbeat containing the public deployment stats. This is somewhat required to ensure that prefixes are unique across deployments.

This registry can display metadata about that deployment (who is running it, who can use it etc.) and could eventually become a way of sharing custom schemas between all instances.

ml-evs avatar Nov 02 '23 11:11 ml-evs

This could just run as a simple open-source app hosted somewhere like Fly so people can transparently see what we're doing with the data (see e.g., https://github.com/marda-alliance/metadata_extractors_registry as a template)

ml-evs avatar Nov 02 '23 11:11 ml-evs

This essentially exists as https://github.com/datalab-org/datalab-federation

ml-evs avatar Oct 09 '24 13:10 ml-evs