feat: Migrate container registries from `etcd` to `postgreSQL`

[jopemachine]

Checklist: (if applicable)

• [ ] Milestone metadata specifying the target backport version
• [x] Mention to the original issue
• [x] Installer updates including:
  • Fixtures for db schema changes
  • New mandatory config options
• [ ] Update of end-to-end CLI integration tests in ai.backend.test
• [ ] API server-client counterparts (e.g., manager API -> client SDK)
• [x] Test case(s) to:
  • Demonstrate the difference of before/after
  • Demonstrate the flow of abstract/conceptual models with a concrete implementation
• [ ] Documentation
  • Contents in the docs directory
  • docstrings in public interfaces and type annotations

Resolves https://github.com/lablup/backend.ai/issues/1907

Changes

• Migrate container registry schema and data from etcd to PostgreSQL
• Update ContainerRegistry graphql API argument from hostname to id (UUID)
• hostname is changed into registry_name
• Add is_global column to the ContainerRegistry table

[jopemachine]

Just a little suggestion about type hint in is_known_registry(). How about accepting only dict (or Mapping) type as known_registries parameter? Please enlighten me how the known_registries looks like in list type and dict type

dict example:

{'stable': {'cr.backend.ai': URL('https://cr.backend.ai')}, 'community': {'cr.backend.ai': URL('https://cr.backend.ai')}, 'multiarch': {'cr.backend.ai': URL('https://cr.backend.ai')}}

list example:

 ['cr.backend.ai']

Note: list is not aware of project unlike dict type here as you see above example.

[kyujin-cho]

I am postponing milestone to 24.09. We managed to meet our internal deadline for per-user image customization feature (#1973). From now on, at this PR, let's focus on forming concrete definitions and stabilizing things rather than rushing for the merge approval.

[jopemachine]

• #2831
• #2665
• #2624
• #2623
• #2622
• #2621
• #2815
• #2620
• #2615
• #2707
• #1917 👈
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @jopemachine and the rest of your teammates on Graphite

[github-actions[bot]]

Backport to 24.03 is failed. Please backport manually.