dask-gateway icon indicating copy to clipboard operation
dask-gateway copied to clipboard

Use alembic to version database

Open jcrist opened this issue 6 years ago • 4 comments

To handle potential database migrations, we should be using alembic to manage database versions.

jcrist avatar May 30 '19 14:05 jcrist

Is there a database involved still in the dask-gateway architecture? I see none in the k8s deployment that relies on DaskCluster resources, but perhaps the other deployments of dask-gateway works with a database somehow?

consideRatio avatar Aug 27 '21 02:08 consideRatio

In the case of yarn, the "database" is they key-value store in skein. I don't know about the job schedulers.

martindurant avatar Aug 27 '21 12:08 martindurant

I think you're confusing that with something else Martin. All backends other than the k8s backend store state in a configurable database (similar to jupyterhub). By default this is a local sqlite file. These backends all subclass from DBBackendBase, which handles all the DB logic, see https://github.com/dask/dask-gateway/blob/main/dask-gateway-server/dask_gateway_server/backends/db_base.py.

I still see migrations as something that may be nice to have later, but don't see them as high priority for now.

jcrist avatar Aug 27 '21 13:08 jcrist

Sorry, my mistake

martindurant avatar Aug 27 '21 13:08 martindurant