dagster
dagster copied to clipboard
[docs] - Clarify gRPC server and workspace relationship
Summary
Update the Workspace docs to clarify the relationship between gRPC and workspaces. See convo for info.
Dagster Documentation Gap
clarify in the docs the relation between 'running your own gRPC server' and workspaces
This issue was generated from the slack conversation at: https://dagster.slack.com/archives/C01U954MEER/p1639288854082800?thread_ts=1639288854.082800&cid=C01U954MEER
Conversation excerpt:
U02NCH4C86B: Hi, just wondering, suppose several dagster jobs have different requirements.txt in order to execute properly, but I only have 1 dagster instance, what is the recommended way to deal with this? U02P92K2FRQ: Workspaces could help. https://docs.dagster.io/concepts/repositories-workspaces/workspaces#workspaces|https://docs.dagster.io/concepts/repositories-workspaces/workspaces#workspaces U02NCH4C86B: interesting, will check it out U02NCH4C86B: wondering how this feature is tied in together with the grpc ? I see it being mentioned in the same page. Thanks. U016C4E5CP8: Hi Pier - agree this is confusing in the docs. This is because each entry in your workspace loads its own gRPC server (so it has its own python environment). You can have dagit manage those servers for you, or run them yourselves.
This is probably the section that is most relevant for your question: https://docs.dagster.io/concepts/repositories-workspaces/workspaces#multiple-python-environments
If you have two different python environments set up, each with its own executable path, the default run launcher should launch each run in the correct Python environment U016C4E5CP8: <@U018K0G2Y85> docs clarify in the docs the relation between 'running your own gRPC server' and workspaces U018K0G2Y85: Created issue at: https://github.com/dagster-io/dagster/issues/5940
Message from the maintainers:
Are you looking for the same documentation content? Give it a :thumbsup:. We factor engagement into prioritization.