Feature Request Collection for WorkGraph

[superstar54]

To gain an overall view of feature requests related to WorkGraph, I'm opening this issue to collect and track them in one place. While creating individual issues for each request is also beneficial, this list will help maintain an overview, especially since some of these issues are interrelated. I want to ensure developers can easily locate relevant feature requests without having to sift through hundreds of other issues.

Feature Requests

Note: this list will be continuously updated.

• [ ] Allow Passing Parent PID to the Process During instantiate_process:
  In aiida-core, this is handled automatically. However, in WorkGraph, we need more control over this process to ensure proper task scheduling.

• [ ] Enable Submission of calcfunction and workfunction to the Daemon:
  This feature would prevent these functions from blocking the scheduling and response of processes.

• [ ] Support multiple queues We may want a process (Scheculer) to listen to a task queue that is different from the default one. kiwipy supports it, but in aiida-core, we always use the default one, and does not expose the API for selecting queues, e.g., in manager.create_daemon_runner., RemoteProcessThreadController.task_send

Discussion and Implementation

We can discuss whether to implement these features directly in aiida-core or elsewhere. If anyone is interested in taking on any of the above features, please feel free to proceed.