aws-rfdk icon indicating copy to clipboard operation
aws-rfdk copied to clipboard

Support for NFS filesystems in Deadline Render Farm

Open ddneilson opened this issue 4 years ago • 0 comments

This is a feature request for support of NFS filesystems within the Deadline render farm. Specifically, for use as the Repository Filesystem and support for using one as an asset filesystem on worker nodes.

Use Case

Basically flexibility. The current default EFS filesystem for the repository filesystem can become a bottleneck under certain extreme workloads. In these cases the ability to switch to a different filesystem type is required to get past the bottleneck.

Proposed Solution

The interface that the RFDK provides for the Repository's filesystem is generic enough to support other filesystem types; they just need to have integrations created for them.

An initial solution for NFS support is implemented in -- https://github.com/ddneilson/aws-rfdk/tree/mountable_nfs -- however it is not yet ready for integration into the RFDK. Specifically, the MountableNfs class -- https://github.com/ddneilson/aws-rfdk/blob/mountable_nfs/packages/aws-rfdk/lib/core/lib/mountable-nfs.ts This solution specifically only supports insecure/unauthenticated NFS.

The solution should support authenticated users (ex: kerberos) before becoming a part of the RFDK, but that requires work on integrating authentication providers into the RFDK first.

Other

Note: To use the MountableNfs that is in the fork, simply create an instance of MountableNfs and pass it as the fileSystem property on the deadline.Repository construct.

  • [ ] :wave: I may be able to implement this feature request
  • [ ] :warning: This feature might incur a breaking change

This is a :rocket: Feature Request

ddneilson avatar Oct 22 '20 17:10 ddneilson