File operations are painfully slow on AWS EFS

[burakkaraceylan]

Context

Cloud runner with AWS provider strategy creates an EFS and uses it for persistent storage. Backups of Library and LFS as well as retained workspaces are created by tar archiving the entire directories and extracting them when needed. This is extremely slow on EFS and can take up to 40 minutes even with empty Unity projects.

Suggested solution

Use ephemeral storage for operations and utilize s3 for backups.

Additional details

Suggested solution reduced build time of an empty Unity project from 1 hour 20 minutes down to 20 minutes in my tests.

[webbertakken]

Interesting. Have you experienced this too and what do you think @frostebite?