ayon-core icon indicating copy to clipboard operation
ayon-core copied to clipboard

Implement a format representation sequence path function for Loaders

Open BigRoy opened this issue 2 years ago • 2 comments

Is your feature request related to a problem? Please describe.

Many loader plug-ins involved quite some code on finding the right file or file pattern for a sequence. They are trying to construct patterns like:

/path/to/publish/v001/filename.####.exr
/path/to/publish/v001/filename.$F4.exr
/path/to/publish/v001/filename.%04d.exr
/path/to/publish/v001/filename.<f>.exr
/path/to/publish/v001/filename.<udim>.exr
/path/to/publish/v001/filename.<udim>.<f>.exr

These currently all appear to be implemented over and over again, and also appear to parse this data from the filename itself even though most of these frames or udims or alike is information that was available at the time of publish.

Some examples

A lot of these implementations have many points of failures. E.g. most of the os.listdir usages don't even check whether the result is a file and has the right extension - it might just pick up any other file in that folder instead. But the essence of what they are trying to do is mostly the same, and its detecting and formatting the following:

  • Do the files exist?
  • Are they a sequence of files or a single file?
  • What kind of tokens are in the filename?
  • And then last format the path so the token is the way we need for our loader, e.g. changing frame in #### or <f> or $F4 etc.

Describe the solution you'd like

I'd like a single recommended (and documented) approach on how a loader should retrieve the files of the publish and preferably even expose get_representation_sequence or format_representation_path or something along those lines that would make this loading logic of sequences in a certain way easily manageable for the developer implementing a Loader plugin.

The tricky bit is if the function itself formats the path like e.g. /path/to/publish/v001/filename.%04d.exr that would make it non-trivial for the loader plugin developer to detect whether the files exist on disk or not. So we might need to consider also returning the full paths easily.

Describe alternatives you've considered

The alternative is to pick one of the different implementations found in the codebase and use one, but they don't seem foolproof and generally result in many lines of code extra to maintain in a loader.

Additional context

There is an existing get_representation_path function which I believe returns the first filepath of the representation.

[cuID:OP-4791]

BigRoy avatar Jan 21 '23 09:01 BigRoy