scaper icon indicating copy to clipboard operation
scaper copied to clipboard

Does fg_spec need to store all provided paths?

Open sripathisridhar opened this issue 2 years ago • 0 comments

I'm generating JAMS annotations for a large dataset of ~500,000 examples. However, the JAMS are quite large when source_file = ('choose', list_of_paths). The files are around 1MB in size, which quickly adds up.

Is there a way to have the sandbox not store all provided paths in the corresponding fg_spec? Since the specific source files for each observation are stored in the Annotation array anyway, this seems redundant.

sripathisridhar avatar Mar 05 '22 15:03 sripathisridhar