scaper
scaper copied to clipboard
Does fg_spec need to store all provided paths?
I'm generating JAMS annotations for a large dataset of ~500,000 examples. However, the JAMS are quite large when source_file = ('choose', list_of_paths)
. The files are around 1MB in size, which quickly adds up.
Is there a way to have the sandbox not store all provided paths in the corresponding fg_spec? Since the specific source files for each observation are stored in the Annotation array anyway, this seems redundant.