datastore-mapper icon indicating copy to clipboard operation
datastore-mapper copied to clipboard

Published 20 hours ago • verified publisher icon CaptainCodeman

Optimize output writer

Open CaptainCodeman opened this issue 9 years ago • 1 comments

Existing rolled-up files can be skipped, single file rollups can be done as a move (or copy/delete) and rollup needs to handle the number of source files being over the cloud storage rollup limit (i.e. perform iterative rollup).

CaptainCodeman avatar Jul 11 '16 19:07 CaptainCodeman

Rollup of > 32 files is now supported.

Need to detect or handle rollup where the total number of segments is > 1024 by re-writing the file(s) into a new one.

CaptainCodeman avatar Feb 22 '17 14:02 CaptainCodeman