fluo icon indicating copy to clipboard operation
fluo copied to clipboard

Check for empty table before loading FluoFileOutputFormat file

Open mikewalch opened this issue 10 years ago • 2 comments

A file created by FluoFileOutputFormat has timestamps of zero. This could cause issues if the file was loaded into a non-empty table. A sanity check could be added to stop this. Discovered while reviewing #35

mikewalch avatar Jun 30 '14 20:06 mikewalch

This could be tricky. The map reduce job producing the rfiles does not need to know anything about the Accismus instance where files will eventually be loaded. Would need to require that information so that this check could be done.

keith-turner avatar Jul 15 '14 16:07 keith-turner

One possible way to do this is to add a Fluo API call for loading files into a table. This call would do the sanity check and then make the Accumulo call to bulk load files. Could encourage users to use this API call instead of going to Accumulo directly.

keith-turner avatar Dec 30 '14 17:12 keith-turner