datawave
datawave copied to clipboard
DataWave is an ingest/query framework that leverages Apache Accumulo to provide fast, secure data access.
MarkingFunctionsFactory.createMarkingFunctions() ocassionally fails and returns a null. One of the reasons is a VFS / HDFS error. If the failure (null) is cached in a static member of a classs,...
* Simplified any logic looking for nested documents
Updated the ivarator mechanisms to cleanup directories when they are done. This has resulted in collapsing the directory structure. However since they are now deleted when done we should be...
* Added comment explaining why we do not persist the ivarator set in some situations.
* Pass in the Query to the getUserOperations call for potential filtering
DROP state for normalization was originally intended to prevent the errant value from being indexed. However, we are dropping the field from the event altogether which is not correct.
Some efficiency gains by not performing JexlEvaluation for all edge definitions on an event that doesn't even contain the necessary fields, general cleanup, etc.
A couple of ingest scripts were incorrectly quoting regexs so in addition to fixing those, the legacy backticks were also removed in favor of the current $() syntax.