Gaffer
Gaffer copied to clipboard
gchq
A large-scale entity and relation database supporting aggregation of properties
Provide an implementation of the PageRank algorithm using GraphFrames to demonstrate use of the GraphFrames API as a Gaffer operation.
For example: ```scala val addRdd = new ImportRDDOfElements.Builder() .input(elementsRdd) .option("outputPath", "output") .option("failurePath", "failure") .build() graph.execute(addRdd, user) ``` Exception is: ``` Exception in thread "main" java.io.NotSerializableException: uk.gov.gchq.gaffer.accumulostore.key.core.impl.byteEntity.ByteEntityAccumuloElementConverter Serialization stack: - object...
The documentation of Job, and the general title/JavaDoc of JobTracker indicates that, when enabled on a store, the JobTracker should track only Jobs. However, inspection of Store.java (see https://github.com/gchq/Gaffer/blob/1fb6823082ef9dd88f65fab33ac1541e8a2a76cc/core/store/src/main/java/uk/gov/gchq/gaffer/store/Store.java#L389 and...
Addition of predicates to enable validation and filtering against TSV elements.
When run with maven, the RoadTrafficRestApiITs>RoadTrafficTestQueries.checkRoadJunctionsInSouthWestHeavilyUsedByBusesIn2000 test fails intermittently. The error messages seem to indicate that the store is not returning correct number of expected elements: ``` [ERROR] Failures: [ERROR]...
For example: ```json { "class": "GetElements", "input": "${input}", "view": { "edge1": { "preAggregationFilterFunctions": [{ "selection": "count", "predicate": { "class": "IsMoreThan", "value": "${threshold}" } }] } } } ``` This is...
Currently on the right of the page there is a box with an "example value". If you try and run this you get an Exception thrown. It would be good...
Investigate switching to using builder-style setters to remove the need for inner Builder Classes, except where validation is required before creation e.g. Graph.Builder().build()
The RowIdAggregator seems to assume that the column family specifies the group, e.g. group = options.get(AccumuloStoreConstants.COLUMN_FAMILY); and in `IteratorSettingFactory` the `getRowIDAggregatorIteratorSetting` method takes parameters `final AccumuloStore store, final String columnFamily`....
Objects like FreqMap should only be used with a small number of keys, otherwise we could end up hitting limits in accumulo/hbase for the size of the rows. In our...