p013570

It is common for Gaffer Schemas to have quite a bit of boiler plate code, such as: - commonly used types - count - time/date - visibility - cardinality Entities...

Create RunScript operation

1

Being able to run arbitrary script from Java would be useful for data conversion and processing. It should not be enabled for public use, but as an enhanced/processing user it...

Create update elements operation

1

Create an operation to update elements. This should probably be handled by Accumulo using a map reduce job.

ProxyStore fails to deserialise JSON for Operations with a generic output type

5

An OperationChain consisting of [GetElements, Limit(10)] has a generic output type of Iterable. This means the Proxy Store doesn't know to deserialise the objects into Elements.

Unable to federate over 2 graphs that have different visibility properties

1

If you create 2 graphs in the FederatedStore with different visibility property names ("visibility1" and "visibility2") then you cannot run a single operation over both graphs at the same time....

Create GetShortestPath operation

2

The GetShortestPath should take a start and end vertex (should it be an EntitySeed or just the vertex value?) It should be configured with a maximum number of hops. It...

ImportRDDOfElements on Accumulo fails when run on a cluster

2

For example: ```scala val addRdd = new ImportRDDOfElements.Builder() .input(elementsRdd) .option("outputPath", "output") .option("failurePath", "failure") .build() graph.execute(addRdd, user) ``` Exception is: ``` Exception in thread "main" java.io.NotSerializableException: uk.gov.gchq.gaffer.accumulostore.key.core.impl.byteEntity.ByteEntityAccumuloElementConverter Serialization stack: - object...

Allow variables to be used in Operation Chains

3

For example: ```json { "class": "GetElements", "input": "${input}", "view": { "edge1": { "preAggregationFilterFunctions": [{ "selection": "count", "predicate": { "class": "IsMoreThan", "value": "${threshold}" } }] } } } ``` This is...

Add protection to our BinaryOperators to prevent objects growing too large

1

Objects like FreqMap should only be used with a small number of keys, otherwise we could end up hitting limits in accumulo/hbase for the size of the rows. In our...

Create system test suite to test Gaffer is deployed correctly on a Accumulo cluster.

1

This would include running all the integration tests and checking things like AddElementsFromHdfs works.