Sonal

build generic junits

3

a lot of junits can be generalized so that they can be used for Spark as well as other frameworks. create a list here of junits which use SparkFrame and...

confusing stacktrace while giving python phases

1

this is a debug messageand should be printed as it will confuse the user java.lang.NullPointerException at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at zingg.spark.core.executor.SparkZFactory.get(SparkZFactory.java:40) at zingg.common.client.Client.setZingg(Client.java:58) at zingg.common.client.Client.(Client.java:43) at zingg.spark.client.SparkClient.(SparkClient.java:22) at zingg.spark.client.SparkClient.getClient(SparkClient.java:47)...

Matcher and Linker names are incorrect

2

should reflect the changed package structure we now have

for users who are running Zingg through Python, assessmodel should be able to give stats based on zinggDir and model id instead of expecting a json

Revisit Integer Similarity, Float and Double

1

Current feature is if (first+second != 0) score = 2.0*Math.abs(first - second)/(first + second); Do we really need the 2?

Python unittest for coverage

2

We want one test that checks if we have covered any method change in Java. It goes over every file in java that has a python api. there is a...

right now the code has ColName.COL_PREFIX all over. We should see whats needed and then improve the code

Current Matcher has the Graph scoring and other graph stuff which makes them tighly coupled. We should move the scoring to a different class. Also think through other graph stuff...

blocking heavily dependent on field order

3

blocking algorithms are currently heavily dependent on field order, giving vastly different results when field order in fedDefinitions is changed. We should make them more consistent.

We add the dataframe to the pipe when we read it, which modifies the original args object. In a way that is ok as we are only enriching the args....