Zoi Kaoudi

WordCount using Flink not working

1

I tried to run the Wordcount with Flink and got this error: Exception in thread "main" org.apache.wayang.core.api.exception.WayangException: Executing T[FlinkReduceBy[Add counters]] failed. at org.apache.wayang.flink.execution.FlinkExecutor.execute(FlinkExecutor.java:113) at org.apache.wayang.core.platform.PushExecutorTemplate.execute(PushExecutorTemplate.java:73) at org.apache.wayang.core.platform.PushExecutorTemplate$StageExecution.execute(PushExecutorTemplate.java:195) at org.apache.wayang.core.platform.PushExecutorTemplate$StageExecution.doExecute(PushExecutorTemplate.java:166) at...

Revisit benchmark jobs

2

The jobs in the wayang-benchmark module need to be rewritten/cleaned: either because they are using the foundational java plan building way (the Java ones) or because they are using some...

Code restructure

9

Currently, there are some modules that the source code is not in the usual path of "[module_name]/src/main/java" but inside a "code" folder. This is not the case for all modules....

Currently, the code for reading files remotely through an Http call in the JavaTextFileSource is inside a catch (Exception e): https://github.com/apache/incubator-wayang/blob/31b5a295186f3d6d9ac3e0a18b2adf15b2304cc4/wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/operators/JavaTextFileSource.java#L98 This is problematic because, if a user just passes...