incubator-wayang
incubator-wayang copied to clipboard
apache
Apache Wayang(incubating) is the first cross-platform data processing system.
Add sample method https://github.com/apache/incubator-wayang/blob/d44a00a45f2e3ab9b2abd08a1b4c1aa94750a3f1/wayang-api/wayang-api-json/src/main/scala/operatorfromjson/unary/SampleOperatorFromJson.scala#L35 ```scala /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this...
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
This is a draft pull request. I wanted to test the added function readKafkaTopic(topicName: String) which is new in the JavaPlanBuilder. Here is my test code: import org.apache.wayang.api.JavaPlanBuilder; import org.apache.wayang.basic.data.Tuple2;...
I have added the logging functionality to the CsvRowConverter. Also added the CsvRowConverterTest.java to test the thing. Tested with: mvn compile test -Dlog4j2.level=DEBUG Shows: [INFO] ------------------------------------------------------- [INFO] T E S...
This issue is related to #386 . **In this issue we want to identify the scope of Apache Wayang - Apache Kafka support.** Apache Kafka does not offer a processing...
This is a PR to prep the release v1.0.0. I started working on this, using the original repository, not a clone, but due to missing permissions I can't push directly....
In order to read text input files from remote sources like SOLID Datapods I added this functionality to the JavaTextSource.
This PR provides a short .md-guide that shows an examplory usage of the previously introduced abstraction of the cost model. The guide shows how it can be utilized in order...
other parameters https://github.com/apache/incubator-wayang/blob/f8d4a8efb107a2073f2c8ac4dedc0fb4b0474859/wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/operators/LinearRegressionOperator.java#L32 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work...
Currently, there are some modules that the source code is not in the usual path of "[module_name]/src/main/java" but inside a "code" folder. This is not the case for all modules....
Besides the following processing platforms: [Java 8 Streams] [Apache Spark](https://spark.apache.org/) [GraphChi](https://github.com/GraphChi/graphchi-java) [Postgres](http://www.postgresql.org/) [SQLite](https://www.sqlite.org/) [Apache Flink](https://flink.apache.org/) it is suggested to also support Apache Kafka. This issue is considered to be an...