incubator-wayang
incubator-wayang copied to clipboard
apache
Apache Wayang(incubating) is the first cross-platform data processing system.
Why managing previous and predecessors per separate? https://github.com/apache/incubator-wayang/blob/c25c6561bf786d76d0dc717b28cf15885c269232/python/old_code/pywayang/src/pywy/orchestrator/operator.py#L69 ```python # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file...
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
create reduce by plan_dataquanta_sink.console() https://github.com/apache/incubator-wayang/blob/c25c6561bf786d76d0dc717b28cf15885c269232/python/old_code/pywayang/src/pywy/orchestrator/main.py#L114 ```python # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with #...
create reduce by .reduce_by(reducer) \ .flatmap(lambda elem: elem.split("|")) .map(lambda elem: (elem, elem.split("|"))) \ L_RETURNFLAG 8 L_LINESTATUS 9 L_QUANTITY 4 L_EXTENDEDPRICE 5 discount 6 tax 7 https://github.com/apache/incubator-wayang/blob/c25c6561bf786d76d0dc717b28cf15885c269232/python/old_code/pywayang/src/pywy/orchestrator/execdirectly.py#L114 ```python # # Licensed...
maybe would be better just leave the number as key udf=func, Nevertheless, current configuration runs it over Java To execute the plan directly in the program driver graph.print_adjlist() Separates Python...
key should be given by "udf" UDF specifies reducer function https://github.com/apache/incubator-wayang/blob/c25c6561bf786d76d0dc717b28cf15885c269232/python/old_code/pywayang/src/pywy/orchestrator/dataquanta.py#L104 ```python # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See...
Bumps org.apache.hadoop:hadoop-common from 3.2.4 to 3.4.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.16.3 to 3.25.5. Release notes Sourced from com.google.protobuf:protobuf-java's releases. Protocol Buffers v3.20.3 Java Refactoring java full runtime to reuse sub-message builders and prepare to migrate parsing logic...
Bumps [com.fasterxml.jackson.core:jackson-databind](https://github.com/FasterXML/jackson) from 2.10.0 to 2.12.7.1. Commits See full diff in compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: #...
Currently, the code for reading files remotely through an Http call in the JavaTextFileSource is inside a catch (Exception e): https://github.com/apache/incubator-wayang/blob/31b5a295186f3d6d9ac3e0a18b2adf15b2304cc4/wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/operators/JavaTextFileSource.java#L98 This is problematic because, if a user just passes...
The first iteration on creating a PLAYGROUND for Apache Wayang demos has been created.
