incubator-wayang
incubator-wayang copied to clipboard
apache
Apache Wayang(incubating) is the first cross-platform data processing system.
See what is happening with ENV Python version IDK redirectStreamsToStderr(worker.getInputStream, worker.getErrorStream) https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/PythonProcessCaller.java#L68 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements....
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "github-actions[bot] avatar"){kind=avatar}
create documentation to how to the configuration in the code https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/PythonProcessCaller.java#L46 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See...
How to get the config https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/PythonProcessCaller.java#L41 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed...
cannot be always string, include definition for every operator like: map(udf, inputtype, outputtype) https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/ProcessReceiver.java#L26 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor...
use config buffer size https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/ProcessReceiver.java#L34 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with...
Missing case PortableDataStream https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/ProcessFeeder.java#L99 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this...
use config buffer size https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/ProcessFeeder.java#L63 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with...
add to a config file https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/wayang-api/wayang-api-python/src/main/java/org/apache/wayang/api/python/executor/ProcessFeeder.java#L41 ```java /* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed...
Here we are temporarily assuming that the user is exclusively sending UTF8. User has several types out_iter = batched(func(iterator)) On most of IPv6-ready systems, IPv6 will take precedence. https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/python/src/pywy/platforms/jvm/worker.py#L334 ```python...
First we must receive the operator + UDF print("base64_message") print(base64_message) print (func) for x in func([1, 2, 3, 4, 5, 6, 7, 8, 9, 10]): print(x) https://github.com/apache/incubator-wayang/blob/d859a97d43a8c3c3c964150eaff8f3833e41ea75/python/src/pywy/platforms/jvm/worker.py#L312 ```python # #...