Littlely

pyspark dataframe coverting to koalas dataframe have different elements

5

Code: ``` import databricks.koalas as ks from pyspark import SparkConf from pyspark.sql import SparkSession if __name__ == '__main__': conf = SparkConf().setAppName("test") spark = SparkSession.builder.config(conf=conf).enableHiveSupport().getOrCreate() sdf = spark.sql("select uid,vr_id, gender, follow_count,...

安装完成后运行`from fancy_nlp.applications import NER`出现`RuntimeError: dictionary changed size during iteration` ``` Traceback (most recent call last): File "", line 1, in File "/Users/littlely/myvirtual/tf21/lib/python3.7/site-packages/fancy_nlp/__init__.py", line 7, in from . import utils File...

an error has occurred in pyspark streaming when running about two hours, my code is in the below: ``` def init_create_context(): sc = SparkContext(appName="test") sc.setLogLevel("WARN") ssc = StreamingContext(sc, 60) kafka_params...

model.roberta_model.BertEmbeddings类的forward方法下第一个else中的inputs_embeds没有定义

1

model.roberta_model.BertEmbeddings类的forward方法下第一个else中的inputs_embeds没有定义

spark backend distributed predicting got error

10

my code: ``` res = est.predict(data=train_data.select("embed"), feature_cols=["embed"]) print(f"=====================res: {res}") res.show() ``` The error message: ``` 36/36 [==============================] - 0s 738us/step =====================res: DataFrame[embed: vector, prediction: vector] 22/08/04 16:14:09 ERROR PythonRunner: Python...

Use spark backend got error:NotImplementedError: Saving the model to HDF5 format requires the model to be a Functional model or a Sequential model. It does not work for subclassed models, because such models are defined via the body of a Python method, which isn't safely serializable. Consider saving to the Tensorflow SavedModel format (by setting save_format="tf") or using `save_weights`.

14

Use spark backend got error:NotImplementedError: Saving the model to HDF5 format requires the model to be a Functional model or a Sequential model. It does not work for subclassed models,...

RuntimeError: Horovod detected that one or more processes exited with non-zero status

1

**Environment:** 1. Framework: (TensorFlow, Keras) 2. Framework version:TensorFlow-2.3.0 3. Horovod version:horovod[spark]-0.25.0 4. MPI version:NA 5. CUDA version:NA 6. NCCL version:NA 7. Python version:3.6.5 8. Spark / PySpark version:2.4.6 9. Ray...

make_spark_converter RuntimeError: Vector columns are only supported in pyspark>=3.0

4

I convert pyspark dataframe to two columns: one for feature column, it's a dense vector, and another is a label column. When I transform to tensorflow dataset using `make_spark_converter`, it...

[Bug] [file] Plugin PluginIdentifier{engineType='flink', pluginType='source', pluginName='file'} not found in flink running

2

### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main...