Kai Huang
Kai Huang
We have some released spark whls for spark 2.3: https://sourceforge.net/projects/analytics-zoo/files/zoo-py/ and probably you may have a try? cc @Le-Zheng Or you may use the spark-submit directly to play safe :)
Seems it is an issue due to the cluster 0_0? Is it brought by adding the analytics-zoo jar? If so, can you provide more details (for example the command you...
Similar issue: https://github.com/intel-analytics/BigDL/issues/4410
Same issue as https://github.com/intel-analytics/BigDL/issues/4800?
https://github.com/intel-analytics/BigDL/pull/4494 Friesian fixed here
https://github.com/intel-analytics/BigDL/pull/5692 Fixes Orca. Excludes tests and bert example. Bert has too many many style errors, mostly indent issues, ignored.
@dding3 Please take a look.
> BTW, we need support `merge` operation in Shards, could you add the implementation of `merge` to https://github.com/intel-analytics/BigDL/blob/main/python/orca/src/bigdl/orca/data/shard.py after it's done? https://github.com/intel-analytics/BigDL/pull/5820 already have a PR
> The exception happend as XShards of dataframe doesn't expect empty dataframe for each partition. While in above code, after spark dataframe `join` operatition, the joined spark df(`merged` in the...
> > > > I think with default spark settings, without coalesce, we cannot guarantee each partition is non-empty. But even with coalesce, will it guarantee each partition is non-empty?