zingg icon indicating copy to clipboard operation
zingg copied to clipboard

febrl example runs slow on docker

Open sonalgoyal opened this issue 2 years ago • 4 comments

Describe the bug febrl example takes a long time

Expected behavior same time on docker as local machine

sonalgoyal avatar Jun 21 '22 09:06 sonalgoyal

most likely this is happening as memory is not getting set. SPARK_MEM?

sonalgoyal avatar Jul 19 '22 05:07 sonalgoyal

driver memory, executor

sonalgoyal avatar Jul 19 '22 05:07 sonalgoyal

pass on env variables for above

sonalgoyal avatar Jul 19 '22 05:07 sonalgoyal

this should be sorted as the conf can now be passed programmatically

sonalgoyal avatar Jul 26 '22 11:07 sonalgoyal