yinlice
yinlice
### What happened? 2024-01-30 13:40:10.440 INFO [Thread-966] TaskLog-517-58215-0:183 - 2024-01-30 13:40:10.435 INFO [ job-0] c.w.addax.plugin.writer.hivewriter.HiveWriter$Job:315 - end splitting. 2024-01-30 13:40:10.440 INFO [Thread-966] TaskLog-517-58215-0:183 - 2024-01-30 13:40:10.435 INFO [ job-0] com.wgzhao.addax.core.job.JobContainer:689...
### Search before asking - [X] I had searched in the [feature](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description 完善对接调度平台步骤 ### Usage Scenario _No response_ ### Related issues _No...
java.lang.RuntimeException: 启动 jobserver 失败, Spark App Status：FAILED, 失败原因: java.lang.RuntimeException: Exception in thread "main" java.lang.IllegalArgumentException: Attempt to add (file:///root/tmp/spark-jobserver-config/Test/hive-site.xml) multiple times to the distributed cache. at org.apache.spark.launcher.OutputRedirector.redirect(OutputRedirector.java:67) at java.lang.Thread.run(Thread.java:750) at io.github.melin.spark.jobserver.deployment.YarnSparkDriverDeployer.buildJobServer(YarnSparkDriverDeployer.java:134)...
2023-04-14 10:32:46,511 INFO i.g.m.s.j.s.ClusterManager [check-yarn-app-0] 当前yarn 集群可用内存: 5074MB, 最小需要内存: 4096, 可以调整参数(单位MB): jobserver.yarn.min.memory.mb 2023-04-14 10:32:46,511 INFO i.g.m.s.j.s.ClusterManager [check-yarn-app-0] 当前yarn 集群可用CPU数量: 4143, 最小需要CPU: 5, 可以调整参数: jobserver.yarn.min.cpu.cores 2023-04-14 10:32:46,515 INFO i.g.m.s.j.d.AbstractDriverDeployer [check-yarn-app-0] Get...
如果有一批spark历史任务想要迁移到jobserver上,可以像阿里云EMR作业提交那样 直接指定参数 (jar路径.main-class.配置信息等) ,然后再jobserver上提交吗
hadoop环境需要配置哪些?列的不是很清楚
melin.bee 1.6.0版本不能下载