fire-spark
fire-spark copied to clipboard
Spark 脚手架工程,标准化 spark 开发、部署、测试流程。
Bumps [protobuf-java](https://github.com/protocolbuffers/protobuf) from 2.5.0 to 3.16.3. Release notes Sourced from protobuf-java's releases. Protobuf Release v3.16.3 Java Refactoring java full runtime to reuse sub-message builders and prepare to migrate parsing logic...
Bumps hadoop-common from 3.0.0 to 3.2.4. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
Bumps commons-email from 1.4 to 1.5. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands...
Bumps httpclient from 4.5 to 4.5.13. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands...
Sink引用报错
1:方便加你的微信吗? 2: 这个脚手架真棒,不过我在使用的时候遇到一个问题,就是无法yin'yong引用你的sink, 请问正确的引用sink的姿势是什么呀?(我的代码还比较差,麻烦你写详细点,谢谢!) 详细报错如下: Error:(51, 17) overloaded method value output with alternatives: (rdd: org.apache.spark.rdd.RDD[Nothing],time: org.apache.spark.streaming.Time)Unit (dStream: org.apache.spark.streaming.dstream.DStream[Nothing])Unit cannot be applied to (org.apache.spark.rdd.RDD[String]) hBaseSink.output(rdd) image @platypus0127
Bumps [junit](https://github.com/junit-team/junit4) from 4.12 to 4.13.1. Release notes Sourced from junit's releases. JUnit 4.13.1 Please refer to the release notes for details. JUnit 4.13 Please refer to the release notes...
判断当前partition是否Empty
Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 2.5.0 to 3.25.5. Release notes Sourced from com.google.protobuf:protobuf-java's releases. Protocol Buffers v3.20.3 Java Refactoring java full runtime to reuse sub-message builders and prepare to migrate parsing logic...