inlong icon indicating copy to clipboard operation
inlong copied to clipboard

[Feature][Tool] Support parallel compilation and packaging

Open featzhang opened this issue 2 years ago • 2 comments

There are two problems with the current project:

  1. When using mvn -B or mvnd to compile the project, various problems will occur and the compilation will fail.
  2. The CR pipeline runs too slowly

To locate the above problem, the analysis is as follows:

  1. Reasons why parallel packaging cannot be done

The inlong-distribution module uses assembly to compress and package the output of each module together. However, the module dependencies are not clearly specified in the pom file, causing maven to infer dependencies.

  1. CR pipeline does not need to generate distribution

Transformation method:

  • [ ] #8242
  1. CR pipeline does not package Distribution
  2. Clear distribution modules and all dependencies in the project

At present, it is being transformed to support multiple versions of Sort Flink, and it is also necessary to clarify the maven coordinates of each Connector

featzhang avatar Apr 04 '23 09:04 featzhang

This issue is stale because it has been open for 60 days with no activity.

github-actions[bot] avatar Jun 04 '23 02:06 github-actions[bot]

This issue is stale because it has been open for 60 days with no activity.

github-actions[bot] avatar Aug 15 '23 01:08 github-actions[bot]

#11440 support parallel building

aloyszhang avatar Nov 26 '24 02:11 aloyszhang