datawave icon indicating copy to clipboard operation
datawave copied to clipboard

Dependency analysis in gitlab

Open cogross opened this issue 1 year ago • 0 comments

Dependency analysis runs in gitlab updated structure to remove most "unused declared" and "used undeclared" dependencies.

A few still remain that are used that the tool falsely identifies as unused. Notes on those below. I tried using a few different tactics but I wasn't quite able to untangle the dependencies.

locally, run mvn -DignoreNonCompile dependency:analyze to see results.

NOTES datawave-ws-atom needs abdera, axiom-impl, axiom-api, hadoop-client-runtime

datawave-ingest-core needs accumulo-server-base, log4j-core, hadoop-client-runtime, log4japi, log4j-slf4j-impl

datawave-ingest-csv needs datawave-ingest-configuration, accumulo-core is not test only

datawave-ingest-json needs datawave-ingest-configuration, hadoop-mapreducew-client-core/-common

datawave-query-core needs json-simple, jackson-module-jaxb-annotations, lucene-analyzers-common, commons-logging, datawave-ingest-configuration, hadoop-mapreduce-client-core

datawave-ingest-wikipedia needs datawave-ingest-configuration, type-utils not just test only

assemble-datawave

datawave-ops-tools-index-validation needs zookeeper

OLD NOTES datawave-core:

  • removing log4j-slf4j-impl causes org.junit.ComparisonFailure: expected:<[Hash]UID> but was:<[Snowflake]UID> error - UID uses a logger.

datawave-ws-atom:

  • abdera-parser, hadoop-client-runtime, axiom-api, axiom-impl are all required

datawave-ingest-core:

  • accumulo-server-base, log4j-core, hadoop-client-runtime, log4j-api, log4j-slf4j-impl are all required

datawave-ingest-csv:

  • hadoop-mapreduce-client-common, datawave-ingest-configuration are used
  • accumulo-core not just scoped for tests

datawave-ingest-json:

  • hadoop-mapreduce-client-core, hadoop-mapreduce-client-common, datawave-ingest-configurationare all required

datawave-query-core: -hadoop-mapreduce-client-core, json-simple are required

datawave-ws-model:

  • slf4j-api is required
  • authorization-api is not just scoped for tests

datawave-ingest-wikipedia: -datawave-ingest-configuration is required

  • type-utils is not just scoped for tests

datawave-metrics-core:

  • datawave-query-core is required

datawave-ops-tools-config-compare:

  • hadoop-client-runtime is required

datawave-ops-tools-index-validation:

  • zookeeper, guava are required

cogross avatar Oct 23 '23 16:10 cogross