[Bug] [DEPLOY] docker compose up worker started failed tag dev

[zhyyyq]

Search before asking

• [ ] I had searched in the issues and found no similar issues.

What happened

Caused by: org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'org.apache.dolphinscheduler.plugin.storage.api.StorageOperator' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {}

	at org.springframework.beans.factory.support.DefaultListableBeanFactory.raiseNoMatchingBeanFound(DefaultListableBeanFactory.java:1801)

	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1396)

	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)

	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:887)

	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:791)

	... 47 common frames omitted

docker compose image tag dev

What you expected to happen

worker started properly

How to reproduce

docker compose --profile all up -d

Anything else

No response

Version

dev

Are you willing to submit PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [x] I agree to follow this project's Code of Conduct

[SbloodyS]

docker-compose deployment needs to be optimized.

[caosuwenwu]

+1

[delei]

The main reason for the problem is the missing dolphinscheduler-storage-hdfs plugins. Since the default storage type is LOCAL, you need to install the dolphinscheduler-storage-hdfs plugin first.

Temporary Solution

1. For the Docker environment, you can manually download the dolphinscheduler-storage-hdfs jar file and place it in the local directory.

2. BTW, as mentioned in the issue #17370 , you also need to download htrace-core4 jar file at the same time.

3. Modify docker-compose.yml and mount the plugins directory to the dolphinscheduler-worker container.

For example:

dolphinscheduler-worker:
    image: ${HUB}/dolphinscheduler-worker:${TAG}
    profiles: ["all"]
    env_file: .env
    healthcheck:
      test: [ "CMD", "curl", "http://localhost:1235/actuator/health" ]
      interval: 30s
      timeout: 5s
      retries: 3
    depends_on:
      dolphinscheduler-zookeeper:
        condition: service_healthy
    volumes:
      - dolphinscheduler-worker-data:/tmp/dolphinscheduler
      - dolphinscheduler-logs:/opt/dolphinscheduler/logs
      - dolphinscheduler-shared-local:/opt/soft
      - dolphinscheduler-resource-local:/tmp/dolphinscheduler
      - ./conf/plugins:/opt/dolphinscheduler/plugins
    networks:
      - dolphinscheduler

[delei]

docker-compose deployment needs to be optimized.

Hi, @SbloodyS

Currently, the plugins folder in the provided image is empty. We may need to improve the documentation or include plugin dolphinscheduler-storage-hdfs in the image file by default.