dolphinscheduler icon indicating copy to clipboard operation
dolphinscheduler copied to clipboard

Published 20 hours ago • verified publisher icon apache

[Bug] Insufficient permissions after version 3.1.8 upgrade to 3.2.0

Open Johp-t opened this issue 1 year ago • 4 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

After upgrading from version 3.1.8 to 3.2.0, an error is encountered in the execution of the Datax workflow:

/tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362_job.json [INFO] 2024-05-10 14:24:08.541 +0800 - Executing shell command : sudo -u dolphinscheduler -i /tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362.sh [INFO] 2024-05-10 14:24:08.543 +0800 - process start, process id is: 10664 [INFO] 2024-05-10 14:24:09.548 +0800 - ->

DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.


Usage: datax.py [options] job-url-or-path

Options:
  -h, --help            show this help message and exit

  Product Env Options:
    Normal user use these options to set jvm parameters, job runtime mode
    etc. Make sure these options can be used in Product Env.

    -j <jvm parameters>, --jvm=<jvm parameters>
                        Set jvm parameters if necessary.
    --jobid=<job unique id>
                        Set job unique id when running by Distribute/Local
                        Mode.
    -m <job runtime mode>, --mode=<job runtime mode>
                        Set job runtime mode such as: standalone, local,
                        distribute. Default mode is standalone.
    -p <parameter used in job config>, --params=<parameter used in job config>
                        Set job parameter, eg: the source tableName you want
                        to set it by command, then you can use like this:
                        -p"-DtableName=your-table-name", if you have mutiple
                        parameters: -p"-DtableName=your-table-name
                        -DcolumnName=your-column-name".Note: you should config
                        in you job tableName with ${tableName}.
    -r <parameter used in view job config[reader] template>, --reader=<parameter used in view job config[reader] template>
                        View job config[reader] template, eg:
                        mysqlreader,streamreader
    -w <parameter used in view job config[writer] template>, --writer=<parameter used in view job config[writer] template>
                        View job config[writer] template, eg:
                        mysqlwriter,streamwriter

  Develop/Debug Options:
    Developer use these options to trace more details of DataX.

    -d, --debug         Set to remote debug mode.
    --loglevel=<log level>
                        Set log level such as: debug, info, all etc.
/tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362.sh:行4: /tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362_job.json: 权限不够

What you expected to happen

I hope it works out.

How to reproduce

version 3.1.8 upgrade to 3.2.0

Anything else

No response

Version

3.2.x

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

Johp-t avatar May 10 '24 06:05 Johp-t

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

After upgrading from version 3.1.8 to 3.2.0, an error is encountered in the execution of the Datax workflow:

/tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362_job.json [INFO] 2024-05-10 14:24:08.541 +0800 - Executing shell command : sudo -u dolphinscheduler -i /tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362.sh [INFO] 2024-05-10 14:24:08.543 +0800 - process start, process id is: 10664 [INFO] 2024-05-10 14:24:09.548 +0800 - ->

DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.


Usage: datax.py [options] job-url-or-path

Options:
  -h, --help            show this help message and exit

  Product Env Options:
    Normal user use these options to set jvm parameters, job runtime mode
    etc. Make sure these options can be used in Product Env.

    -j <jvm parameters>, --jvm=<jvm parameters>
                        Set jvm parameters if necessary.
    --jobid=<job unique id>
                        Set job unique id when running by Distribute/Local
                        Mode.
    -m <job runtime mode>, --mode=<job runtime mode>
                        Set job runtime mode such as: standalone, local,
                        distribute. Default mode is standalone.
    -p <parameter used in job config>, --params=<parameter used in job config>
                        Set job parameter, eg: the source tableName you want
                        to set it by command, then you can use like this:
                        -p"-DtableName=your-table-name", if you have mutiple
                        parameters: -p"-DtableName=your-table-name
                        -DcolumnName=your-column-name".Note: you should config
                        in you job tableName with ${tableName}.
    -r <parameter used in view job config[reader] template>, --reader=<parameter used in view job config[reader] template>
                        View job config[reader] template, eg:
                        mysqlreader,streamreader
    -w <parameter used in view job config[writer] template>, --writer=<parameter used in view job config[writer] template>
                        View job config[writer] template, eg:
                        mysqlwriter,streamwriter

  Develop/Debug Options:
    Developer use these options to trace more details of DataX.

    -d, --debug         Set to remote debug mode.
    --loglevel=<log level>
                        Set log level such as: debug, info, all etc.
/tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362.sh:行4: /tmp/dolphinscheduler/exec/process/dolphinscheduler/12899597581952/13432672120965_2/2121/14362/2121_14362_job.json: 权限不够

What you expected to happen

I hope it works out.

How to reproduce

version 3.1.8 upgrade to 3.2.0

Anything else

No response

Version

3.2.x

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

github-actions[bot] avatar May 10 '24 06:05 github-actions[bot]

This may be a file permission bug, please try 3.2.1.

ruanwenjun avatar May 10 '24 06:05 ruanwenjun

@ruanwenjun 3.2.1 There's a problem turning the pages. Any ideas?

Johp-t avatar May 10 '24 08:05 Johp-t

@ruanwenjun 3.2.1 There's a problem turning the pages. Any ideas?

Or you can manually fix this by following the dev branch, this should already be fixed.

ruanwenjun avatar May 10 '24 11:05 ruanwenjun

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Jun 10 '24 00:06 github-actions[bot]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

github-actions[bot] avatar Jun 17 '24 00:06 github-actions[bot]