dify icon indicating copy to clipboard operation
dify copied to clipboard

After upgrading to Dify 1.4.0, the WebScraper tool cannot be worked.

Open gsm1258 opened this issue 7 months ago • 8 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

1.4.0

Cloud or Self Hosted

Cloud

Steps to reproduce

After upgrading to Dify 1.40, when creating a new workflow and using the webscraper tool, this node displays the error message: "Failed to transform tool message: Command '['node', 'ExtractArticle.js', '-i', '/tmp/tmp58op_ej_', '-o', '/tmp/tmp58op_ej_.json']' returned non-zero exit status 1."

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

gsm1258 avatar May 15 '25 12:05 gsm1258

Hello @gsm1258! I'm Dosu, your friendly bot here to help you with bugs, questions, and anything else you might need while you wait for a human maintainer. Let's tackle this issue together! 🚀

The error message you're encountering indicates that the ExtractArticle.js script is failing to execute properly. The command node ExtractArticle.js -i /tmp/tmp58op_ej_ -o /tmp/tmp58op_ej_.json is returning a non-zero exit status, which typically means there is an error in the script execution.

Here are a few steps you can take to troubleshoot this issue:

  1. Check Node.js Installation: Ensure that Node.js is properly installed and accessible in your environment. You can verify this by running node -v in your terminal to check the version.

  2. Script Debugging: If you have access to the ExtractArticle.js script, try running it manually with the same input and output arguments to see if any specific error messages are displayed. This might give you more insight into what is going wrong.

  3. Dependencies: Make sure all necessary dependencies for the script are installed. If the script uses any Node.js packages, ensure they are installed by running npm install in the directory containing ExtractArticle.js.

  4. File Permissions: Check the permissions of the temporary files being used (/tmp/tmp58op_ej_ and /tmp/tmp58op_ej_.json). Ensure that the script has the necessary permissions to read from and write to these files.

  5. Error Logs: Look for any logs or error messages that might be generated by the script or the Dify platform. These logs can provide additional context about the failure.

If these steps do not resolve the issue, it might be helpful to check if there are any known issues or updates related to the WebScraper tool in the Dify 1.4.0 release notes or documentation.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

dosubot[bot] avatar May 15 '25 12:05 dosubot[bot]

I am running it on the official Dify cloud platform, so there is no configuration issue. Please resolve the compatibility problem as soon as possible.

gsm1258 avatar May 15 '25 13:05 gsm1258

Hi @gsm1258. I can't reproduce this issue. Could you please provide more detailed information?

laipz8200 avatar May 15 '25 14:05 laipz8200

Image

Image

gsm1258 avatar May 15 '25 14:05 gsm1258

I’ve looked into the issue, and we’ll need some time to fix it. In the meantime, I recommend trying out similar plugins available in our marketplace, such as Jina Reader. Thanks for your patience!

laipz8200 avatar May 15 '25 16:05 laipz8200

Image I have the same problem

austincityuwen avatar May 17 '25 11:05 austincityuwen

have the same issue

AmintaCCCP avatar May 20 '25 16:05 AmintaCCCP

same issue

zhibinQiu avatar May 21 '25 01:05 zhibinQiu

have the same issue

a506488043 avatar May 24 '25 13:05 a506488043

have the same issue

chenkunlong avatar May 26 '25 09:05 chenkunlong

have the same issue

hingbong avatar May 27 '25 08:05 hingbong

After testing, version 1.4.1 has fixed this issue.

createskyblue avatar May 29 '25 04:05 createskyblue