dolphinscheduler
dolphinscheduler copied to clipboard
SQL component, parameter passing problem when the custom parameter is LIST
Search before asking
- [X] I had searched in the issues and found no similar feature requirement.
Description
下一个节点的配置如下
实际日志如下
请问如何可以获取到dataList的数据呢
Documentation Links
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Search before asking
- [X] I had searched in the issues and found no similar feature requirement.
Description
The configuration of the next node is as follows
The actual log is as follows
How can I get the data of dataList?
Documentation Links
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Right now, we only support transport the value by column.
If you have two column in your table t_screen
, you need to add two param.
It is a usefully feature if we can directly transport the whole output result of the task.
I think this may be a large feature? For online SQL query, such as MySQL, PostgreSQL, which can return results within seconds level, we can directly use network for transport. For offline SQL query, which is calculated by distributed ETL engine, like HIVE, SPARK, FLINK, the results can be read from other source? like DFS, MQ, etc.
关于产品,目前HTTP组件不支持从上游系统传输数据过来;刚好目前我们有这个方面的需求。不知道后续的产品规划中有没得这个功能,如果没有的话,我这边能否完善这个功能点,提交到官方?
I've just recently started learning about this software. Can someone please help me understand how to add multiple records to a database after querying them using the SQL module? 我最近才刚开始了解这个软件,那位大佬可以帮忙告诉我 使用SQL 模块 查询除了多条数据之后 应该怎么添加到数据库
sql是否适合大数据量的传输,看代码数据是放到varpool这个字段中的
,最终还会保存到库里。