seatunnel
seatunnel copied to clipboard
[Bug] [Source] Temporary files are not ignored
Search before asking
- [X] I had searched in the issues and found no similar issues.
What happened
ignored Temporary files
SeaTunnel Version
2.3.1
SeaTunnel Config
env {
# You can set spark configuration here
# see available properties defined by spark: https://spark.apache.org/docs/latest/configuration.html#available-properties
#job.mode = BATCH
job.name = "SeaTunnel"
spark.executor.instances = 1
spark.executor.cores = 1
spark.executor.memory = "1g"
spark.master = local
}
source {
Hive {
table_name = "test.test_count"
metastore_uri = "thrift://master1:9083"
hdfs_site_path = "/data/conf/cdh/hadoop/hdfs-site.xml"
read_partitions = ["dt=2023-01-01"]
result_table_name = "hive_table"
}
}
transform {
#Sql {
# source_table_name = "hive_table"
# result_table_name = "trans_table"
# query = "select * from hive_table"
#}
}
sink {
console{
}
}
Running Command
seatunnel.sh --config test.conf --deploy-mode local
Error Exception
.hive-staging_hive* Contains data, will dirty read。
Flink or Spark Version
No response
Java or Scala Version
No response
Screenshots
Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Check whether there is a problem PTAL: @EricJoy2048 ,I'll fix it if I can
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.