Loki issues

Repositories
Issues
Comments

Results 2 issues of


                                            Loki

There are 1 datanode(s) running and 1 node(s) are excluded in this operation

Hi, when I try to write parquet file into HDFS, I have below issue: File /data_set/hello/crm_last_month/2534cb7a-fc07-401e-bdd3-2299e7e657ea.parquet could only be replicated to 0 nodes instead of minReplication (=1). There are 1...

一个小建议

判断文件是否更新： 1. 把本地目录的文件的更新时间创建一个 dict，文件名为key，更新时间为 value。 2. 每次重新upload文件到oss的时候，把当前文件的更新时间和保存的dict做比对。 3. 如果当前文件的值不存在，或者当前文件的更新时间晚于dict里对应的值，则去上传。