libhdfs3

libhdfs3 copied to clipboard

The proto used in this project should be copied from the official website. What is the corresponding version?

cs-moushuai

clickhouse version 23, connect hdfs error

1

CREATE TABLE guandata.of0b4be941d9_0( `id`Nullable(Int32), `customer_name`Nullable(String), `comments`Nullable(String) )ENGINE=HDFS('hdfs://nameserver1/guandata-store/of0b4/part-000.snappy.parquet','Parquet') select * from guandata.of0b4be941d9_0; When I execute the SQL query, ClickHouse reports an error. > connection reset by peer: While executing ParquetBlockInputFormat: While...

jdxia

I already submitted the issue to the mentioned gohdfs library: https://github.com/colinmarc/hdfs/issues/313 When I try writing a simple csv file (initially, I tried parquet to the same effect), the file written...

knl

hdfsBuilderSetPrincipal doesn't work

2

Hi Team, I got an error like this : ``` 2021-03-14 14:10:20.339761, p16581, th139969607461248, INFO Retrying connect to server: "hadoopc1h5:25000". Already tried 9 time(s) 2021-03-14 14:10:22.359599, p16581, th139969607461248, ERROR Failed...

youngfn

fix compile failed caused by sse4_2

1

CentOS-7 gcc 11  

hfutatzhanghb

Fixes issue [#45](https://github.com/ClickHouse/libhdfs3/issues/45)

gfrontera

We have recently fixed a bug in libhdfs3 regarding libgsasl, allowing it to connect to HDFS clusters with secure mode enabled. We have also replaced libgsasl with cyrus_SASL to support...

victorlw1

Since int64_t StripedBlockUtil::getInternalBlockLengt returns int64_t https://github.com/ClickHouse/libhdfs3/blob/d0ae7d2568151feef61d3ec7896803262f0e0f91/src/client/StripedBlockUtil.cpp#L117-L134 and only dataSize has int64_t there could be integer overflow at: https://github.com/ClickHouse/libhdfs3/blob/d0ae7d2568151feef61d3ec7896803262f0e0f91/src/client/StripedBlockUtil.cpp#L132-L134 Possible fix: cast one of member of adddition to int64_t

stasos24

assert failed when use pread

1

https://[s3.amazonaws.com/clickhouse-test-reports/69862/331872a7e496cdd9d6420f989eb73d5aa5a1afee/stateless_tests__debug__s3_storage_/stderr.log](https://s3.amazonaws.com/clickhouse-test-reports/69862/331872a7e496cdd9d6420f989eb73d5aa5a1afee/stateless_tests__debug__s3_storage_/stderr.log) assertion will failed, when use pread

liuneng1994