bug: Using stage to query or import ORC from object storage exception

[xujinlong0314]

Search before asking

• [X] I had searched in the issues and found no similar issues.

Version

1.2.530

What's Wrong?

Using stage to query or import ORC from object storage exception

`root@localhost:8000/default> SELECT * FROM @my_user_behavior_stage_1( FILE_FORMAT => 'orc', PATTERN => '*') limit 1; error: APIError: ResponseError with 4000: Failed to read, source: Unexpected (persistent) at , context: { expect: 16384, actual: 76761490 } => reader got too much data

root@localhost:8000/default> SELECT * FROM @my_user_behavior_stage_1( FILE_FORMAT => 'orc', PATTERN => '*') limit 1; error: APIError: ResponseError with 4000: Failed to read, source: Unexpected (persistent) at , context: { expect: 16384, actual: 76761490 } => reader got too much data

root@localhost:8000/default> COPY INTO my_sdap.event FROM( select dt, user_id, event_time, to_YYYYMM(event_time) event_month, to_YYYYMMDD(to_monday(event_time)) event_week_begin , to_YYYYMMDD(event_time) event_dt, event_attr49, event_attr50 FROM @my_user_behavior_stage_1) FILE_FORMAT =(TYPE = ORC) PATTERN = '*'; error: APIError: ResponseError with 4000: Failed to read, source: Unexpected (persistent) at , context: { expect: 16384, actual: 76761490 } => reader got too much data `

[Xuanwo]

Hi @youngsofun, could you check this issue? It seems we didn't correctly read the orc file.

[youngsofun]

@Xuanwo "reader got too much data" seems like an err raise from opendal?

[Xuanwo]

@Xuanwo "reader got too much data" seems like an err raise from opendal?

Oh, thanks a lot for your correction. I understand what happened now.

---

Hi, @xujinlong0314, which object storage service are you using? Would you like to double check it's HTTP Range support? It's seems return too much data that we expected.

[xujinlong0314]

@Xuanwo "reader got too much data" seems like an err raise from opendal?

Oh, thanks a lot for your correction. I understand what happened now.

Hi, @xujinlong0314, which object storage service are you using? Would you like to double check it's HTTP Range support? It's seems return too much data that we expected. use OBS, https://support.huaweicloud.com/productdesc-obs/obs_03_0150.html