lake-api icon indicating copy to clipboard operation
lake-api copied to clipboard

Corrupted files

Open IngLP opened this issue 1 year ago • 0 comments

  • Lake API version: 0.8.0
  • Python version: 3.10
  • Operating System: macOS

Description

I want to report corrupted trades for all symbols on Coinbase, at 2023-03-04.

What I Did

I tried to download the aforementioned data. Returned DataFrame is empty and the following log is printed.

WARNING  [_read_parquet.py:59] Ignoring corrupted file = s3://qnt.data/market-data/cryptofeed/trades/exchange=COINBASE/symbol=ADA-USD/dt=2023-03-04/1.snappy.parquet

IngLP avatar Oct 03 '23 09:10 IngLP