lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

Import failed due to writing range with wrong keys order

Open lynnro314 opened this issue 2 years ago • 1 comments

This came up from a user. Import data from s3 to lakeFS failed with this error:

{"error":"writing range from entry iterator: writing record: setting key and value: pebble: keys must be added in order: #0,DEL, #0,SET","file":"lakeFS/pkg/api/controller.go:1747","func":"pkg/api.(*Controller).handleAPIError","level":"error","msg":"API call returned status internal server error","service":"api_gateway","time":"2022-08-28T15:33:00Z"}

image

lynnro314 avatar Aug 28 '22 16:08 lynnro314

We should block import from paths that contain the repo storage namespace.

  1. It makes no sense to import lakeFS metadata and data to lakeFS.
  2. It causes errors in S3 due to keys not being sorted.

itaiad200 avatar Aug 29 '22 09:08 itaiad200

This issue is now marked as stale after 90 days of inactivity, and will be closed soon. To keep it, mark it with the "no stale" label.

github-actions[bot] avatar Nov 01 '23 14:11 github-actions[bot]

Closing this issue because it has been stale for 7 days with no activity.

github-actions[bot] avatar Nov 10 '23 01:11 github-actions[bot]