framework icon indicating copy to clipboard operation
framework copied to clipboard
verified publisher icon frictionlessdata

Investigate database usage as a backend for transform/validate

Open roll opened this issue 3 years ago • 0 comments

Overview

Currently, we use in-Python streaming based on PETL for transformations but it makes sense to investigate if we can replace it with in-database manipulations. It's a research issue

  • [ ] New Pipeline/Checklist
  • [ ] Replace Detector by steps.importFile (or similar)
  • [ ] Do we need something in parallel?

roll avatar Nov 21 '22 14:11 roll