feature-store-api icon indicating copy to clipboard operation
feature-store-api copied to clipboard

splits inode foreign key

Open moritzmeister opened this issue 5 years ago • 0 comments

we should add a foreign key to the inode of a split, so that metadata gets deleted when the user deletes a split from the Datasets browser.

Problem: Spark recreated the directory when writing, therefore creating a new inode. In append mode it wouldn't be a problem, however, tfrecords don't support append.

moritzmeister avatar Apr 19 '20 12:04 moritzmeister