feature-store-api
feature-store-api copied to clipboard
splits inode foreign key
we should add a foreign key to the inode of a split, so that metadata gets deleted when the user deletes a split from the Datasets browser.
Problem: Spark recreated the directory when writing, therefore creating a new inode. In append mode it wouldn't be a problem, however, tfrecords don't support append.