pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Fix FileNotFoundException in HadoopPinotFS during table deletion when metadata files don't exist

Open Akanksha-kedia opened this issue 3 months ago • 3 comments

java.io.FileNotFoundException: File does not exist: hdfs://namenode:8020/pinot/data/myTable/segment_name.metadata.tar.gz at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1520) at org.apache.pinot.plugin.filesystem.HadoopPinotFS.isDirectory(HadoopPinotFS.java:236) at org.apache.pinot.plugin.filesystem.HadoopPinotFS.delete(HadoopPinotFS.java:92)

Akanksha-kedia avatar Nov 30 '25 15:11 Akanksha-kedia

@Jackie-Jiang

Akanksha-kedia avatar Nov 30 '25 15:11 Akanksha-kedia

@Akanksha-kedia Do you want to help fix this?

cc @swaminathanmanish @KKcorps Seems the behavior of PinotFS.isDirectory() is not consistent across different FSs

Jackie-Jiang avatar Dec 01 '25 20:12 Jackie-Jiang

Yes i m wanting to fix raised a pr as well

On Tue, 2 Dec 2025 at 2:06 AM, Xiaotian (Jackie) Jiang < @.***> wrote:

Jackie-Jiang left a comment (apache/pinot#17292) https://github.com/apache/pinot/issues/17292#issuecomment-3598723508

@Akanksha-kedia https://github.com/Akanksha-kedia Do you want to help fix this?

cc @swaminathanmanish https://github.com/swaminathanmanish @KKcorps https://github.com/KKcorps Seems the behavior of PinotFS.isDirectory() is not consistent across different FSs

— Reply to this email directly, view it on GitHub https://github.com/apache/pinot/issues/17292#issuecomment-3598723508, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVL2AZVHPBJPHOFR3O7TPOL37SRD5AVCNFSM6AAAAACNTDR33GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTKOJYG4ZDGNJQHA . You are receiving this because you were mentioned.Message ID: @.***>

Akanksha-kedia avatar Dec 02 '25 02:12 Akanksha-kedia