Robert Pack

@houqp @wjones127 - latest datafusion is already using the `Path` abstraction from object_strore_rs as well as the specific "view" on what an object store is. For the unix systems quickly...

Hi @ganesh-gawande, tahnks for this report. - could you share the basic layout of your storage account? Specifically where the `_delta_logs` folder is located?

not sure i follow. This means, the delta table is located at the root of the container within the storage account? In your example you mention `DeltaTableNameFromDatabricks`. Does this then...

Thanks! In that case "adls2://{ContainerName}@{StorageAccountName}.dfs.core.windows.net" should be the way to go. The fact that we are getting the error you mentioned should already mean, that we can access the storage,...

just making sure - does the `_last_checkpoint` file exist? the logic is roughly like this .. check if we find the `_last_checkpoint` file, if yes, start from that checkpoint, if...

hmm strange ... this seems like a corruption in the delta log to me... when databricks creates a checkpoint it should also create a `_last_checkpoint` file. The rust implementation relies...

@ganesh-gawande - sorry for sending you on a wild goose chase ... I recreated the behaviour locally. Seems like we have a bug where we cannot read a table from...

@ganesh-gawande - so the path you should be using is `adls2://{StorageAccountName}/{ContainerName}/`. After #603 is merged `adls2://{StorageAccountName}/{ContainerName}` should also work. However I also tried loading a delta log with initial commit...

kind of lost track... just making sure, so to clarify - Loading the original table does not work - That table does NOT have `_last_commit` file or `00000000000000000000.json`. Did you...

also if you add a trailing "/"? This is actually the bug that gets fixed in #603. i.e. if the trailing slash is missing it also fails for me ...