AzureStorageExplorer icon indicating copy to clipboard operation
AzureStorageExplorer copied to clipboard

Azure Storage Explorer ADLS files should have preview UI

Open cesarjo opened this issue 3 years ago • 6 comments
trafficstars

Preflight Checklist

Problem

Cannot view all file types in the ADLS container

Desired Solution

Preview top 100 rows of any file in the ADLS containers. Should support all file extensions -- eg .tsv and .ss (Cosmos structured streams)

Alternatives and Workarounds

Open file using other apps (outside of Azure Storage Explorer)

Additional Context

No response

cesarjo avatar Jan 19 '22 03:01 cesarjo

@cesarjo couple of clarifying questions:

  • Are you talking about ADLS Gen1 or ADLS Gen2
  • When you say "view all file types", what do you mean by view? Are the files you want to see not visible or do you mean something else?

MRayermannMSFT avatar Jan 20 '22 18:01 MRayermannMSFT

Hello - Sorry I was not clear in my description.

I am referring to ADLS Gen2. "View all files (formats)" means a feature/UI that will allow user to open file for viewing - e.g., able to look through the columns and rows for a csv or tsv file format. We also work with the structured stream (.ss extension) file format - i.e., Cosmos as it's referred to internally at Microsoft - and this feature would allow user to view contents of .ss files as well.

Thanks -cesar

From: Matthew Rayermann @.> Sent: Thursday, January 20, 2022 10:06 AM To: microsoft/AzureStorageExplorer @.> Cc: Cesar @.>; Mention @.> Subject: Re: [microsoft/AzureStorageExplorer] Azure Storage Explorer ADLS files should have preview UI (Issue #5343)

@cesarjohttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fcesarjo&data=04%7C01%7C%7C4e78560393544c1852b408d9dc3f87aa%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637782987685402685%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=ZNS6RyiGMj%2BfrM0wnOkYk38kh%2F12deCrtqtypQMyfrk%3D&reserved=0 couple of clarifying questions:

  • Are you talking about ADLS Gen1 or ADLS Gen2
  • When you say "view all file types", what do you mean by view? Are the files you want to see not visible or do you mean something else?

Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FAzureStorageExplorer%2Fissues%2F5343%23issuecomment-1017777549&data=04%7C01%7C%7C4e78560393544c1852b408d9dc3f87aa%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637782987685402685%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=txvH%2ByZENQdjqRtVXtB1izfEL4GP65hrac3niBWP4Sw%3D&reserved=0, or unsubscribehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FACB3LYGIWG52FZOZCJEVIP3UXBFI3ANCNFSM5MIZBB5Q&data=04%7C01%7C%7C4e78560393544c1852b408d9dc3f87aa%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637782987685402685%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=IVQ%2BPCmnZ503JbMhpbIjQOgHcSZnnXU3Gj%2BgSMROVl0%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7C%7C4e78560393544c1852b408d9dc3f87aa%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637782987685402685%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Ae3%2B26BhzEPfc%2FWHY0sRm2R%2FYpVHYxH4FNTaBs1iLkM%3D&reserved=0 or Androidhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7C%7C4e78560393544c1852b408d9dc3f87aa%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637782987685402685%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=WSXiLM1AAP69KMQ0ByN4NB0uRdMwXWvE%2BIvNJKmfjxg%3D&reserved=0. You are receiving this because you were mentioned.Message ID: @.@.>>

cesarjo avatar Jan 20 '22 20:01 cesarjo

@cesarjo ok gotcha, right now our recommendation is to download the file yourself and open it in a program specifically designed for working with such file types. Is there a reason you don't want to do that?

MRayermannMSFT avatar Jan 21 '22 00:01 MRayermannMSFT

Our data engineering team almost exclusively works with (Cosmos) structured streams --- the .ss extension file format. When working in the Cosmos big data platform (internal to Microsoft), the user can use Explorer web browser to navigate folder path and view contents (in table layout) of the data in .ss files -- there is native support in Cosmos to work with any web browser.

The migration to use Azure Data Lake, now prohibits using the web browser to navigate to (ADLS folder path) and view .ss files. There is no other program/app to view Cosmos structure stream file format. More and more data teams inside of Microsoft have motivations to migrate from Cosmos to the Azure Data Lake (ADLA/ADLS-Gen2), but there does not appear to be a clear user scenario for viewing structured streams that will continue to be the file format for processing datasets (Scope language is used, which is similar to U-SQL language).

thanks -cesar

From: Matthew Rayermann @.> Sent: Thursday, January 20, 2022 4:35 PM To: microsoft/AzureStorageExplorer @.> Cc: Cesar @.>; Mention @.> Subject: Re: [microsoft/AzureStorageExplorer] Azure Storage Explorer ADLS files should have preview UI (Issue #5343)

@cesarjohttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fcesarjo&data=04%7C01%7C%7Caa4812bd1af944ded1cc08d9dc75daec%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637783221013811579%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=5HK60A2hVuNarVrSFcjaHB2lZSDvIh5V8s2kY8NvAzk%3D&reserved=0 ok gotcha, right now our recommendation is to download the file yourself and open it in a program specifically designed for working with such file types. Is there a reason you don't want to do that?

Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FAzureStorageExplorer%2Fissues%2F5343%23issuecomment-1018050244&data=04%7C01%7C%7Caa4812bd1af944ded1cc08d9dc75daec%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637783221013811579%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=jZmde2Zqrwrpqis9S9gVlrZrMTzruOF79ObMlSPowsQ%3D&reserved=0, or unsubscribehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FACB3LYB7SXXSPWYYWU7KG6LUXCS3FANCNFSM5MIZBB5Q&data=04%7C01%7C%7Caa4812bd1af944ded1cc08d9dc75daec%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637783221013811579%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=CFypXxbmALkUCXTzL5XU3vtlZ65sdPxXSjYS%2FGwL2KU%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7C%7Caa4812bd1af944ded1cc08d9dc75daec%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637783221013811579%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=qP%2BOQLUeMBJI4BSZ6BziXF%2FMmmvGfDxhbBaS%2FfX%2Bz70%3D&reserved=0 or Androidhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7C%7Caa4812bd1af944ded1cc08d9dc75daec%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637783221013811579%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=INLLaAo1rU7wL8FOmKRLIJYIRyoTnrzsadFbr5JUIS0%3D&reserved=0. You are receiving this because you were mentioned.Message ID: @.@.>>

cesarjo avatar Jan 21 '22 01:01 cesarjo

@cesarjo are you internal? Can you shoot me a message on teams. I'd like to learn more about what you're talking about.

MRayermannMSFT avatar Jan 21 '22 17:01 MRayermannMSFT

@cesarjo In 1.26.0 we added a feature to let you preview blobs as text with known extensions, do you have a chance to try it?

JasonYeMSFT avatar Oct 10 '22 17:10 JasonYeMSFT