Arvind Shyamsundar

icon indicating a website link https://mstdn.social/@arvisam

icon company @Microsoft icon location Redmond, WA, United States icon location Product @ MSFT #AzureSQL. Data geek. SQL MCM. PMC emeritus for Apache Accumulo and Apache Fluo.

Results 22 issues of Arvind Shyamsundar

Long delay after writing edge snapshots due to single-threaded renaming of output files by the Spark driver

6 comment

I generated SF30000 dataset directly to ADLS Gen 2. What I observed is that after the major snapshots are written, there are significant delays due to single-threaded renaming of the...

performance

Update MSTest nugets