David Beavon

**Is your feature request related to a problem? Please describe.** I really like using the **Group/Apply** (RelationalGroupedDataset) interface that allows the rapid exchange of complex data with executors. I use...

[FEATURE REQUEST]: GetNumPartitions

2

**Is your feature request related to a problem? Please describe.** It takes a lot of effort to detect the number of partitions in a dataframe. Currently I have to swap...

Enterprise gateway will not refresh access token. Custom Connector is using Aad for Authentication Kind

6

I have a custom connector that relies on the authentication kind "AAD" (Azure identities). The custom connector internally relies on a remote REST service. After an hour my AAD access...

Issue with TokenLibrary on Synapse - can't authenticate to a normal oauth2 scope

3

The nuget library Microsoft.Spark.Extensions.Azure.Synapse.Analytics.Utils points back to this project so I'm hoping I can get some help with TokenLibrary. I'd like to connect to resources using the managed identity of...

Want to authenticate in synapse spark pool using managed identity.

1

I'm looking for a way to authenticate within the synapse spark pool, using the MSI. Managed Identity Support is already available in a variety of other Azure platforms via the...

Synapse cluster has intermittent .net exception related to DNS

2

I realize it is a long-shot to post a question here about "managed private endpoints" and DNS name resolution in a synapse spark cluster. This forum has smart people, so...

Swapping line delimiters from UNIX to Windows (probably only when running on windows agent)

2

I'm using this in Azure devops. https://marketplace.visualstudio.com/items?itemName=DataThirstLtd.databricksDeployScriptsTasks&ssr=false#qna The task is: **DataThirstLtd.databricksDeployScriptsTasks.databricksDeployDBFSFilesTask** When running on a windows agent (we have a large windows -based agent pool) it swaps line delimiters from...

[FEATURE REQUEST]: Deprecate and/or evict Microsoft.Data.Analysis from the Microsoft.Spark assembly

1

**Is your feature request related to a problem? Please describe.** I'd like to deprecate **Microsoft.Data.Analysis** from this project, or at least move it out of **Microsoft.Spark** to a distinct assembly...

**Is your feature request related to a problem? Please describe.** We need .Net 8 support. It is the current LTS. **Describe the solution you'd like** I'm able to successfully test...

**Is your feature request related to a problem? Please describe.** For simplicity, does it make sense to **stop** targeting .net standard and to **only** target .net 8? I don't think...