defoe
defoe copied to clipboard
Reduce number/overhead of Azure authentication calls
defoe/spark_utils.py open_stream creates and connects to a new instance of azure.storage.blob.BlobService for every "blob". This should be refactored so it's only done once per Azure container within which the blobs reside.