logstash-input-azure_blob_storage

logstash-input-azure_blob_storage copied to clipboard

Logstash with plugin output failed

2

Set up an Azure VM which is Ubuntu18 with java8 and logstash plugin installed successfully. set up network watcher to retrieve NSG flow logs into storage account successfully /etc/logstash/conf.d/logstash.conf: input...

SiberianTiger01

log_type for azure apim diagnostic logs

10

I need to know if this plugin supports the reading of the diagnostic logs which are forwarded to blob storage. I get json parse errors. the apim logs like this...

michaelhui8

Reading Gzip file on azure blob containing json

6

Possibility to read gz files stored on azure blob. The gz contains json files, have done the following config and below is the error ``` input { azure_blob_storage { storageaccount...

ashwinmuni

Can multiple logstash instances with plugin logstash-input-azure_blob_storage installed to read the same container read without duplicate processing?

1

I have a requirement to have multiple logstash instances reading from the same Azure storage account and the same container. The container has activity logs. I am running two logstash...

anshuca0743

Plugin not creating registry file

17

Hi Jan, Any chance you could suggest a way to troubleshoot this? I have two Azure resource groups - one in a Dev environment and the other in a Production...

sera4000

I down load the "PT1H.json" from storage account on Azure Portal GUI.  And compare with local file on logstash host. And found the local file's log count is more...

royoan

i need create a prefix with the format yyyy/MM/dd

1

I need to create a prefix that allows me to have the year, month and day as a variable so that my logstash process does not analyze the millions of...

ghost

Index -1 out of bounds for length

20

I'm giving the plugin a try but no idea why I'm getting the below error. **Running Logstash 8.10.4 fresh install** ``` Using bundled JDK: /usr/share/logstash/jdk Picked up _JAVA_OPTIONS: -Dawt.useSystemAAFontSettings=on -Dswing.aatext=true...

ThreatLentes

Reading JSON append blobs from storage account

5

Hello, Currently I have a diagnostic setting on my Azure Data Factory that sends pipeline/activity logs to a container in storage account in the following format "container/dir/dir/dir/y=2023/m=05/d=02/h=10/m=00/PT1H.json. For every hour,...

saiframahii

Logstash not able to read and process .csv file

6

I am reading .csv file from the Azure storage blob and adding that data in Elasticsearch. But logstash gets stuck after the below lines. [2023-06-16T18:30:28,479][INFO ][logstash.inputs.azureblobstorage][main][181f6119611506bdf4dacc3ea01b35a1dee26ed795d3b801c7e8f3d7080a0e8c] learn json one of...

vitthaltambe-gep