apm-server icon indicating copy to clipboard operation
apm-server copied to clipboard

Ability to run standalone apm server 8.x without elasticsearch output nor kibana endpoint

Open jguay opened this issue 2 years ago • 2 comments

Running standalone APM Server 8.x without elasticsearch output nor kibana endpoint will return

{"log.level":"error","@timestamp":"2023-06-19T01:02:04.567Z","log.logger":"beater","log.origin":{"file.name":"beater/beater.go","file.line":368},"message":"error waiting for server to be ready: cannot wait for integration without either Kibana or Elasticsearch config","service.name":"apm-server","ecs.version":"1.6.0"}

This is a documented requirement

However if apm server is not intended to be allowed to connect to Kibana nor Elasticsearch, this adds a requirement to open connection to Kibana for APM Server standalone to work... Also currently with fleet, only logstash and elasticsearch output are supported hence why APM Server standalone may be used (example using Kafka or Redis output)

Requested feature would be to add the ability to disable the check for APM integration assets installation status hence something like apm-server.check-assets defaulting to true but setting to false would not attempt to check assets are installed or require kibana endpoint

jguay avatar Jun 20 '23 13:06 jguay

This is indeed a valid usecase for outputs different than Elasticsearch. We have seen issues in the past when templates and ingest pipelines were missing before data ingestion started. After some previous internal discussions, we would want to add additional safety guards and only allow disabling the check if output is different than ES.

simitt avatar Jun 21 '23 07:06 simitt

I think this would no longer be an issue once https://github.com/elastic/elasticsearch/pull/97546/ is merged

kruskall avatar Aug 24 '23 18:08 kruskall

Hi, any update / workout found to remove dependency on startup ?

heisGarvit avatar May 27 '24 05:05 heisGarvit

This will be resolved in 8.15.0, by https://github.com/elastic/apm-server/pull/12066 and https://github.com/elastic/elasticsearch/pull/108860.

axw avatar May 27 '24 05:05 axw