prometheus-boshrelease icon indicating copy to clipboard operation
prometheus-boshrelease copied to clipboard

integrate with influxdb for long term storage

Open m-richo opened this issue 7 years ago • 8 comments

Hi, I've been looking at using influxdb to provide long term storage. The prometheus job already includes properties for remote_write and remote_read.

Would you be open to a PR that would include the following.

  1. operator file to deploy an influxdb instance
  2. update prometheus.yml template from prometheus job to optionally set remote_write and remote_read based on BOSH link data from the influxdb instance.

NOTE: i did spend time looking at building a BOSH job for remote_storage_adapter based on https://github.com/prometheus/prometheus/tree/release-2.1/documentation/examples/remote_storage/remote_storage_adapter but it now appears that influxdb 1.4.x supports the prometheus read/write natively.

Cheers, Michael

m-richo avatar Feb 14 '18 21:02 m-richo

@m-richo What influxdb bosh release do you plan to add at the op-file?

frodenas avatar Feb 15 '18 05:02 frodenas

i had a look around and thought the following from the concourse folk was most active https://github.com/concourse/influxdb-boshrelease

it's a fork, but they don't appear to be upstreaming.

I've raised a PR to them to add BOSH links and intended to raise another to upgrade influxdb from 1.3 to 1.4.3 (current) which supports prometheus remote storage natively.

m-richo avatar Feb 15 '18 06:02 m-richo

Sounds good!

frodenas avatar Feb 16 '18 05:02 frodenas

HI, did u have tried to integrate promethsu2 with influxdb successfully? and can someone share your manifests it possible?

Alexvianet avatar May 24 '18 15:05 Alexvianet

@Alexvianet I have never tried it, maybe @m-richo has updates?

frodenas avatar May 25 '18 10:05 frodenas

works well with https://github.com/cloudfoundry-community/influxdb-boshrelease prometheus2 job:

properties:
   prometheus:
      remote_write:
        - url: http://influxdb:8086/api/v1/prom/write?u=user&p=pass&db=yourdb
      remote_read:
        - url: http://influxdb:8086/api/v1/prom/read?u=user&p=pass&db=yourdb

Alexvianet avatar May 25 '18 14:05 Alexvianet

Thanks @Alexvianet. Willing to contribute an op-file to enable this?

frodenas avatar May 26 '18 15:05 frodenas

I am planning to test this in one of our environments, I will create a PR with an Ops File if this is not done until then.

benjaminguttmann-avtq avatar Jun 21 '18 10:06 benjaminguttmann-avtq

This issue is stale because it has been open 60 days with no activity. Comment or this will be closed in 5 days.

github-actions[bot] avatar Apr 25 '23 13:04 github-actions[bot]

This issue was automatically closed because it has been stalled for 5 days with no activity.

github-actions[bot] avatar May 01 '23 02:05 github-actions[bot]