terraform-provider-datadog icon indicating copy to clipboard operation
terraform-provider-datadog copied to clipboard

Add better support for logs management

Open avishnyakov opened this issue 5 years ago • 18 comments

Currently, this provider does not support any of log management features.

It makes it hard to manage and move configurations across different DataDog organizations. Here are several suggestion for new features:

  • support column creation
  • support facets creation
  • support saved views creation

avishnyakov avatar Jun 05 '19 04:06 avishnyakov

DataDog would have to publish APIs for log management first.

gregsymons avatar Jun 05 '19 14:06 gregsymons

There are Datadog Log Index and Pipeline APIs

https://docs.datadoghq.com/api/?lang=python#logs-indexes https://docs.datadoghq.com/api/?lang=python#logs-pipelines

julianvmodesto avatar Aug 02 '19 19:08 julianvmodesto

Hello,

Thanks @julianvmodesto , we indeed to have an API for pipelines and indexes (which include exclusion filters) and we are working on adding terraform support for it.

Regarding your request, it is planned to have an API and terraform support for:

  • Management of Facets and Measures
  • Management of Saved Views

Those are being worked on and we will update this thread once released.

Regarding columns, those are per users therefore I'm not sure to understand how you would use an API for them. Would you mind extending on your use case regarding setting columns via API?

NBParis avatar Aug 19 '19 16:08 NBParis

Hi folks, version 2.5.0 of the provider has been released and contains support for logs indexes and logs pipelines [1]. While I understand that the current feature set does not fully satisfy everything that this issue asks for, I still wanted to give a heads-up here so that you could benefit from these new resources.

[1] https://github.com/terraform-providers/terraform-provider-datadog/blob/master/CHANGELOG.md#250-october-22-2019

bkabrda avatar Oct 23 '19 11:10 bkabrda

Hello,

Are there any plans to add "Generate Metrics" from logs support too? (and Distribution Metrics from them?)

Thanks

thomas-riccardi avatar Dec 12 '19 11:12 thomas-riccardi

Hello @thomas-riccardi ,

The overall plan is to support all features through API and terraform which includes the Generate Metrics from Logs.

We will make sure to update this issue as we make progress on the different items covered here.

NBParis avatar Dec 12 '19 12:12 NBParis

Any ETA for managing Facets?

chriskolenko avatar Mar 06 '20 22:03 chriskolenko

Our company also needs to generate metrics and create facets from terraform. They are the next logical features after finishing datadog_dashboard, since the dashboards require special metrics and facets. On the positive side, we were able to wire our cluster resource names into the dashboard log queries because they are terraformed, BIG WIN!

lukeforehand avatar Jul 09 '20 16:07 lukeforehand

Be able to terrafom facets is must for multi-org setups. I'm interesting to see this feature as well

egorchabala avatar Sep 12 '20 02:09 egorchabala

Being able to create facets via terraform would be really great. Is there an ETA on this?

drpebcak avatar Nov 20 '20 15:11 drpebcak

Still no news? Facet management in Terraform is important for us.

sanderginn avatar Feb 16 '21 09:02 sanderginn

Bumping up this issue, since there is no reply yet! Will Logs -> Saved Views be available through the TF provider? If there is API support I could help with a contribution!

pavlospt avatar Oct 12 '21 18:10 pavlospt

It has been almost 33 months since this was requested originally. Is there any update on this?

We need Datadog facet management supported through API and Terraform to standardize Datadog account management. As mentioned by lukeforehand in comment, this is necessary even for setting up common Dashboards especially in multiple Datadog accounts.

Note that, there is already internal API for this: https://app.datadoghq.com/api/v1/logs/scopes/{scope_id}/facets?type=logs . Please consider expediting this feature request as it is necessary to support multiple Datadog accounts with set of standard facets and dashboards.

knowshan avatar Mar 14 '22 19:03 knowshan

Didn't see it already in this thread. But I'd like the ability to create exclusion filters as a separate resource for the index. My use case is allowing different applications and projects to define their own exclusion filters referencing the index by name or ID (so that we can do it on the default main index as well).

andyshinn avatar Apr 26 '22 20:04 andyshinn

Is there any update on the facet feature being available

ShajiCsTR avatar Jan 20 '23 14:01 ShajiCsTR

Any update on the facet and measure feature?

anietieasuquo avatar Aug 14 '23 07:08 anietieasuquo

Hello there,

Just in case this was missed but Facets are no longer required to make searches or analytics. So even if no facets are defined on a given dimension, it can be used in any search or group by in the explorer, dashboards or monitors (anywhere in Datadog).

NBParis avatar Aug 14 '23 08:08 NBParis

Any news about supporting facets on the provider?

pacoguzman avatar Feb 14 '24 09:02 pacoguzman