m3 icon indicating copy to clipboard operation
m3 copied to clipboard

Rollup rules not working with unagregated namespace

Open yackushevas opened this issue 3 years ago • 2 comments

https://m3db.io/docs/operational_guide/mapping_rollup/ Based on this documentation, I tried to use the rules for unaggregated namespace:

m3coordinator:

    ...
    clusters:
    - namespaces:
      - namespace: default
        retention: 744h
        type: unaggregated
      - namespace: metrics_5m_90d
        retention: 2160h
        resolution: 5m
    ...
    downsample:
      ...
      rules:
        rollupRules:
            ...
            storagePolicies:
              - resolution: 10s
                retention: 744h
              - resolution: 5m
                retention: 2160h

In the namespace metrics_5m_90d, the metrics are written successfully, in the default: "msg":"could not write ingest op","error":"no configured cluster namespace for: retention=744h0m0s, resolution=10s","retryableError":true

m3db default namespace:

        ...
        "aggregationOptions": {
          "aggregations": [
            {
              "aggregated": false,
              "attributes": null
            },
            {
              "aggregated": true,
              "attributes": {
                "resolutionNanos": "10000000000",
                "downsampleOptions": {
                  "all": false
                }
              }
            }
          ]
        },
        ...

yackushevas avatar Feb 22 '22 10:02 yackushevas

Had same issue, solved by configuring the default namespace twice in the yaml file, with the downsample all set to false:

- namespaces:
      - namespace: default
        retention: 744h
        type: unaggregated
      - namespace: default
         retention: 744h
         type: aggregated
         resolution: 10s
         downsample:
           all: false
     

anton-Kozlenko avatar Mar 08 '22 10:03 anton-Kozlenko

@anton-Kozlenko It works, thanks!

yackushevas avatar Mar 09 '22 12:03 yackushevas