deepflow icon indicating copy to clipboard operation
deepflow copied to clipboard

[BUG] clickhouse数据库乱码

Open goobycle opened this issue 1 year ago • 9 comments

Search before asking

  • [X] I had searched in the issues and found no similar feature requirement.

DeepFlow Component

Server

What you expected to happen

in_process表profile_location_str字段乱码,如(�/��1�[p] deepflow-agent;[t] cgroups-control�>k�,如何调整,烦请支持。

How to reproduce

一直存在,没有解决

DeepFlow version

最新版

DeepFlow agent list

1.0

Kubernetes CNI

1

Operation-System/Kernel version

1

Anything else

1

Are you willing to submit a PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

goobycle avatar May 03 '24 09:05 goobycle

请提供一下 deepflow-agent -v 、deepflow-server -v 的输出

sharang avatar May 09 '24 08:05 sharang

@.***

发件人: XIANG Yang 发送时间: 2024-05-09 16:50 收件人: deepflowio/deepflow 抄送: goobycle; Author 主题: Re: [deepflowio/deepflow] [BUG] clickhouse数据库乱码 (Issue #6313) 请提供一下 deepflow-agent -v 、deepflow-server -v 的输出 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

goobycle avatar May 11 '24 06:05 goobycle

请提供一下 deepflow-agent -v 、deepflow-server -v 的输出 deepflow-server-v deepflow-agent-v

goobycle avatar May 11 '24 06:05 goobycle

@goobycle 看到你的 deepflow-server 是 6.4.3,建议升级到 6.4 的最新版,后者是一个 LTS 版本。

sharang avatar May 14 '24 12:05 sharang

@goobycle

不是乱码,存储里默认使用了 zstd 压缩,通过 /v1/Profile/Profiletracing 接口查询结果可见明文

如需要存储明文且不经压缩,通过此配置修改为空即可

https://github.com/deepflowio/deepflow/blob/main/server/server.yaml#L543

ingester:
  ## profile compression algorithm, default is zstd, empty string for not compress
  profile-compression-algorithm: ""

taloric avatar Jul 08 '24 09:07 taloric

请问 All-in-One K8s 下部署怎么调整这个参数?感谢。

goobycle avatar Jul 16 '24 09:07 goobycle

在部署的 helm chart values-custom.yaml 文件中加上:

configmap:
  server.yaml:
    ingester:
      profile-compression-algorithm: ''

taloric avatar Jul 16 '24 14:07 taloric

增加参数后,执行helm upgrade deepflow -n deepflow deepflow/deepflow -f values-custom.yaml,查看数据库貌似还是压缩过的,需要删除命名空间重新建立吗?

goobycle avatar Jul 18 '24 00:07 goobycle

不用,但需要检查下修改是否生效,看下

kubectl get cm -n deepflow deepflow -o yaml | grep profile-compression-algorithm

如果它是如下(即冒号后面无内容)

profile-compression-algorithm:

估计是 helm chart 没渲染空字符串,可手动修改为:

profile-compression-algorithm: ""

taloric avatar Jul 22 '24 10:07 taloric