paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Feature] Query SQL Audit

Open create-co opened this issue 1 year ago • 3 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Motivation

I activated the privilege system. In our business scenario, I want to collect all executed sql queries of paimon from authorized users for security audit. Does paimon currently support collecting executed sql records? Or is there a solution?

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

  • [X] I'm willing to submit a PR!

create-co avatar Sep 11 '24 15:09 create-co

Do audit logs need to have a central service that can centralize the audit logs? Paimon is a tabular format and does not have a central service. Can we consider solving this at the computing engine layer, such as Hive? If not, then Paimon needs to support uploading audit logs to a central storage like ElasticSearch.

davedwwang avatar Sep 23 '24 11:09 davedwwang

I just need to collect the execution log of paimon. Now I don't know how to configure it. I can collect the execution log of paimon. For example, colleague A executed SELECT * FROM A ; where can I collect this execution sql and know that someone accessed Table A?

------------------ 原始邮件 ------------------ 发件人: "apache/paimon" @.>; 发送时间: 2024年9月23日(星期一) 晚上7:43 @.>; @.@.>; 主题: Re: [apache/paimon] [Feature] Query SQL Audit (Issue #4174)

Do audit logs need to have a central service that can centralize the audit logs? Paimon is a tabular format and does not have a central service. Can we consider solving this at the computing engine layer, such as Hive? If not, then Paimon needs to support uploading audit logs to a central storage like ElasticSearch.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

create-co avatar Sep 23 '24 11:09 create-co

@create-co Maybe you can try apache gravitino. It support the audit log for paimon.

coolderli avatar Sep 25 '24 12:09 coolderli