kyuubi icon indicating copy to clipboard operation
kyuubi copied to clipboard

[KYUUBI #7078] Make data masking and row filter configurable

Open wForget opened this issue 5 months ago • 5 comments

Why are the changes needed?

Make data masking and row filter configurable.

closes #7078

How was this patch tested?

added unit test

Was this patch authored or co-authored using generative AI tooling?

No

wForget avatar Jun 05 '25 13:06 wForget

Codecov Report

Attention: Patch coverage is 0% with 64 lines in your changes missing coverage. Please review.

Project coverage is 0.00%. Comparing base (cad5a39) to head (ab6c900).

Files with missing lines Patch % Lines
.../rule/datamasking/RuleApplyDataMaskingStage1.scala 0.00% 19 Missing :warning:
.../main/scala/org/apache/spark/authz/AuthzConf.scala 0.00% 19 Missing :warning:
.../rule/datamasking/RuleApplyDataMaskingStage0.scala 0.00% 10 Missing :warning:
...park/authz/rule/rowfilter/RuleApplyRowFilter.scala 0.00% 9 Missing :warning:
.../authz/rule/config/AuthzConfigurationChecker.scala 0.00% 7 Missing :warning:
Additional details and impacted files
@@          Coverage Diff           @@
##           master   #7082   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         697     698    +1     
  Lines       43203   43233   +30     
  Branches     5854    5854           
======================================
- Misses      43203   43233   +30     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov-commenter avatar Jun 06 '25 09:06 codecov-commenter

How about we have an extra RangerSparkExtension to register auth-only rules?

yaooqinn avatar Jun 13 '25 05:06 yaooqinn

How about we have an extra RangerSparkExtension to register auth-only rules?

Sounds good to me, I'll change it that way

wForget avatar Jun 18 '25 02:06 wForget

能否支持类似 databricks 的语法,实现数据脱敏或者 row filter,spark4.0 支持 user 定义函数语法。https://docs.databricks.com/aws/en/tables/row-and-column-filters?language=Catalog%C2%A0Explorer

melin avatar Jun 18 '25 02:06 melin

能否支持类似 databricks 的语法,实现数据脱敏或者 row filter,spark4.0 支持 user 定义函数语法。https://docs.databricks.com/aws/en/tables/row-and-column-filters?language=Catalog%C2%A0Explorer

这个讨论与此 pr 无关,你可以创建一个新的 issue 进行讨论。

wForget avatar Jun 18 '25 04:06 wForget