trino icon indicating copy to clipboard operation
trino copied to clipboard

Add physical data scan tracking to resource groups

Open kekwan opened this issue 8 months ago • 4 comments

Description

This PR adds support to track physical data scan usage in resource groups. This is an optional feature in resource groups and behaves similar to softMemoryLimit, new queries will get queued once data scan limit is reached. This is a helpful feature for admins who need to 'throttle' their users from pulling too much data from file system.

Additional context and related issues

https://github.com/trinodb/trino/issues/25003

Release notes

( ) This is not user-visible or is docs only, and no release notes are required. ( ) Release notes are required. Please propose a release note for me. (x) Release notes are required, with the following suggested text:

## General
* Add physical data scan tracking to resource groups({issue}`25003`)
## SPI
*  Methods added to io.trino.spi.resourcegroups for tracking data scan usage({issue}`25003`)

kekwan avatar Feb 21 '25 23:02 kekwan