dbt-databricks icon indicating copy to clipboard operation
dbt-databricks copied to clipboard

UserWarning: resource_tracker: There appear to be 2 leaked semaphore objects to clean up at shutdown 3

Open xg1990 opened this issue 3 years ago • 0 comments
trafficstars

Describe the bug

The instance is killed with the reason OOMKilled.

Seems there is a memory leakage.

Steps To Reproduce

When run dbt build with multiple threads enabled, in a memory constrained environment (i.e. k8s, with limited memory) The instance will be killed with the reason OOMKilled

Expected behavior

dbt build should not require too much memory

Screenshots and log output

image

image

image

System information

The output of dbt --version: image

The operating system you're using:

The output of python --version: image

Additional context

Add any other context about the problem here.

xg1990 avatar Jul 14 '22 23:07 xg1990