FATE icon indicating copy to clipboard operation
FATE copied to clipboard

nodemanager temp data is too large

Open majorinche opened this issue 2 years ago • 2 comments

when we run many jobs , the data under LMDB will expand too quickly and too large. node-too large

can we just give some configuration for us to decide, like how long we will keep these temparary data? or what is the maximum days?

maybe just put it in the service_conf file? service_conf

thanks majorin

majorinche avatar May 20 '22 07:05 majorinche

The data is the component output data of job.
You can clean the data if you don't not need it.

dylan-fan avatar Jun 14 '22 03:06 dylan-fan

The data is the component output data of job.
You can clean the data if you don't not need it.

dylan-fan avatar Jun 14 '22 03:06 dylan-fan