NVTabular icon indicating copy to clipboard operation
NVTabular copied to clipboard

[FEA] Automatically calculate memory utilization parameters like limit_frac in dl_encoder.py

Open benfred opened this issue 5 years ago • 0 comments

Issue by oyilmaz-nvidia Wednesday Feb 26, 2020 at 15:57 GMT Originally opened as https://github.com/rapidsai/recsys/issues/17


Is your feature request related to a problem? Please describe. It's not exactly a problem but a suggestion to utilize the GPU or host memory better. When we use a constant value for memory utilization such as "limit_frac = 0.05", we might be under utilize the memory depending on the data.

Describe the solution you'd like Maybe, we can find a way to calculate these parameters automatically. If this doesn't seem feasible, we can leave it as it is.

benfred avatar Jun 04 '20 23:06 benfred