NVTabular
NVTabular copied to clipboard
[FEA] Automatically calculate memory utilization parameters like limit_frac in dl_encoder.py
Issue by oyilmaz-nvidia
Wednesday Feb 26, 2020 at 15:57 GMT
Originally opened as https://github.com/rapidsai/recsys/issues/17
Is your feature request related to a problem? Please describe. It's not exactly a problem but a suggestion to utilize the GPU or host memory better. When we use a constant value for memory utilization such as "limit_frac = 0.05", we might be under utilize the memory depending on the data.
Describe the solution you'd like Maybe, we can find a way to calculate these parameters automatically. If this doesn't seem feasible, we can leave it as it is.