InvoiceNet icon indicating copy to clipboard operation
InvoiceNet copied to clipboard

Published 20 hours ago • verified publisher icon naiveHobo

Suggested Hardware/GPU Memory for training

Open flexwend opened this issue 4 years ago • 3 comments
trafficstars

Can anybody suggest hardware for training? I got a dataset of about 1000 files, and would like to train with batch size 32. I tried it with aws instance g4dn.xlarge (1 GPU, 4 vCPUs, 16 GiB of memory, 125 NVMe SSD, up to 25 Gbps network performance) and it seems like that its not enough memory and therefore reduces the performance significantly.

I would appriciate any tips

flexwend avatar Sep 17 '21 16:09 flexwend

you can try this. i have tried performance is good.

https://e2enetworks.com NVIDIA - RTX8000 | 48 GB | Ubuntu - 20.04 | GDC.RTX-16.115GB | CPU 16 | 115 GB | 900 GB

marutichintan avatar Sep 22 '21 06:09 marutichintan

@marutichintan Thanks for the answer and tip

Can you say how large your dataset was and how long training took for a field?

flexwend avatar Oct 08 '21 10:10 flexwend

@flexwend did you use something? i just found this project and i am basically swamped. i feel overwhelmed. did you get to use this? what server did you use and what is the datasize-to-time ratio with regards to listed configs here?

don't we have to generate a training data just once?

test2a avatar Nov 06 '21 18:11 test2a