pycoal icon indicating copy to clipboard operation
pycoal copied to clipboard

Investigate running Pytorch on GPU

Open TinyBugBigProblem opened this issue 5 years ago • 4 comments
trafficstars

I think I managed to fix the problem I was running into. The approach I had before didn't seem to take into account how Pytorch handled wrapping the Model class and distributing the necessary information to each forward function to perform the operations. I believe the trick to getting Pytorch to work was creating a custom function class inheriting from torch.autograd.

What I have, if I can look into it some more and fix some bugs, should be able to run with any number of GPUs while evenly distributing the image data, scored and classified arrays across them.

TinyBugBigProblem avatar Dec 02 '19 05:12 TinyBugBigProblem

Hi Dennis, did you mean to close this issue before it was reviewed? Thanks for posting your initial work.

Lewis Dr. Lewis J. McGibbney Ph.D, B.Sc Skype: lewis.john.mcgibbney

lewismc avatar Dec 02 '19 14:12 lewismc

Actually @Luner if your work incorporated into this PR?

lewismc avatar Dec 03 '19 02:12 lewismc

@lewismc It looks like this PR is utilizing the code from issue 192. This was when we changed everything to pytorch but did not implement the column by column approach. The runtime for issue 192 was closer to 50 minutes.

Luner avatar Dec 03 '19 02:12 Luner

OK, we can rebase this once we've worked on #198

lewismc avatar Dec 03 '19 03:12 lewismc