cog icon indicating copy to clipboard operation
cog copied to clipboard

TPU support

Open Ontopic opened this issue 3 years ago • 4 comments
trafficstars

Awesome initiative, props to the maintainers!

Was wondering if TPU support is anything on your radar or if contributions in that area are welcome?

Ontopic avatar Apr 11 '22 22:04 Ontopic

Yes! Related: #376

bfirsh avatar Apr 12 '22 10:04 bfirsh

Not sure whether I should reply on the open issue, or here. The dream of cog with TPU-support is large though. All the features you advertise, are clearly needed on the TPU. Perhaps you could even count on some engineers from Google to assist with proper integration?

Awesome project nonetheless, hoping it will bring the TPU into the fold!

Ontopic avatar Jun 20 '22 03:06 Ontopic

I could post my findings into integrating TPU-access with Docker and recompiling libtpu for different setups? That would perhaps help someone on the Cog team to speed things along. But without someone knowledgable from your end I'm not sure I could achieve much.

Ontopic avatar Jun 20 '22 03:06 Ontopic

Yes, that would be very helpful, thank you! Even if it's just links to information.

bfirsh avatar Jun 20 '22 16:06 bfirsh

I was trying this out, and the breaker I ran into was that cog can't run docker with --privileged --network=host (As is required by TPUs)

Would be nice to allow custom docker run params when running cog build!

devxpy avatar Nov 19 '22 20:11 devxpy