SATOSHI NAKAMOTO

anchor.fm/TheAIRevolution [email protected]

DONATE BY MAIL HOT SPRINGS NATIONAL PARK, ARKANSAS 🎙️ Host of 'The AI Revolution' radio show on WWPR | Major investor in AI & Machine Learning 🤖 | Tech Founder, Developer Advocate | Passionate about Ethical AI

Repositories
Issues
Comments

Results 1 issues of


                                            SATOSHI NAKAMOTO

Implement Fully Sharded Data Parallel (FSDP) support

This pull request aims to implement Fully Sharded Data Parallel (FSDP) support in tinygrad. FSDP is a technique for efficient distributed training of large models by sharding model parameters and...