BitNet
BitNet copied to clipboard
Demo bitnet.cpp on Google Colab CPU
BitNet.cpp Demo on Google Colab: CPU-based Testing
This PR introduces a demo for BitNet.cpp running on Google Colab's CPU environment. Key features:
- Demonstrates BitNet.cpp capabilities on standard CPUs
- Fully automated setup process
- Designed for quick and easy testing
The demo showcases how BitNet.cpp can perform AI model inference on CPUs, making it accessible for devices without high-end GPUs.
Testing instructions and expected outputs are included in the demo notebook.
@labKnowledge please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]Options:
- (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
@microsoft-github-policy-service agree
- (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
@microsoft-github-policy-service agree company="Microsoft"Contributor License Agreement
@microsoft-github-policy-service agree