BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

Demo bitnet.cpp on Google Colab CPU

Open labKnowledge opened this issue 1 year ago • 2 comments

BitNet.cpp Demo on Google Colab: CPU-based Testing

This PR introduces a demo for BitNet.cpp running on Google Colab's CPU environment. Key features:

  1. Demonstrates BitNet.cpp capabilities on standard CPUs
  2. Fully automated setup process
  3. Designed for quick and easy testing

The demo showcases how BitNet.cpp can perform AI model inference on CPUs, making it accessible for devices without high-end GPUs.

Testing instructions and expected outputs are included in the demo notebook.

labKnowledge avatar Oct 19 '24 20:10 labKnowledge

@labKnowledge please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.

@microsoft-github-policy-service agree [company="{your company}"]

Options:

  • (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
@microsoft-github-policy-service agree
  • (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

labKnowledge avatar Oct 20 '24 14:10 labKnowledge

@microsoft-github-policy-service agree

labKnowledge avatar Oct 20 '24 14:10 labKnowledge