WebGPT
WebGPT copied to clipboard
0hq
Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.
Access to fetch at 'file:///C:/Users/idgaf/OneDrive/Desktop/WebGPT/models/better_shakespeare/params_gpt.json' from origin 'null' has been blocked by CORS policy: Cross origin requests are only supported for protocol schemes: http, data, isolated-app, chrome-extension, chrome, https, chrome-untrusted....
Example: https://github.com/josephrocca/gpt-2-3-tokenizer/issues/1
Hello @0hq, I think the below results are not the expected behavior.  Shakespeare Model.  GPT2 Model. # Environment Arch Linux Chrome Canary Version 114.0.5720.4 (Official Build) dev (64-bit)...
Hi! 👋 Thanks for sharing your project! I've got a question about this part of the Readme: https://github.com/0hq/WebGPT/blob/5ce0182a81a049784173be1ae19d4742d79a1768/README.md?plain=1#L15 On Chrome Canary v114, I couldn't see the difference between running it...
Steps to duplicate 1. Clone the repo 2. serve the files using `serve` npm package 3. Open on Canary with Unsafe WebGPU enabled 4. Click on "Load GPT2 Model" Current...
Hi! Reaching out from the Microsoft Edge team! When visiting kmeans.org with a browser that does not have WebGPU support the site recommends using Chrome.  Is it possible to...
Don't have time to add it to your systems in place, but this 3.5x the FLOPs for a very skinny matmul (cached KV inference) and should 4x decrease the model...