falcon-play icon indicating copy to clipboard operation
falcon-play copied to clipboard

Command-line script for inferencing from models such as falcon-7b-instruct

Results 1 falcon-play issues
Sort by recently updated
recently updated
newest added

I'm trying to set it up on Windows, and while I had no problem to set up CUDA ( python returns True to torch.cuda.is_available() ) But it seems that the...