Vito Plantamura
Vito Plantamura
Thank you :-) Vito
hi, It would be interesting to try running TinyLlama with OnnxStream but the problem would be latency. At the generation of each token, all weights would be read from disk...
hi, Please specify the "--xl" parameter for Stable Diffusion XL. You can use the "--models-path" parameter to specify the directory that contains the files downloaded from Hugging Face. Use the...
hi, simply start the application :-) The weights for SD 1.5 can be downloaded from the Releases section of this repo. Thanks, Vito
hi, you should download the Stable Diffusion weights before running the software. The path of the weights can be specified via the "--models-path" option when running the software. The weights...
@dstab001, just follow the instructions in the main README :-)
hi, thanks for the feedback. Yes, O3 and march=native can significantly increase performance. The other options can actually slow down or even compromise the accuracy of the math operations. Unfortunately...
hi, I waited a little while before replying. I myself am trying to figure out the best direction for the project :-) I don't think the integration with AUTO1111 is...
hi, I guess you can already achieve this functionality with stdout redirection, i.e. with the ">" operator. Furthermore, with the "tee" command you can save to file and simultaneously view...
The image is really cool and the idea of making a webpage is really nice! Keep me updated on your progress, Vito