OnnxStream

OnnxStream copied to clipboard

=== ERROR === Model::get_tensor_data: input tensor not found: input_5F_ids

1

I'm getting tensor errors after the build is completed. Not sure I do things right, as I had to create a symbolic link `text_encoder_fp32 -> stable-diffusion-xl-base-1.0-onnxstream/sdxl_text_encoder_1_fp32` to do so. ```bash...

JonRiv

=== ERROR === unable to open file: ./tokenizer/vocab.txt

1

```bash ./sd ----------------[start]------------------ positive_prompt: a photo of an astronaut riding a horse on mars negative_prompt: ugly, blurry output_png_path: ./result.png steps: 10 ----------------[prompt]------------------ === ERROR === unable to open file: ./tokenizer/vocab.txt...

JonRiv

compiling in raspi 4

4

trying to build on raspi 4 with rasbain os 64 bit everything works fine until in try. "cmake --build . --config Release" command for OnnxStream Not sure what i am...

RorschachTest

compiling on rpi zero 2

13

i'm following the instrcutions trying to compile xnnpack on raspberry pi zero 2 and running into issues am i missing something else i need to install? `Scanning dependencies of target...

novaspirit

OnnxStream and TinyLlama?

1

I was just wondering but would the methods used in OnnxStream further benefit a tiny language model like [TinyLlama?](https://github.com/jzhang38/TinyLlama). Just wanted to know how far resource usage could be brought...

stl3

Very slow performance on Ryzen 7 4700u + more features and command line options needed

1

Hi. Thank you for this perfect SD implementation. I downloaded a Windows version from releases and ran it on Ryzen 7 4700u, 16gb ram. 1 step needs 42 seconds to...

JohnClaw

build

30

can this be built for linux arm 64? say termux environment . also i would like to know about the inference speed

Fcucgvhhhvjv

Compiler Optimizations Flags in Makefile

1

Hi, I asked ChatGPT about some optimization flags for the 'CMakeLists.txt' and it came up with this, to append at the EOF: target_compile_options(sd PRIVATE -O3 -march=native -mtune=native -funroll-loops -finline-functions -ffast-math...

tessellated

=== ERROR === failed to create multiply operation

3

im getting this error: ----------------[start]------------------ positive_prompt: a photo of an astronaut riding a horse on mars SDXL turbo doesn't support negative_prompts output_png_path: astronaut.png steps: 7 seed: 798720 ----------------[prompt]------------------ Token: "a"...

kroryan

Optimizations for Pi AI hat (Hailo)

1

I'm taking a crack at trying to integrate OnnxStream and [OnnxStreamGUI](https://github.com/ThomAce/OnnxStreamGui/) (web) into the same Docker container (while also trying to learn PHP in the process) on my RPi 5...

eiddor