tc-wolf

Click to expand! ### Issue Type Bug ### Source source ### Tensorflow Version 2.9.1 ### Custom Code No ### OS Platform and Distribution Ubuntu 20.04 LTS ### Mobile device _No...

Attempted workaround for reduce_mean with Hexagon delegates

4

Attempted workaround for reduce_mean - bump the index for axes reducing over by the number of 'padding' dimensions of size one we add when the input tensor is rank <...

- Had to change some i8 -> `std::os::raw::c_char` for c char arrays - Add bindgen output for linux arm64 - Started on compiling from scratch, though might want to abandon...

Should be fixed by #79

Re-use images (only changing parameters)?

2

My current workflow is to use the gcloud CLI to submit jobs with a common base image and differ the parameters (used in a CI setting). I like that in...

The 'get_preprocessed_entry_point" isn't run if the distribution strategy is None and the entry point is a python file (ends in ".py"): https://github.com/tensorflow/cloud/blob/master/src/python/tensorflow_cloud/core/run.py#L266-L282 This is a problem because this is the...

[QNN] Support non-Android aarch64 Linux targets for QNN backend?

1

I'm targeting Snapdragon 8 Gen 2 hardware, but it is using (non-Android) aarch64 Linux (under a QNX hypervisor) as the operating system. I've been able to use the QNN SDK...

LLM inference task questions (GPU implementation, KV cache)

4

I'm reviewing Mediapipe as a potential solution for non-Android embedded GPU inference (using an Adreno GPU) and wanted to ask some basic questions: * Is the implementation for GPU inference...

Fix compilation w/ metal feature enabled

7

* Link against `-ggml-metal.o` file When creating object file with `compile_metal`, the object file is `-ggml-metal.o`, not `ggml-metal.o` - looks like cc-rs does this in `objects_from_files` to avoid overwriting (in...

Compiling with metal feature has `ggml-metal.o` linker failure

3

``` error occurred: Command ZERO_AR_DATE="1" "ar" "cq" "/home/tc-wolf/rust-llama.cpp/target/release/build/llama_cpp_rs-75252caa56296e09/out/libbinding.a" "/home/tc-wolf/rust-llama.cpp/target/release/build/llama_cpp_rs-75252caa56296e09/out/./llama.cpp/common/common.o" "/home/tc-wolf/rust-llama.cpp/target/release/build/llama_cpp_rs-75252caa56296e09/out/./llama.cpp/llama.o" "/home/tc-wolf/rust-llama.cpp/target/release/build/llama_cpp_rs-75252caa56296e09/out/./binding.o" "/home/tc-wolf/rust-llama.cpp/target/release/build/llama_cpp_rs-75252caa56296e09/out/llama.cpp/ggml.o" "/home/tc-wolf/rust-llama.cpp/target/release/build/llama_cpp_rs-75252caa56296e09/out/llama.cpp/ggml-metal.o" with args "ar" did not execute successfully (status code exit status: 1). ``` This is because the...