nnstreamer

nnstreamer copied to clipboard

[Single] Add asynchronous invoke callback for tensor_filter_single Introduced a new API g_tensor_filter_single_set_invoke_async_callback to support asynchronous invoke operations. - Allows users to register a callback function (invoke_async_callback) for handling outputs asynchronously....

songgot

[Test] Add test for llamacpp

1

- Add a simple testcase for tensor_filter with llamacpp sub-plugin

songgot

# Issue Description tensor_transform is incapable of outputting `other/tensors,format=flexible`. Expected Result ============ tensor_transform is documented as capable of outputting `other/tensors,format=flexible`. How to Reproduce =============== 1. `GST_DEBUG=6 gst-launch-1.0 -v videotestsrc !...

ethanfowler

Hi team, I have tested pytorch 1.11.0 and it worked fine before. Does nnstreamer work with pytorch 1.12 or some newer version of pytorch? Thanks!

liuhao-97

Add custom property for edgesrc/edgesink. , separated options(key:value) are set on the edge handle. **Self evaluation:** 1. Build test: [*]Passed [ ]Failed [*]Skipped 2. Run test: [*]Passed [ ]Failed [*]Skipped

gichan-jang

Inviting Manufacturer as Subplugin Maintainer

2

There are manufacturer-written subplugins, which cannot be tested or maintained by current maintainers. I propose to invite maintainers from manufacturers who have been writing nnstremer subplugin: - NXP - Does...

myungjoo

Possible new subplugin requirement: hailo-rt

1

This new subplugin can be taken by anyone as we do not have any official requests from clients. Anyway, there are Tizen contributors upstreaming "HAILO-RT" NPU libraries to tizen.org, which...

myungjoo

[ML Agent/Service] ML Service C API in Android

1

It is required to support the equivalent behaviors of ML.inference, ML.service C APIs for Android. (including data/model repo and rpk support) CC: @jaeyun-jung @niley7464 Note: offloading support and data repo...

myungjoo

Langchain support with multi-modality

1

Langchain itself can be supported as a subplugin. For multi-modality support along with langchain, a futher design might be required.

myungjoo

[Design] tensor-filter HAL for layer separation

1

Approach A. - Interface in C struct with function pointers - Caution: there can be 2 or more instances of NPU HAL objects! (we already have one coming soon) -...

myungjoo