Saeed Bastani

synaptic bit-slicing

4

Hi, I was wondering if and how synaptic bit-slicing is supported by the simulator? For example, the needed weight precision is 4 bits but the device only supports 2 bits...

What is the memory size of Snapdragon 8 Elite Mobile Platform used in performance profiling of LLMs? Also the name of the specific mobile phone.

Does not detect and run on GPU

6

I have tested the app on Qualcomm Snapdragon 8 Elite. It only runs on CPU, but not GPU. Does not even detect the GPU.

Failed to load OmniNeural-4B-Mobile on Samsung S25 Ultra

34

I am trying to deploy OmniNeural- 4B on Android smartphones with Qualcomm Snapdragon 8 Elite SoC such as Samsung S25 Ultra. I am following the instruction in Nexa Android SDK...