erlexec icon indicating copy to clipboard operation
erlexec copied to clipboard

Think about making multimodal as first class citizen in the protobuf

Open samsja opened this issue 3 years ago • 0 comments
trafficstars

Context

We want docarray to fully support multi modal features. ATM we have the dataclass feature that allow to do this easily. Nevertheless this multiodal feature is not first class citizen. Our protobuf still does not offer the same flexibility as our dataclass. There are two layers, protobuf with chunk and content and dataclass that map the multi modal feature to the protobuf definition.

We should remove the extra layer, make multi modal first class citizen in the protobuf.

This will make the goal of docarray for multi modal clearer + it will be easier for anybody to ship an interface for docarray in other programming language.

samsja avatar Sep 21 '22 08:09 samsja