Create an @embedding decorator used for projection, KNN, etc.

[cabreraalex]

Often times we just want to get an embedding from the input data, NOT the output data. Currently we only support embeddings that come with a model prediction.

It would be nice to have embeddings run just once on the input data.

One option is to have this be a @distill function that we annotate as an embedding....

We could also generalize this to annotations for projections too?

[cabreraalex]

@xnought thoughts?

[xnought]

Hmm good thought. I like the idea with the distill functions.

[xnought]

Yeah but for stuff that needs the full data to compute, we would need a different system.

Like tsne could not work on distill unless we allow people to define batch sizes in the distill decorator itself distill(batches=1) so it just gets run on the entire data.

[cabreraalex]

ah yeah I keep forgetting about the fns that need the whole dataset