spear icon indicating copy to clipboard operation
spear copied to clipboard

Published 20 hours ago • verified publisher icon NFIBrokerage

projections API

Open the-mikedavis opened this issue 3 years ago • 4 comments

connects #7

the projections API is a bit cryptic for me

I've been able to hobble my way through the rest of the protos pretty much just on sheer experimentation and checking with the other client libraries. The projections API is a bit out there and I'm not really sure what the difference is between a continuous, a transient, and a one-time projection (just to begin with). The Event Store team is supposedly in a major documentation refactor, so I'm gonna put this one on hold and go get the more familiar persistent subscriptions API.

the-mikedavis avatar Apr 20 '21 20:04 the-mikedavis

looks like the eventstore team threw up some docs on the grpc projections API https://developers.eventstore.com/clients/grpc/projections/ just yesterday :rocket:

the-mikedavis avatar Aug 19 '21 21:08 the-mikedavis

Hi there, have you been able to look at the new documentation and understand projections better yet?

(untold underlying question: any idea how complex and time consuming implementing them would be?)

TiteiKo avatar Sep 14 '22 19:09 TiteiKo

I haven't looked into it myself. We drive projections through the HTTP API since the HTTP API is easier to integrate with infrastructure-as-code tools (terraform, ansible, etc.), so we don't have a good use-case for using projections via Elixir.

With the addition of subscriptions/reads of the $all stream and filters though, projections are no longer very useful to us in general. They cause some write-amplification when you have many of them which can be avoided by with $all+filters.

I would prefer that the projections API code is added by someone with a use-case for it. It should be somewhat easy: Spear just needs a nice wrapper for the projection RPCs in projections.proto:

  • new functions in lib/spear.ex
  • wrappers for those new functions in lib/spear/client.ex
  • some test cases

https://github.com/NFIBrokerage/spear/pull/49 could be used as a good example.

The gRPC code already exists (https://github.com/NFIBrokerage/spear/blob/main/lib/spear/records/projections.ex) so you could use projections now with a combination of Spear.Records.Projections macros and Spear.request/5 if you need.

the-mikedavis avatar Sep 16 '22 10:09 the-mikedavis

I didn't know that $all + filters was as, if not more, viable than projections. I'll keep it simple and make the most out of the existing tools.

Thank you for taking the time to answer ✨

TiteiKo avatar Sep 18 '22 08:09 TiteiKo