Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

Product telemetry instrumentation

Open andrewm4894 opened this issue 2 years ago • 9 comments

This is for sure a bit premature but just wanted to mention. If we have a need for product telemetry on the frontend then I'd recommend and be happy to help set up posthog.

They have a free cloud offering, are developer first, open source, very responsive and we can customize to any level of analytics as we need or want (e.g different levels of opt in or out etc). They also make it easy to publish public dashboards which could be handy for this project.

Just thinking if we want simple ways to get product analytics that we can share back with users, help with spotting bugs or issues and generally understanding usage patterns. All in a totally open and non creepy way, can be as anonymous or not as we want.

(At netdata we made it anonymous in the open source project (example) and a more traditional implementation in our cloud offering)

Anyway, probably something we not thinking about right now but could be useful and helpful for getting this sort of usage insights back out of it without crazy complex backend work.

https://github.com/PostHog/posthog

andrewm4894 avatar Jan 06 '23 21:01 andrewm4894

And alternative is also Prometheus: https://prometheus.io/

fozziethebeat avatar Jan 13 '23 07:01 fozziethebeat

Other alternatives:

Google Analytics https://analytics.google.com/

OpenTelemetry (open-source, requires setup): https://opentelemetry.io/

AbdBarho avatar Jan 13 '23 08:01 AbdBarho

Looking at the options briefly, Posthog looks like its the most analogous to Google Analytics. I like that they have a posthog-foss repo that's 100% FOSS. I propose we give Posthog FOSS a shot and see how well it works.

fozziethebeat avatar Jan 16 '23 12:01 fozziethebeat

My big question tho is what are the premium features for posthog that are under the ee directory? I'm hoping they're not that useful since using them with self hosting requires a license.

fozziethebeat avatar Jan 16 '23 12:01 fozziethebeat

Trawling reddit found Umami an MIT licensed project. It requires a little more work than PostHog but it looks like it'd plug into NextJS well and use our current database.

fozziethebeat avatar Jan 16 '23 12:01 fozziethebeat

I would +1 PostHog and happy to help with implementation or anything as i'm very familiar with it and this space in general.

I'd suggest just starting with their free cloud tier since gets 1st million events free (am sure we could ask them to see about maybe sponsoring some amount above that (if was ever needed) maybe potentially as an open source project ourselves).

If we wanted to self host afaik there is not really any major differences in terms of features or things that would be missing, just more about managing it ourselves (docs). We have done both at Netdata, anon stats docs where i work, started with self hosting but have since moved to their cloud as one less infra thing to worry about.

andrewm4894 avatar Jan 16 '23 12:01 andrewm4894

Also another option: https://github.com/plausible/analytics https://plausible.io/docs/self-hosting

AbdBarho avatar Jan 16 '23 15:01 AbdBarho

I think Umami or Plausible are the best options. Both look like they fully support self hosting. Given the rest of our stack can be fully self hosted, I think our analytics solution should follow that trend. We'd make it harder for others to deploy their own versions if they had to depend on posthog cloud.

fozziethebeat avatar Jan 19 '23 06:01 fozziethebeat

https://github.com/supabase/supabase

AbdBarho avatar Jan 20 '23 13:01 AbdBarho