posthog.com icon indicating copy to clipboard operation
posthog.com copied to clipboard

Blog: How we captured billions of events in Django (and why we rewrote in Rust)

Open ivanagas opened this issue 1 year ago • 1 comments

Changes

A big blog on the evolution of our capture endpoint, lightweight capture, and the process of rewriting in Rust. The goal is to show off the work we’ve done to help with recruitment (at the request from Tim)

I would appreciate feedback on:

  • Am I missing any high impact activities done before lightweight capture to improve the capture endpoint?
  • Specific technical details about why a decision was made, interesting aspects of the implementation, and the outcome of the decision, especially around the Rust rewrite.
  • More details about why we chose Rust specifically.1

Reviewing or even pointing me to specific reviews and issues that would be helpful (I already used as many as I could find).

Checklist

  • [x] Words are spelled using American English
  • [x] Titles are in sentence case
  • [x] Feature names are in sentence case too
  • [x] Use relative URLs for internal links

Article checklist

  • [ ] I've added (at least) 3-5 internal links to this new article
  • [ ] I've added keywords for this page to the rank tracker in Ahrefs
  • [ ] I've checked the preview build of the article
  • [x] The date on the article is today's date

Useful resources

ivanagas avatar Mar 22 '24 16:03 ivanagas

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
posthog ✅ Ready (Inspect) Visit Preview Mar 22, 2024 4:43pm

vercel[bot] avatar Mar 22 '24 16:03 vercel[bot]

Anything we can do to nudge this one along? (e.g. can someone else review who isn't @timgl ?)

charlescook-ph avatar Apr 18 '24 13:04 charlescook-ph

Happy to do an edit but would need someone to jump in and do the technical review ahead of that.

jtemperton avatar Apr 18 '24 20:04 jtemperton