posthog icon indicating copy to clipboard operation
posthog copied to clipboard

feat(plugin-server): add ingestion warning when historical event timestamps too recent

Open eli-r-ph opened this issue 7 months ago • 1 comments

Problem

Based on a support ticket discussion. Event capture routes events to our historical ingest pipeline if the incoming batch request is marked for historical_migration or if the event timestamps are older than 24 hours.

This is supposed to make the ingest events free of charge. However, the billing query will pick up the events regardless if the timestamp is in fact set to 24 hours ago or less.

After discussion with billing folks, we decided to update the migration documentation to more clearly call this out, and to consider adding an ingestion warning so users and PH admins have an audit trail when this happens.

This PR implements that warning.

Changes

  • Adds an ingestion warning check to the plugin-server when an even comes through the historical ingestion pipeline with a timestamp less than 24 hours from "now" UTC.

Did you write or update any docs for this change?

Being handled separately ✅

How did you test this code?

Locally and in CI

eli-r-ph avatar Jun 05 '25 22:06 eli-r-ph

This PR hasn't seen activity in a week! Should it be merged, closed, or further worked on? If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in another week. If you want to permanentely keep it open, use the waiting label.

posthog-bot avatar Jun 16 '25 07:06 posthog-bot

After the corresponding docs update shipped, we haven't heard from any more confused users. Closing this out - can revisit if needed later 👍

eli-r-ph avatar Jun 21 '25 17:06 eli-r-ph