data-models
data-models copied to clipboard
snowplow
⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.
[This](https://github.com/snowplow/data-models/blob/master/mobile/v1/bigquery/sql-runner/playbooks/standard/04-sessions/01-sessions-main.yml.tmpl#L16-L20) looks like a copy paste error - please delete. Typically our default customer schema name for the atomic dataset in bigquery is 'rt_pipeline_prod1', would it be possible to set...
Reference: https://github.com/snowplow-incubator/dataform-data-models/issues/6
This is most likely my fault, but just noticed that all of the README headings bar the top one should have one more `#`. Just one should be reserved for...
Inconsistent naming of the tstamp between sessions_userid_manifest_staged and sessions_userid_manifest_this_run. Suggest we change `min_tstamp` to `start_tstamp` [here]( https://github.com/snowplow/data-models/blob/e1e10fb696a52aa9bc990e975154405779f421de/web/v1/bigquery/sql-runner/sql/standard/03-sessions/01-main/05-sessions-prep-manifest.sql#L22) to align with other web models.
GBQ & Snowflake web models contain a `start_date` variable in the main users playbook, which is used to seed the `users_manifest` table during creation. The use of a variable here...
If there's some issue in the atomic data for a period of time (eg failed events) that gets fixed subsequently to a model running over the time period, reprocessing involves...
The table `{{.scratch_schema}}.pv_upsert_limit{{.entropy}}` should be dropped as part of the step `99-page-views-cleanup.sql`. Needs to be added.
Using `MERGE` instead of `DELETE FROM`, `INSERT INTO` might well prove more performant and cost efficient, particularly in the case of BigQuery. We should test this, and implement `MERGE` if...
In some instances the `screen_id` generated by the screen view context during a screen view event does not equal the `screen_view_id` which is incorrect. This is thought to be state...