Pengyu Hou

icon company @airbnb icon location Silicon Valley icon location Software engineer @airbnb. PMC member of Chronon.

Results 8 issues of Pengyu Hou

Add flushBeforeClose for eventual persistent database

1 comment

Right now, the eventual persistent database doesn't support flushBeforeClose feature. It would be great to add `flushBeforeClose` flag to the close method for eventual persistent database.

feature

Update rowcount.pig

Make sure there is a mutation table for mutation sources

## Summary In this PR, we will check if there is a mutation table in the entity source to determine if it is a mutation source. The entity source itself...

add logback.xml

## Summary ## Why / Goal ## Test Plan - [ ] Added Unit Tests - [ ] Covered by existing CI - [ ] Integration tested ## Checklist -...

force overwrite metadata in table properties

## Summary Added a new flag to overwrite metadata if needed to avoid dropping previously computed intermediate tables ## Why / Goal This PR can avoid dropping the previously computed...

Group by upload: use repartition to increase parallelism

## Summary The group by upload input rdd has less number of partitions with compact size. It can leads to executor OOM while converting to chronon row. Use the default...

[Kaggle outbrain example] Dockerized the outbrain Kaggle example

## Summary This PR updates the Kaggle example to run it with docker images. It saves the user efforts to setup their local machines. ## Why / Goal Simplify the...

[wip] Avro schema

## Summary https://github.com/airbnb/chronon/pull/834 ## Why / Goal ## Test Plan - [ ] Added Unit Tests - [ ] Covered by existing CI - [ ] Integration tested ## Checklist...