Heanh Sok
Heanh Sok
Hi Prof. @gpsaggese and @Shaunak01 Instead of using Jupyter notebook as my consumer, I want to use just Python script running inside a container as my consumer that reads data...
Following are the progress I have made: - create docker-compose file that defined all the necessary containers (such as Zookeeper, Kafka Broker, Jupyter, Schema Registry, Postgres) for the project -...
Additional Completed Items: - Add example of schema validation for producer and consumer using Apache Avro as data serialization Add example of data validation logic in our consumer - Improve...
Additional Completed Items: - Add example of data validation logic in our consumer - Add comments to code TODO: - Record a short video explaining the project and put in...
Additional Completed Items: - Record a short video walkthrough of the project. Project is completed.
> Could you explain what problem are we trying to solve with this issue? We have a script that can be run to sync labels from a yml file to...
- Not sure if we need this now that we use the dockerized executable approach (https://github.com/causify-ai/helpers/issues/560) ? @gpsaggese - If we want to get fancy, we can even run the...
- Should this be its own bounty or GSI? - This is going to be just a simple wrapper around the script that we have for syncing the label
### Example usage: ``` ❯ sync_gh_issue_labels.py \ --yaml ./labels/gh_issues_labels.yml \ --owner causify-ai \ --repo sports_analytics \ --token ******* \ --backup 00:46:21 - INFO hdbg.py init_logger:1013 Saving log to file '{'/Users/heanh/src/helpers1/dev_scripts_helpers/github/sync_gh_issue_labels.py.log'}'...
> Do you want to file follow-ups for the shell script and the docs? Or feel free to do it in this PR, up to you. Filed the followings as...