data-engineer-handbook
data-engineer-handbook copied to clipboard
This is a repo with links to everything you'd ever want to learn about data engineering
Adding some fix suggestion for connectivity error thrown while connecting to PgAdmin
Hi Zach, just want to say that all the Discord links has been expired. Mind if you can update the link. Many thanks!
Added an extra step to try if the tables do not load in pgAdmin 4 without any error.(That was in my case and this worked for me)
#244 This fix is made due to an IllegalStateException when running command `make job`
When I run the command: ``` make job ``` or ``` docker compose exec jobmanager ./bin/flink run -py /opt/src/job/start_job.py --pyFiles /opt/src -d ``` The application fails to start due to...
Fixes issues with DatasetAPI notebook preventing it from executing. And using batch processing in Bucket-Join-In-Iceberg notebook to prevent OOM error.
Add to myself to LinkedIn as I focus on monetizing data skills as a content
Added a section for Data Lineage with an example of https://openlineage.io/
Suggested Javier for Linkedin Data Engineer