Spring2024_Data_Streaming_Platform_with_Apache_Kafka

[heanhsok]

Final Submission

Date: May 9, 2024

Dear Prof. @gpsaggese and @Shaunak01,

I would like to submit the final version of my project. I have uploaded a copy of the README.md file (along with the necessary assets folder) to Canvas too. The link to the video walkthrough is also included in the README.md file as well. Please let me know if you have any questions or feedbacks.

Thanks, Heanh

---

First Checkpoint Updates:

Date: Apr 24, 2024

Following are the progress I have made:

• create docker-compose file that defined all the necessary containers (such as Zookeeper, Kafka Broker, Jupyter, Schema Registry, Postgres) for the project
• create a Kafka Tutorial in Jupyter notebook
• create producer and consumer that continuously producing and consuming stream of messages
• write project documentation which includes the following sections:
  • Overview
  • Technologies Used
  • Project Structure
  • Docker Implementation
  • How to Run
  • Kafka Tutorial
  • Implementing Data Streaming Platform
  • Cleaning Up