ingestion topic
crowd
👥 [WIP] An experimental High Available Reverse Proxy for Massive Asynchronous Message Consumption
azure-event-hubs-spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
gobblin
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch...
ibis
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
data-prepper
Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
net.jgp.labs.spark
Apache Spark examples exclusively in Java
borrow-bot
:moneybag: A bot for maximizing the borrow subreddit
hyperdrive
Extensible streaming ingestion pipeline on top of Apache Spark
CatraMMS
Media Management System: ingestion, processing, encoding, delivery, ...