Redpanda Examples

A collection of examples to demonstrate how to interact with Redpanda from various clients and languages. Redpanda is Kafka API compatible. Any client that works with Kafka will work, but we have tested the ones listed here.

Directory

Clients

There are a growing number of client examples. Submit any new and/or interesting examples with a pull request!

Ebooks microservices payments

The Ebooks folder contains a Java app built with Quarkus, which is a popular Java framework that uses Redpanda to power its Kafka dev service (see this article for more details). The Ebooks app implements a consumer which validates payments.

Spark

The spark app shows how to read and write to Redpanda with Spark streaming. A producer writes stock activity, then a streaming app reads this data from a topic and sends it into a Spark SQL DataFrame. Spark then modifies the events before writing to another topic. A consumer app then reads these modified events. More details here.

WebAssembly Transforms

The wasm app shows how to create a JavaScript-based module that compiles to WebAssembly, and uses an Avro schema to serialize JSON events. More details here.

Partner Integrations

Below is a sample of some of our partner integrations.

Deephaven

Deephaven is an open-core query engine for building apps and analytics with real-time streams and batch data.

Redpanda + Deephaven Demo

The demo follows closely the one defined for Materialize. We want to showcase how you can accomplish the same workflow in Deephaven, with Deephaven's query engine and Redpanda's streaming capabilities.

Docker-stats

Need to monitor your local machine in real time? This example publishes your docker stats to Redpanda. Written in Python, this is an out-of-the box solution to see when your Docker containers over-use their resources. See full example here: deephaven-examples/redpanda-docker-stats.

Stock Market

Want to monitor updating stock market data? Or see how to publish multiple topics to Redpanda? This example creates tables to see stocks from dxFeed. See full example here: deephaven-examples/redpanda-dxfeed-financial-data.