rudder-transformer
rudder-transformer copied to clipboard
Open-source, warehouse-first Customer Data Pipeline and Segment-alternative. Collects and routes clickstream data and builds your customer data lake on your data warehouse.
⚠️ Docker image for rudder-transformer has been moved to new org rudderstack/rudder-transformer
RudderStack Transformer
RudderStack Transformer is a service which transforms the RudderStack events to destination-specific singular events. This feature is released under under the Elastic License 2.0.
Transformer Setup
Docker
If you want to run the RudderStack Transformer inside a Docker container, follow these steps:
- Clone this repository
- Run
docker-compose up transformer
Native Installation
On Mac, if you don't have make and g++, you would have to install Xcode Command Line Tools using xcode-select --install.
On Linux, install the required dependencies python, make and g++ and follow these steps:
- Clone this repository
- Setup the repository with
npm run setup - Build the service with
npm run build:clean - Start the server with
npm start
Transformer without User Functions
If you don't need user functions, you can skip those and run a destination-only transformer.
Docker
If you want to run the RudderStack Transformer (without the user functions) inside a Docker container, follow these steps:
- Clone this repository
- Run
docker-compose up transformer-no-func
Native Installation
On Mac, if you don't have make and g++, you would have to install Xcode Command Line Tools using xcode-select --install.
On Linux, install the required dependencies python, make and g++ and follow these steps:
- Clone this repository
- Setup the repository with
npm run setup - Build the service with
npm run build:clean - Start the server with
npm start
How to run the E2E tests locally
Run make setup( make setup-arm in case of arm processor(M1 chip)). This operation is needed only once.
Now you can run make test.
If you wish you can destroy the cluster manually with make destroy.
Contact Us
If you come across any issues while setting up or running the RudderStack Transformer, feel free to start a conversation on our Slack channel.