Docker Intro

Normalizer image: wizzieio/normalizer:latest

How to get Normalizer image

You can pull the docker image from our registry:

$ docker pull wizzieio/normalizer:latest

How to use this image

Normalizer requires a running Kafka broker before it starts.

Zookeeper

First, start a zookeeper container by executing:

$ docker run --rm --name zookeeper-svc --net=host wurstmeister/zookeeper

You can found more information about wurstmeister/zookeeper image here

Kafka

Now, start a kafka broker container by executing:

$ docker run --rm --name kafka-broker --net=host -e KAFKA_ADVERTISED_HOST_NAME=localhost -e KAFKA_ADVERTISED_PORT=9092 wurstmeister/kafka:0.10.2.1

You can found more information about wurstmeister/kafka image here

Start Normalizer

Once kafka broker is up, we can start a Normalizer container and link it to the kafka broker, and configuring the APPLICATION_ID environment variable with our custom app name:

$ docker run --rm --name my-normalizer --net=host -e APPLICATION_ID=my-normalizer-app -e KAFKA_BOOTSTRAP_SERVER=localhost:9092 wizzieio/normalizer:latest

Now you can follow the base tutorial to test Normalizer!

Using environment variables in normalizer configuration

You can configure the docker image using these environment properties:

Env Property Description Default Value
APPLICATION_ID This id is used to identify a group of normalizer instances null
KAFKA_BOOTSTRAP_SERVER Kafka servers list null
NUM_STREAM_THREADS Number parallelism 1
METRIC_ENABLE Enable the metrics true
METRIC_INTERVAL The interval time to report metrics (milliseconds) 60000
MULTI_ID Configure the multi.id property Multi Tenant false
MAX_OUTPUT_KAFKA_TOPICS Max limit of output kafka topics 500

You can found more information about base configuration here