Boostrapper Configuration

The bootstrapper is the mechanism that is used to load stream config into normalizer. You can configure the boostrapper class on the config file, using bootstrapper.classname property. Currently, the normalizer has two bootstrappers:

Bootstrappers

KafkaBootstrapper

io.wizzie.bootstrapper.bootstrappers.impl.KafkaBootstrapper

This bootstrapper read the stream config from Kafka, so you can change the stream topology without restart the service. The bootstrapper is reading the topic __normalizer_bootstrap using a kafka consumer instance with a random group.id.

Property Description
bootstrap.kafka.topics Topics that are used to read the bootstrapper configuration
application.id The app id to identify the client configuration
bootstrap.servers The kafka broker to read the bootstrapper configuration

StreamerKafkaConfig

The StreamerKafkaConfig tool allows us to send new stream config to the normalizer and read the current stream config.

You can use the script streamer-kafka.sh to use this tool. The tool has two modes:

Read Mode

The read mode allows us to read the current stream configuration to specific normalizer instance.

bin/streamer-kafka.sh $BOOTSTRAP_KAFKA_SERVER $APPLICATION_ID
Write Mode

The write mode allows us to send new stream configuration to specific normalizer instance.

bin/streamer-kafka.sh $BOOTSTRAP_KAFKA_SERVER $APPLICATION_ID $STREAM_CONFIG_FILE

FileBootstrapper

io.wizzie.bootstrapper.bootstrappers.impl.FileBootstrapper

This bootstrapper read the stream config from local file system, and build a KS topology using this file. You need to add the properties on the configuration file.

Property Description
file.bootstrapper.path Stream config file path

Library: config-bootstrapper