Base Configuration
The configuration file is a JSON format file where you specific the general properties to configure the normalizer instance. This file is different that stream config file that define the KS topology.
Example configuration file:
{
"application.id": "ks-normalizer-app-id",
"bootstrap.servers": "localhost:9092",
"num.stream.threads": 1,
"bootstrapper.classname": "io.wizzie.normalizer.builder.bootstrap.KafkaBootstrapper",
"metric.enable": true,
"metric.listeners": ["io.wizzie.metrics.listeners.ConsoleMetricListener"],
"metric.interval": 60000,
"multi.id": false
}
| Property | Description | Default Value |
|---|---|---|
application.id |
This id is used to identify a group of normalizer instances. Normally this id is used to identify different clients. | - |
bootstrap.servers |
A list of host/port pairs to use for establishing the initial connection to the Kafka cluster. The client will make use of all servers irrespective of which servers are specified here for bootstrapping—this list only impacts the initial hosts used to discover the full set of servers. This list should be in the form host1:port1,host2:port2 |
- |
num.stream.threads |
The number of threads to execute stream processing. | 1 |
bootstrapper.classname |
The bootstrapper class reference. More info: Bootstrapper | - |
metric.enable |
Enable metrics system. | false |
metric.listeners |
Array with metrics listeners. More info: Metrics | [“io.wizzie.metrics.listeners.ConsoleMetricListener”] |
metric.interval |
Metric report interval (milliseconds) | 60000 |
multi.id |
This property is used when you have multiple normalizer instances with differences application.id and the normalizer uses the same topic names. More Info Multi Tenant |
false |
metric.enable |
Enable metrics system. | false |
max.kafka.output.topics |
Max number of kafka topics that the normalizer can create to send data using the stream config | Integer.MAX_VALUE |
Note: If you want to configure specific Kafka Streams properties, you can add these properties to this config file. The properties key.serde and value.serde will be overrwritten by normalizer.