Installation and Configuration Guide

10.1 HotFix 1
- 10.1

Back Next

Configuring the Required Parameters in the Configuration File

You must configure the parameters related to Kafka in the configuration file. You can also configure the processing mode that indicates whether you want to link or tokenize the input data.

Open the configuration file in a text editor.

To configure Kafka, configure the following parameters within the

RealTimeService

section:

Broker: Host name of the machine that hosts Kafka and the port number on which Kafka listens. If you use a Kafka cluster, you can specify multiple host names and port numbers separated by commas.; Use the following format to specify the host name and the port number:
<Host Name1>:<Port1>,<Host Name2>:<Port2>,...<Host NameN>:<PortN>
For example,
KafkaBroker2:9092,KafkaBroker1:9092
TopicName: Name of the Kafka topic to which you want to publish the input data.
KafkaPrincipalName: Required if you use Kerberos for authentication. Kerberos principal name of the Kafka broker on which you plan to deploy the Spark instance.; Use the following format for the Kerberos principal name:; kafka/<Full name of the Kafka broker host>@<Realm>; For example,
kafka/kafka1.hostname.com@EXAMPLE.COM
KafkaKeyTabFile: Required if you use Kerberos for authentication. Absolute path and file name of the keytab file that contains the Kerberos principal name you specify.; For example,
/etc/security/keytabs/kafka_server.keytab; The directory that contains the keytab file must not be SELinux enabled. To remove the SELinux permissions from a directory, use the
setfattr
command.; In a distributed Hadoop cluster, ensure that the name of the keytab file and the absolute path to the file are the same for all the nodes.

To configure the processing mode, set the

ALTERNATETABLEFORGROUPINFO

property within the

MetaData

section.

Use one of the following values:

True. Indicates to perform the linking process.

False. Indicates to perform the tokenization process. Default is false.

Save the file.

For example, the following sample code contains the Kafka parameters:

<RealTimeService>
   <Broker>localhost:9092</Broker>
   <TopicName>test-22</TopicName>
   <KafkaKeyTabFile>/etc/security/keytabs/kafka_server.keytab</KafkaKeyTabFile>
   <KafkaPrincipalName>kafka/kafka1.hostname.com@EXAMPLE.COM</KafkaPrincipalName>
</RealTimeService>

Rename Saved Search

Table of Contents

Installation and Configuration Guide

Installation and Configuration Guide

Configuring the Required Parameters in the Configuration File

Configuring the Required Parameters in the Configuration File