The HDFS batch search job identifies the matching records for the input data in the output files of a HDFS tokenization job. The HDFS batch search job reads the input data in HDFS and creates the output files that contain the matching records for the input data in HDFS.
The following image shows how the HDFS batch search job searches for the matching records:
When you run the HDFS batch search job, the job performs the following tasks:
Reads the input files in HDFS.
Compares the input data against the tokenized data that a HDFS tokenization job creates.
Writes the matching records for the input data to the output files in HDFS.
The number of output files depends on the number of reducers that you run.