Table of Contents

Search

  1. Preface
  2. Data Profiling
  3. Profiles
  4. Profile results
  5. Tuning data profiling task performance
  6. Troubleshooting

Data Profiling

Data Profiling

Creating Filters

Creating Filters

You can create one or more filters in a profile. You can add a simple conditional or SQL filters to a profile.
You can create filters on the partitioned fields for profiles that you create with Avro and Parquet source objects for Amazon S3 or Azure Data Lake Store connection.
  1. On the Filter tab, click Add ( The image shows the Add icon. 
				).
  2. In the
    New Filter
    dialog box, enter a name for the filter. Optionally, add a description for the filter.
  3. In the
    New Filter
    dialog box, create the following filter types:
    • Simple
      . To enter a simple filter condition, click Add ( The image shows the Add icon. 
				  ). Choose a column and an operator, and enter a valid value. If required, continue to add more filter conditions.
      The following image shows a sample
      New Filter
      dialog box with a simple filter condition:
    • Query
      . To add a SQL query as a filter, select
      Query
      from the filter type options, and then type in or paste an SQL query in the text box.
      The following image shows a sample
      New Filter
      dialog box with a query filter:
  4. Click
    OK
    .
    The filter appears on the
    Filter
    tab. Add multiple filters if required.

0 COMMENTS

We’d like to hear from you!