Table of Contents

Search

  1. Preface
  2. Part 1: Version 10.5.5
  3. Part 2: Version 10.5.4 - 10.5.4.x
  4. Part 3: Version 10.5.3 - 10.5.3.x
  5. Part 4: Version 10.5.2 - 10.5.2.1.x
  6. Part 5: Version 10.5.1 - 10.5.1.1
  7. Part 6: Versions 10.5 - 10.5.0.1
  8. Part 7: Versions 10.4.1 - 10.4.1.3
  9. Part 8: Versions 10.4 - 10.4.0.2
  10. Part 9: Versions 10.2.2 - 10.2.2 HotFix 1
  11. Part 10: Version 10.2.1
  12. Part 11: Version 10.2 - 10.2 HotFix 2

What's New and Changed (10.5.5)

What's New and Changed (10.5.5)

Profiling for Parquet File

Profiling for Parquet File

You can limit the number of Parquet files to profile in non-hive partitions to 10 in Amazon S3 V2 scanner. Use the following custom option in the Metadata Load Settings tab of the resource to enable limited profiling:
-DExecuteMetaParquet=true
To limit the number of files, ensure that
Disable Partition Pruning
in the Metadata Load Setting tab is unchecked. If you disable partition pruning, all the Parquet files in non-hive partitions will be profiled.
For more information, see the
Enterprise Data Catalog 10.5.5 Scanner Configuration Guide
.

0 COMMENTS

We’d like to hear from you!