Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Introduction to Databricks Connector
  3. Connections for Databricks
  4. Mappings for Databricks
  5. Migrating a mapping
  6. SQL ELT with Databricks Connector
  7. Data type reference
  8. Troubleshooting

Databricks Connector

Databricks Connector

Aggregator transformation

Aggregator transformation

You can configure full
SQL ELT optimization
to push an Aggregator transformation to process in Databricks.

Aggregate calculations

You can perform the following aggregate calculations:
  • AVG
  • COUNT
  • FIRST
  • LAST
  • MAX
  • MIN
  • SUM
  • STDDEV
  • VARIANCE

Incoming ports

When you configure an Aggregator transformation and the incoming port is not used in an aggregate function or in a group by field, the output is not deterministic as the ANY_VALUE() function returns any value from the port.
You can pass only single arguments to the LAST, STDDEV, and VARIANCE functions.

0 COMMENTS

We’d like to hear from you!