🧑‍🍳YouPrep™ Native SQL

Overview

YouPrep™ Native SQL is our powerful option that allows to leverage all the power of your Datawarehouse or database, by delegating YouPrep transformation steps directly to your datasource.

How does it work? We translate your transformation pipeline made with YouPrep directly into one SQL statement. It's very powerful, specially when you must deal with a lot of data within your tables.

The NativeSQL option is available for several connectors:

• Athena

• BigQuery

• PostgreSQL

• Redshift

• Snowflake

Step coverage

Find below the availability of YouPrep steps under Native SQL:

Hybrid Pipeline

To address the issues caused by the lack of support of some steps, we have implemented a hybrid pipeline approach.

This means you can have a unique pipeline mixing NativeSQL supported steps and unsupported steps. All transformation steps can be executed regardless of context, with the flexibility to execute the pipeline partially in NativeSQL and partially in Toucan, depending on the steps utilized.

NativeSQL steps are executed first whenever possible. An unsupported step causes the Toucan engine to take over the pipeline.

How to activate the NativeSQL option

This option is activated by default on Toucan.

Some limitations