# New Data Execution System

Toucan **Highly Available Data Execution System** (HADES) is the result of two years of R\&D to provide the most efficient data execution layer for an embedded analytics tool relying on the latest technologies available. HADES improves data execution efficiency.

### General

HADES is a multi-tenant service dedicated to executing data queries.

Its mission is to

* receive data pipelines,
* process data pipelines, and
* deliver the results efficiently.

<figure><img src="https://1809014303-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FZxYYf1KpgarKMgMsDCrw%2Fuploads%2Fgit-blob-9387aa382eb43679956c52b35ea201f4b4a1f1c1%2Fhades_corrected_apr_25.png?alt=media" alt=""><figcaption><p>HADES : simplified schema of HADES interactions with other services</p></figcaption></figure>

HADES is designed to address the limitations of our previous execution system.

It results in better rendering times for data-intensive dashboards (see [Better than ever](https://www.toucantoco.com/en/blog/multi-tenant-architecture) results in our blog post dedicated to HADES) and a smoother data preparation experience.

Our new Data Execution System enables more users to interact with their analytics dashboards simultaneously without experiencing slowdowns through improved handling of concurrent queries.

HADES ensures a faster experience for builders and viewers who have already accessed the same dashboard or underlying queries.

This system still maintains strict data isolation between customers with dedicated S3 buckets to each customer.

It also leverages on multi-tenant architecture benefits with a better peak management and high availability.

### Data pipeline processing

HADES natively implements [hybrid pipelines](https://www.toucantoco.com/en/blog/product-release-hybrid-pipelines), to seamlessly blend on-source and in-memory data pipelines processing. We determine the optimal execution engine for each step of a data transformation pipeline prioritizing [execution directly on the source database](https://docs-v3.toucantoco.com/datasets-in-toucan/preparing-data/youprep-tm-native-sql#overview) when possible, and switching to in-memory processing for unsupported operations.

### How to test the new service

If you use a **supported connector** (see release note) want to test our new service, you can contact your CSM or our support.

#### **IP Allowlisting**

{% hint style="info" %}
Our new service is accessible to an unique IP (EU area) :\
`51.15.128.70`\
\
Whitelist your backend IP as well.
{% endhint %}


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs-v3.toucantoco.com/data-management-in-datahub/new-data-execution-system.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.