Creating datasets
Last updated
Was this helpful?
Last updated
Was this helpful?
On this page, you will learn how to create datasets:
From connectors
From datasets
Limits on number of rows
The maximum number of rows is set at 1M (for both live and stored dataset). However, when being under that results on a dataset that has less than 1M of rows, there wont be any limitation.
You already configured a connector, that you want to use in order to retrieve your data. For that:
Click on the dataset creation button on from your configured connector
Make the appropriate configuration in order to retrieve the data. Refer to your connector in order to setup the configuration
Validate the configuration
Prepare your data thanks to our no-code transformation tool YouPrep™ (know more about YouPrep )
Save your new dataset by clicking on the button "Create" (at the bottom).
Give a name to the dataset (the name shouldn't be already used by another dataset), and select the storage type between storing it in Toucan, or having it as LIVE data.
Click on "Save" to save your dataset. If you store the dataset in Toucan, you also canto "Save and refresh" the dataset in order to make it available to use
You already have some datasets you want to rely on for creating child datasets. It's very easy to do it within the "Datasets" tab of the Datahub.
Follow the different steps to create a child dataset from another dataset:
Identify the dataset that you would like to use as a source (“Home 1” in the example) of your new dataset, and click on the “Create from” button on the right part of your listed dataset.
Save your new dataset by clicking on the button "Create" (at the bottom).
Give a name to the dataset (the name shouldn't be already used by another dataset), and select the storage type between storing it in Toucan, or having it as LIVE data.
Click on "Save" to save your dataset. If you store the dataset in Toucan, you also canto "Save and refresh" the dataset in order to make it available to use.
Tip: you can even create a child dataset from the Story Panel. You'll be redirected to the DataHub tab while you create your new child dataset. Take a look at this video.
Permissions
If you create a new dataset A, from dataset B that has permissions applied, and define the new dataset A as a Stored dataset, the permissions of the parent dataset won't be applied anymore. You will have to define the permissions again on your dataset if you need to secure the access to the data.
Dataset column naming
When the dataset is stored within Toucan, the column names should respect the following constraints:
The dataset shouldn't contain a column named "_id"
The dataset name shouldn't contain points (".")
When making the configuration in order to retrieve the appropriate data, note that you can refer to variables (more on variables in this ) instead of giving a fixed value.
Prepare your data thanks to our no-code transformation tool YouPrep™ (know more about YouPrep )
