What you'll do#
Define a load, review its stages, publish a version, and run the first load explicitly.
Publishing the definition and running the data are different actions
The first publication creates version 1 and leaves the schedule off. Nothing is read or written at that moment. Turn on schedule and Run now are two other decisions, each with its own button.
The transformation follows the medallion architecture:
- Bronze — raw data, as it arrived from the source.
- Silver — clean, standardized data (types, dates, columns, conditionals).
- Gold — datamart ready for BI (aggregations, joins, business model).
Before you start#
- An authorized connection (see Connect your first source) or a file in the supported import flow.
- Be the workspace owner: Pipelines and Runs are owner areas.
- Know what can be read from the source and where it can be written.
- For the tutorial, use a small, synthetic dataset, with keys and values you know in advance.
- Subscription up to date. Running is an expensive action: when payment is past due, suspended, or canceled, the run is blocked with an explicit message and a link to Plans.
- The first load consumes cloud resources, charged in credits.
Where pipelines live#
In ETL/ELT → Pipelines. The list shows, per pipeline, the source connector, the schedule, and the last run — and the New pipeline button opens the builder.
Create the pipeline — guided mode (the simplest path)#
New pipeline opens four questions:
| # | Question | What you choose |
|---|---|---|
| 1 | Where does the data come from? | A saved connection, Upload a file or spreadsheet, or Connect a database |
| 2 | What to bring in? | The tables (database) or the files — and, for files, whether the new one replaces or is combined with the previous ones |
| 3 | When to update? | Only when I say so, Every day, at a set time (Brasília time), or Whenever I upload a new file |
| 4 | Review and create | Create and run now or Just create |
Guided mode brings in the whole table on every run. For loading only what changed, transformations, partitioning, alerts, or tools (Google Sheets, Ads, CRM), use Use full mode, described below.
Build the pipeline in full mode — the six stages#
Full mode (Use full mode, or New report in the list) has a single six-stage ruler, the same for extraction and for a Gold report:
| # | Stage | What you decide in it |
|---|---|---|
| 1 | Connections | Which saved connection the pipeline will reference. The credential isn't copied. |
| 2 | Data | Which tables, files, or endpoints come in, with fields, types, and a sample when authorized. |
| 3 | Load | The load mode and the effect on the target: replace, merge, and append are not the same thing. |
| 4 | Transformations | The Silver/Gold stages that fit the task, and the dependencies in the graph. |
| 5 | Operation | Schedule, limits, retries, and alerts. |
| 6 | Review | Target, write mode, run stages, schedule, limits, and alerts before publishing. |
Starting from a saved connection, the equivalent shortcut is Use in a new pipeline, in the connection's menu under ETL/ELT → Connections — and, if you open the connection wizard from inside the builder, when you save you return to the same draft with the new connection already selected.
About stage 1
The "— enter one-off credentials —" option exists for specific cases, but loses the advantage of changing the password in one place. Prefer referencing a connection.
Publish version 1#
Publishing happens in the Review stage, with the Publish pipeline button. Next to it, before you click, the screen tells you what will happen: "Publishing creates the pipeline version. The schedule will stay off and no load will start."
Once published, the wizard responds "Pipeline published — version 1", with the Schedule off badge and the sentence "Version 1 of the definition is frozen. No run was created, no load ran and no earlier interval was recovered." The three next actions — Run now, Turn on schedule, and Open operation — appear separately, each with its own button.
On the pipeline screen, the Publishing and schedule panel shows the same state: the Version 1 published badge, the schedule state, and three actions — Review and publish, Turn on schedule, and Run now. The middle button is Turn on schedule precisely because the schedule is off; it only becomes Pause schedule after you turn it on.
Schedule vocabulary on this screen
The status badge uses "Schedule paused" when a time is configured and the switch is off; the scheduling card, just below, uses "Schedule OFF". They're the same thing: nothing is dispatched until you turn it on.
Run the first load#
Use Run now. Review context, version, and target before confirming. Turn on schedule is a separate action, for later — and turning on the schedule does not trigger historical recovery.
Track the run#
In ETL/ELT → Runs. The list separates failed on last run (what needs action now) from failures in period (history), shows the schedule per pipeline, and shows times in Brasília time.
Open the run that was created and drill down from Run to Task, from Task to Attempt, and only then to the Logs tab. The log shown is the one for that attempt — the attempt selector is at the top, next to the run selector.
The Graph tab shows the dependencies between the tasks of the version that ran.
Check the result in the data#
A "success" status doesn't replace checking. Open Data → Data console and validate: the tables exist, the count matches the test dataset, and the known keys and values are there.
Legacy pipelines (created before versioned publishing)#
Not every pipeline in your workspace went through this flow. Those created before versioned publishing have no recorded version, and the screen says so instead of faking a retroactive version 1:
- the badge is "Version not recorded", not "Version 1 published";
- the schedule appears as Manual when no frequency/time is defined — even if the schedule switch is on, because the switch alone doesn't create a schedule;
- if the old registration stored a cron expression, the screen states that it is not dispatched: only the pipeline's scheduling (frequency and time) triggers automatic runs.
The screenshot below is of a legacy pipeline in the demo environment. It's here so you can recognize that state — it is not the screen for a first publication (that's in the Publish version 1 section).
To bring a legacy pipeline into versioning, use Review and publish: publishing creates the version from the current definition. On this path the schedule is kept as it is — updating a pipeline never turns off the schedule as a side effect.
Expected result#
- A published definition, identifiable by version.
- A traceable run, with tasks, attempts, and logs.
- Data checked at the target, not just a green badge.
- The schedule stays as you left it: off, if you didn't turn it on.
The end of a run doesn't refresh every dashboard automatically
Refreshing the dashboard is a separate step. See View a dashboard.
If something goes wrong#
| Symptom | What to check | Next action |
|---|---|---|
| Publishing blocked | The validation pointed out in the review | Fix the item; don't make up a dependency or credential to move forward |
| I published and nothing ran | The schedule state | Expected behavior — use Run now or Turn on schedule |
| It didn't start | Subscription status, concurrency limit, permission | Check the message on screen; settle it in Plans if it's billing |
| Authentication failure | The referenced connection | Fix it in the connection; don't re-enter the password in the pipeline |
| Schema or write failure | Input contract, mapping, effect on the target | See pipeline and schema |
| Retry pending | Limit and time of the attempt | Don't trigger parallel loads unnecessarily |
| Success, but empty dashboard | Target, materialization, BI binding, filters, and dashboard refresh | See View a dashboard |
| I reran and it duplicated | Load mode and recovery scope | See Recover from a failure |
| The historical run doesn't show a version | Runs from before versioning | The screen warns you; don't treat a later date as proof of content |
Limits and costs#
- Creating and publishing: R$ 0. Running consumes cloud resources (credits).
- We don't publish run times: they depend on the volume of your data, the source, and the queue. There's no published measurement.
Back to the app#
- Build a pipeline: ETL/ELT → Pipelines
- Track runs: Runs
Next task#
Last reviewed: 2026-09-17. The screenshots on this page come from the delivered
version, in a demo environment with fictional data (the project seed's synthetic
workspace), 1366×768 viewport; the failed run shown is a failure
induced in the fixture, not a customer incident. The provenance of
each image is in the screenshot manifest e2e/baseline/galeria-v3.json. A
screenshot from a local environment documents the interface; it doesn't prove execution in the
cloud.