Each Silver or Gold table in the pipeline is written in a Storage format:
- Default — the datalake's native format, the one every table uses today.
- Apache Iceberg (open format) — an open table, in Parquet files, that other market tools (Spark, Trino and others) can also read.
The Apache Iceberg option is being rolled out: it is enabled workspace by workspace. While it is not enabled in yours, the screen says "The open format is not enabled in this workspace yet. Contact support to enable it."
What it is for#
| You want | Format |
|---|---|
| Everyday dashboards, queries, AI and Connect BI | Default — the simplest, and nothing changes |
| Another tool (your own Spark or Trino) to read the same table without a copy | Apache Iceberg (open format) |
| To keep the table in an open format, without depending on a vendor | Apache Iceberg (open format) |
For whoever uses the table inside the product — dashboards, queries, Aiô, agents — nothing changes: the table shows up in the catalog with the same name and the same columns, in both formats.
How to choose#
1. Open the step
In the pipeline detail, open the Silver or Gold step (or create one with New Silver / New Gold).
2. Choose the format
Next to the load type, in Storage format, choose Default or Apache Iceberg (open format).
3. Save and run
Save the step. The next run writes the table in the chosen format.
Changing the format of an existing table#
Changing the format recreates the table on the next run.
- With a Full load, the table is rebuilt entirely in the new format — nothing is lost.
- With an Append load, on a table that has already been loaded, recreating it would erase the history. That is why the change is refused. To change it, switch the load type to Full once (the table is recreated) or save it under another name.
Limits#
- It applies to Silver and Gold tables. Bronze stays in the default format.
- With your own cloud (the datalake in your company's project), the open format is not available yet: data keeps being written in the default format, in your cloud.
- To read an Iceberg table from a tool outside the product, contact support: access for other engines is granted table by table.