Read before:
../conectores.md(state map) andfichas.md(index of the cards).
What it is#
Connects to your MariaDB via the MySQL driver and extracts tables to our cloud on a schedule. Supports incremental loading by watermark.
Supported ingestion modes:
- Nós buscamos — Nós buscamos os dados na sua fonte.
Purpose#
Bring data from MariaDB into your datalake and make it available to the Bronze/Silver/Gold layers, BI models and the natural-language question wizard.
When to use / when not to use#
Use when you need to consolidate this source into the datalake on a schedule, with isolation by workspace.
Avoid unnecessary full loads on large tables: prefer incremental loading by watermark (see Limits and the incremental guide).
Plan and permissions#
- Plan: core product (connectors are part of all plans; the limit is the number of sources in the plan).
- Access: requires an active workspace — with the subscription overdue, suspended or cancelled, runs are blocked.
- Shutdown: the ingestion run can be temporarily turned off (maintenance or incident). When that happens, the screen shows that the feature is unavailable at the moment.
Prerequisites#
- A read-only user in the database, with access to the desired schema/tables.
- Network: choose how we reach the database — public IP + allowlist, SSH tunnel (bastion), Cloud SQL or VPN.
Credentials#
Sensitive fields. They are encrypted (AES-256-GCM) and are never kept in the connection config, in the pipeline definition, in exports or in the DAG. By default the encrypted value is stored in the database; moving the credential from this connection to the external credentials vault is an explicit choice made per connection after saving — see ../../administracao/credenciais-e-rotacao.md.
- Password (
password) — Stored encrypted. After saving, nobody can view it again — not even you. - SSH private key (
sshPrivateKey)
Secrets are never re-displayed and are redacted in any error/log (raw token, URL-encoded and in JSON).
Form fields#
| Field | Label | Type | Required | Notes |
|---|---|---|---|---|
host | Server address | text | yes | Server name or IP of the database. Your IT team or ERP provider can provide this. |
port | Port | number | yes | default: 3306; Comes with the default port (3306). Only change if your IT says it's different. |
database | Database name | text | yes | The database name inside the server. |
schema | Schema | text | no | Optional. Leave empty to see all tables visible to the user. |
user | User | text | yes | Prefer a READ-ONLY user created for BI. |
password 🔒 | Password | password/secret | yes | secret (encrypted; external vault optional); Stored encrypted. After saving, nobody can view it again — not even you. |
oracleConnectBy | Identify the database by | selection | no | default: service; options: service / sid; Your IT knows if the Oracle database uses Service Name (more common) or SID. |
serviceName | Service Name | text | no | appears when oracleConnectBy = service |
sid | SID | text | no | appears when oracleConnectBy = sid |
network | How we reach the database | selection | no | default: direct; options: direct / ssh / cloudsql / vpn; In most cases it's “direct over the internet”. Use SSH tunnel if the database only accepts access via the internal network. |
sshHost | Bastion host (SSH) | text | no | appears when network = ssh |
sshPort | Bastion port | number | no | default: 22; appears when network = ssh |
sshUser | Bastion user | text | no | appears when network = ssh |
sshPrivateKey 🔒 | SSH private key | password/secret | no | secret (encrypted; external vault optional); appears when network = ssh |
Step-by-step#
- In the menu Dados → Conexões, use Nova conexão.
- Choose MariaDB in the catalog.
- Fill in the form fields (see the table above).
- Use Testar conexão. The result is shown broken down into Conectividade, Autenticação and Listagem/leitura — each with OK, Failed, Not applicable or Not tested. A capability with no test of its own for this connector shows as Not applicable, and Not applicable never counts as success.
- Use Salvar conexão. Saving DOES NOT start any ingestion.
- On the connection card, use Montar extração (or go to Orquestração → Pipelines and use Conectar fonte). The pipeline points to the saved connection — the credential is not copied.
- In the review, Publicar (agenda desligada) creates version 1 without executing anything. Then, Ativar agenda and Executar agora are separate actions.
Example — connection test#
Example configuration (all values are fictitious; secrets are masked):
# Exemplo sintético (valores fictícios — não são credenciais reais)
host = db.exemplo.invalid
port = 3306
database = vendas
schema = public
user = leitura_bi
password = •••••• (cifrado — nunca exibido)
oracleConnectBy = service
network = directExpected result#
The Testar conexão returns the list of discovered tables/resources. After the first load, the rows appear in the Bronze layer of your workspace, ready for the pipeline.
Limits and costs#
- Pagination: hard cap per run (default 10,000 pages / 5,000,000 rows); loop-guard.
- Incremental by watermark: append/keyset by key-column. Not CDC — does not capture deletes or UPDATEs outside the watermark window. True CDC (WAL/redo/binlog) is on the Roadmap.
- Estimated volume: ~5 GB/month (catalog estimate, not measurement).
- Cost: the extraction itself is not charged by the platform; the Bronze load consumes datalake processing (billable).
Security#
- Workspace-scoped: each customer reads and writes only to their own datalake (
<prefix>_bronze/_silver/_gold); there is never leakage between workspaces. - Encrypted secrets: sensitive material is encrypted with AES-256-GCM before being written. The external credentials vault is optional and enabled per connection; without it, the encrypted value is stored in the database. Changing the value here DOES NOT revoke the credential at the origin.
- Redaction: all errors/logs pass through secret redaction (raw, URL-encoded and in JSON).
- Production does not mock: a path that would fall into a mock triggers the production guard (explicit failure instead of simulating success).
Common errors#
- Connection refused / timeout — incorrect host, port or network rule (allowlist/SSH/VPN). Check the chosen network mode in Como conectamos.
- Authentication failed — invalid user/password or user without read permission on the schema.
- SSL/handshake — adjust
sslmode(PostgreSQL) orencrypt(SQL Server) according to the server requirement. - Large table/query — the extraction respects the pages/rows cap; use incremental loading by watermark to reduce volume.
Troubleshooting#
- Use Testar conexão to isolate credential/network issues before scheduling.
- Monitor runs in the observabilidade por conector (error rate, p50/p95, freshness).
- A schema change at the source is signaled by schema drift (new column = info; removed/changed type column = attention).
Related#
../conectores.md— connectors catalog by state../ingestao-incremental-backfill.md— full, incremental by watermark, backfill and checkpoint../pipeline-medalhao.md— Bronze/Silver/Gold layers and quality../agendamento-retry-dlq.md— scheduling, retry/backoff and DLQ../custo-limites-seguranca.md— cost, caps and workspace security
Last review: 2026-10-04. Card automatically generated from the product connectors catalog.