dbt
Run dbt projects as assets and see models in the lineage graph.
Transformation Beta
What the dbt connector does
Run your dbt project as part of a Synchronoid pipeline. Each dbt model becomes an asset, so it appears in the lineage graph next to the sources that feed it and the change feeds it drives.
Synchronoid runs dbt after the upstream data has landed and passes the run id as a variable, so every model run can be traced back to the load that triggered it.
Capabilities
- Every model, seed and snapshot imported as an asset
- Run, test and build commands
- Model selection with
--selectsyntax per pipeline - dbt tests reported as asset checks in the control room
- Upstream and downstream lineage across dbt and non-dbt assets
- Works with Snowflake, BigQuery, PostgreSQL and Redshift adapters
- Artifacts (manifest and run results) stored for each run
Set it up in minutes
Describe the connection in synchronoid.yaml or in Python. Both produce the same source, and credentials always come from secrets.
transformations:
analytics:
connector: dbt
project_dir: ./dbt
profiles: ${secret:DBT_PROFILES}
command: build
select: "tag:daily"
after:
- companies_currentimport synchronoid as sy analytics = sy.dbt_project( project_dir="./dbt", profiles=sy.Secret("DBT_PROFILES"), select="tag:daily", command="build", after=[companies_current], )
Permissions and prerequisites
| Item | Requirement |
|---|---|
| dbt version | 1.7 or newer (dbt Core) |
| Adapter | One of the supported warehouse adapters |
| Project location | In the same repository as your Synchronoid project |
| Credentials | Warehouse credentials stored as a Synchronoid secret |
| Python | 3.10 or newer on the worker image |
Good to know before you start
- dbt Cloud jobs are not triggered; only dbt Core projects run on Synchronoid workers.
- Models with dynamic
refcalls cannot be shown in the lineage graph. - Beta: selectors that use state comparison are not supported yet.
Need something we don’t cover?
Tell us what you are missing. Feedback from beta users decides what we build next, and you can follow progress on the roadmap.
Request a feature →Keep reading
Connect dbt to Synchronoid
Synchronoid is in private beta. Tell us about your data and we will get you a workspace.