Skip to content

Commit

Permalink
Merge pull request #322 from duckdb/jwills-patch-1
Browse files Browse the repository at this point in the history
Add note about incremental materialization strategies
  • Loading branch information
jwills authored Jan 19, 2024
2 parents cd449e1 + a42bc4c commit 24e7f7c
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -313,6 +313,8 @@ with an extension that matches the `format` argument (`parquet`, `csv`, or `json
relative to the current working directory, but you can change the default directory (or S3 bucket/prefix) by specifying the
`external_root` setting in your DuckDB profile.

dbt-duckdb supports the `delete+insert` and `append` strategies for incremental `table` models, but unfortunately it does not yet support incremental materialization strategies for `external` models.

#### Re-running external models with an in-memory version of dbt-duckdb
When using `:memory:` as the DuckDB database, subsequent dbt runs can fail when selecting a subset of models that depend on external tables. This is because external files are only registered as DuckDB views when they are created, not when they are referenced. To overcome this issue we have provided the `register_upstream_external_models` macro that can be triggered at the beginning of a run. To enable this automatic registration, place the following in your `dbt_project.yml` file:

Expand Down

0 comments on commit 24e7f7c

Please sign in to comment.