|
2 | 2 | title: "DLT-META"
|
3 | 3 | date: 2021-08-04T14:50:11-04:00
|
4 | 4 | draft: false
|
| 5 | + |
5 | 6 | ---
|
6 | 7 |
|
7 | 8 |
|
@@ -42,13 +43,14 @@ In practice, a single generic DLT pipeline reads the Dataflowspec and uses it to
|
42 | 43 | ## DLT-META DLT Features support
|
43 | 44 | | Features | DLT-META Support |
|
44 | 45 | | ------------- | ------------- |
|
45 |
| -| Input data sources | Autoloader, Delta, Eventhub, Kafka | |
| 46 | +| Input data sources | Autoloader, Delta, Eventhub, Kafka, snapshot | |
46 | 47 | | Medallion architecture layers | Bronze, Silver |
|
47 | 48 | | Custom transformations | Bronze, Silver layer accepts custom functions|
|
48 | 49 | | Data Quality Expecations Support | Bronze, Silver layer |
|
49 | 50 | | Quarantine table support | Bronze layer |
|
50 | 51 | | [apply_changes](https://docs.databricks.com/en/delta-live-tables/python-ref.html#cdc) API support | Bronze, Silver layer |
|
51 | 52 | | [apply_changes_from_snapshot](https://docs.databricks.com/en/delta-live-tables/python-ref.html#change-data-capture-from-database-snapshots-with-python-in-delta-live-tables) API support | Bronze layer|
|
| 53 | +| [append_flow](https://docs.databricks.com/en/delta-live-tables/flows.html#use-append-flow-to-write-to-a-streaming-table-from-multiple-source-streams) API support | Bronze layer| |
52 | 54 | | Liquid cluster support | Bronze, Bronze Quarantine, Silver tables|
|
53 | 55 | | [DLT-META CLI](https://databrickslabs.github.io/dlt-meta/getting_started/dltmeta_cli/) | ```databricks labs dlt-meta onboard```, ```databricks labs dlt-meta deploy``` |
|
54 | 56 | | Bronze and Silver pipeline chaining | Deploy dlt-meta pipeline with ```layer=bronze_silver``` option using Direct publishing mode |
|
|
0 commit comments