Empty source loading fails with delta
table format on remote filesystems for not-yet-existing tables
#1685
Labels
bug
Something isn't working
dlt version
0.5.3
Describe the problem
Empty source loading (e.g. when using
dlt.mark.materialize_table_schema()
) fails withdelta
table format on remote filesystems for not-yet-existing tables.Reason is that
storage_options
are not passed toDeltaTable.create
.Does not fail for local filesystem because it does not need
storage_options
.Expected behavior
No response
Steps to reproduce
Run
test_delta_table_empty_source
with remote filesystem (e.g. addAZ_BUCKET
tobucket_subset
).Operating system
Windows
Runtime environment
Local
Python version
3.8
dlt data source
No response
dlt destination
No response
Other deployment details
No response
Additional information
No response
The text was updated successfully, but these errors were encountered: