Fix delta table recreation

What's Changed

• (delta): Detecting when schema changes to regenerate only needed tables by @hugoenrile in #46

Full Changelog: 0.18.5...0.18.6

Recreate Delta Tables in Glue

Merge pull request #45 from metabolicdata/hoftix/fix_delta_recreation

(Athena): Fix delta recreation

0.18.4

What's Changed

• Fix data lake lineage in atlan and add confluent-data_lake lineage by @berna396 in #36
• No execute Atlan Catalogue if no config by @berna396 in #37
• Make optimize optional by @berna396 in #38
• Fix no optimize in delta by @berna396 in #39
• Keep foreachBatch for append and overwrite by @berna396 in #40
• Fix atlan metastore source by @berna396 in #41

Full Changelog: 0.18.3...0.18.4

0.18.3

What's Changed

• Set prefix Athena filesink by @berna396 in #35

Full Changelog: 0.18.2...0.18.3

0.18.2

What's Changed

• Set prefix for athena externa table if the table belongs to a namespace by @berna396 in #32

Full Changelog: 0.18.1...0.18.2

0.18.1

What's Changed

• Incomptaible SchemaChanges mode by @margon8 in #31

Full Changelog: 0.18.0...0.18.1

0.18.0

What's Changed

• Feature/after action by @margon8 in #30

Full Changelog: 0.17.2...0.18.0

0.17.2

What's Changed

• Remove ERROR as fixed log level by @hugoenrile in #29

New Contributors

• @hugoenrile made their first contribution in #29

Quick fixes in Delta Management in AWS environments

What's Changed

• Fix create external table statement for delta tables by @berna396 in #27
• Set recreate delta table as false by default by @berna396 in #28

Full Changelog: 0.17.0...0.17.1

Delta Streaming Auto Optmizer

What's Changed

• feature/drop_view by @browniecode93 in #15
• Always recreate in Glue to keep schema updated by @margon8 in #16
• Updating Deploy Github Action by @margon8 in #17
• Updating aws s3 cp repo by @margon8 in #18
• Updating aws s3 cp repo by @margon8 in #19
• Chore/delta by @margon8 in #20
• Chore/formats docu by @margon8 in #21
• Chore/formats docu by @margon8 in #22
• Chore/formats docu by @margon8 in #23
• Implementing foreach in delta streaming by @margon8 in #24
• Add test to check if optimize works in batch by @berna396 in #25
• Allow demultiplex to future by @berna396 in #26

New Contributors

• @berna396 made their first contribution in #25

Full Changelog: 0.16.6...0.17.0