Skip to content

Allow file format change for Glue adapter #1711

@Jeremynadal33

Description

@Jeremynadal33

Is your feature request related to a problem? Please describe.
This is to complete issue #177 . I added PRs dbt-data-reliability and elementary for allowing Glue adapter with Delta file format. It then requires a configuration that allow Delta tables from the Glue session. We should add the possibility to use other file formats.

Describe the solution you'd like
I think we should add a macro that allow a new configuration to be passed to choose the file format with a verification that the file format allows incremental loads.

Describe alternatives you've considered
N/A

Additional context
Not sure if that is relevant or possible but I feel like we should check if the Glue session is able to use the file format.

Would you be willing to contribute this feature?
I would like to but I don't have time for now...

Activity

haritamar

haritamar commented on Oct 2, 2024

@haritamar
Collaborator

Hi @Jeremynadal33 !
Thanks a lot for your contribution of the Glue adapter, and for this issue.
Will look at the contribution when I can, in any case makes sense this is a separate issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @haritamar@Jeremynadal33

        Issue actions

          Allow file format change for Glue adapter · Issue #1711 · elementary-data/elementary