We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
https://dlthub-community.slack.com/archives/C04DQA7JJN6/p1721995419954429
@VioletM we should document how to adapt sources. the example below IMO is not the best pattern:
from sql_database import sql_database from dlt.destinations.adapters import weaviate_adapter import dlt products_table = sql_database().with_resources("products") pipeline = dlt.pipeline( pipeline_name="postgres_to_weaviate_pipeline", destination="weaviate", ) products_table.table_name = "Products" info = pipeline.run( weaviate_adapter(products_table.products, vectorize="description"), ) print(info)
beacuse it takes the resource out of source and adapts it and loads it. what user should do:
products_tables = sql_database().with_resources("products", "customers") pipeline = dlt.pipeline( pipeline_name="postgres_to_weaviate_pipeline", destination="weaviate", ) # adapt the resource within the source weaviate_adapter(products_tables.products, vectorize="description") weaviate_adapter(products_tables.customers, vectorize="bio") info = pipeline.run(products_tables)
The text was updated successfully, but these errors were encountered:
VioletM
dat-a-man
Successfully merging a pull request may close this issue.
https://dlthub-community.slack.com/archives/C04DQA7JJN6/p1721995419954429
@VioletM we should document how to adapt sources. the example below IMO is not the best pattern:
beacuse it takes the resource out of source and adapts it and loads it. what user should do:
The text was updated successfully, but these errors were encountered: