Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Export / Import lineage data #815

Open
wajda opened this issue Dec 10, 2020 · 2 comments
Open

Export / Import lineage data #815

wajda opened this issue Dec 10, 2020 · 2 comments
Assignees
Labels
Milestone

Comments

@wajda
Copy link
Contributor

wajda commented Dec 10, 2020

We could export/import the lineage.
Imaginary example:

  1. I have a file A on HDFS, and its lineage in Spline
  2. I want to copy A to a different infrastructure (network, cluster, cloud, you name it), monitored by another independent Spline instance. And I don't want to loose the lineage of A
  3. Using Spline UI or CLI I dump A's full lineage to a file and carry it with A to a new infrastructure
  4. There the lineage dump can be imported manually (again by using UI or CLI), or even automatically on the first Spline tracked read from A.

Originally posted by @wajda in #23 (comment)

@Jaykumar5121
Copy link

Hi, Is there any APIS to export the full lineages ? if yes then by HTTP request response can we export ?

@wajda
Copy link
Contributor Author

wajda commented Jan 11, 2023

Not yet. This feature hasn't gotten any priority so far.

@AbsaOSS AbsaOSS deleted a comment from Jaykumar5121 Jan 11, 2023
@wajda wajda self-assigned this Nov 17, 2024
@wajda wajda moved this from New to In Progress in Spline Nov 17, 2024
@wajda wajda added this to the 0.7.10 milestone Nov 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: In Progress
Development

No branches or pull requests

2 participants