Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate data to document-driven database format #15

Open
atoff opened this issue Feb 26, 2020 · 4 comments
Open

Migrate data to document-driven database format #15

atoff opened this issue Feb 26, 2020 · 4 comments
Labels
enhancement New feature or request

Comments

@atoff
Copy link
Owner

atoff commented Feb 26, 2020

Look to migrate existing data structure to a mongo-db type JSON format, to remove issues with current format not being a traditional database style

@atoff atoff added the enhancement New feature or request label Feb 26, 2020
@A-Lawrence
Copy link

@atoff
Copy link
Owner Author

atoff commented Feb 26, 2020

Good shout - I remember a certain Axon showing me this earlier. Thinking in the long term though, would be nice to give each variant a UUID to ensure easy merges into outdated / custom data sets (whilst still being able to maintain collaborative git version control)

@A-Lawrence
Copy link

It's not my package, but does that not mean you wouldn't be able to use it as a relation in a database at risk of it changing, if you aren't just going to give them all ids manually?

If you don't care about that, why don't you hook into the boot::creating event and set the Id as the md5 of the data?

@atoff
Copy link
Owner Author

atoff commented Feb 26, 2020

Trying to keep the package framework agnostic - this repo is just about data. But if I updated, say, the A320 neo variant, at the moment there would be no easy way to merge the new data into an existing import (say an SQL table). You could probably form a unique relationship based on ICAO code and variant and model, but if each variant had a database-like ID this would be a very easy update operation.

What I am kind of aiming for is a way of essentially maintaining a document-driven database, such that people can create, update and delete variants on GitHub without having to resort to a web-based editor (for example https://ourairports.com/), where it is easy to maintain a UUID in the form of an auto-increment ID in the table (If that makes sense)

MD5'ing the row could work, but I think it would be nice to provide a method to update the data for a variant without having to create a new entry in the table (although yes, in theory, the data for a aircraft variant should never change)

Open to ideas!

@atoff atoff changed the title Migrate Data to mongo DB Migrate data to document-driven database format Feb 26, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants