Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add File Caching #253

Open
lharzenetter opened this issue Oct 5, 2021 · 2 comments
Open

Add File Caching #253

lharzenetter opened this issue Oct 5, 2021 · 2 comments

Comments

@lharzenetter
Copy link
Member

Currently, the repositories are quering the file system for each request. To speed up the requests, we should include a chaching mechanism.

@koppor
Copy link
Member

koppor commented Oct 21, 2021

IMHO, this needs an ADR for the storage: file-based, document store, SQL database, graph database. When starting the implementation, I assumed, the file system is fast enough. a) SSDs are fast enough, b) file system caches itself, c) the number of requests per second is low.

May I ask about the decision driver here?

There is also a Winery implementation based on graph database. Should be somewhere archived at the IAAS. Maybe, this implementation can be included?

Oliver Kopp <[email protected]> on behalf of MBition GmbH.

@lharzenetter
Copy link
Member Author

The problem is, that with a growing repository size, the Topology Modeler's loading time increases rapidly. Additionally, as the Container now also uses Winery as its repository provider, the generation of plans got notably slower because each requests to the repository loads the contents from the files directly. Hence, we should maybe not call it file cache but rather object cache.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants