Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Synchronous Mongodb Storage #204

Open
hsicsa opened this issue Mar 20, 2023 · 3 comments
Open

Synchronous Mongodb Storage #204

hsicsa opened this issue Mar 20, 2023 · 3 comments

Comments

@hsicsa
Copy link

hsicsa commented Mar 20, 2023

While async mongodb storage is nice for scalability, some environments (e.g. Apache Beam) don't support async io.
Synchronous Mongodb storage would satisfy that particular use case as well as facilitate testing for smaller data sets.

@ekzhu
Copy link
Owner

ekzhu commented Mar 21, 2023

Good point. Would love to get some help on this one.

@hsicsa
Copy link
Author

hsicsa commented Mar 23, 2023

In the near term, would be be possible to wrap the async functionality in a synchronous wrapper?
How would one do this in python?

@ekzhu
Copy link
Owner

ekzhu commented Mar 24, 2023

Perhaps the easiest thing to do is to implement a separate MongoDB storage layer. The code should be similar but simpler than the async MongoDB storage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants