Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prevent one project from blocking all others to sync #2507

Open
flodolo opened this issue May 3, 2022 · 2 comments
Open

Prevent one project from blocking all others to sync #2507

flodolo opened this issue May 3, 2022 · 2 comments
Labels
bug P2 We want to ship it soon, possibly in the current quarter sync

Comments

@flodolo
Copy link
Collaborator

flodolo commented May 3, 2022

https://pontoon.mozilla.org/sync/log/215326/

Foundation Content took almost 2 hours to sync, blocking most of the other projects (not all of them, somehow).

Filing an issue to make sure this is on the radar, even if we talked about it before. This is likely caused by the TOML file having hundreds of entries.

I guess part of solving the issue is optimizing the performance, but the most important part (maybe the easiest?) would be making sure such a project doesn't block all the others.

@mathjazz mathjazz changed the title Sync: prevent one project from blocking all others Prevent one project from blocking all others to sync May 3, 2022
@mathjazz mathjazz added P2 We want to ship it soon, possibly in the current quarter bug sync labels May 3, 2022
@mathjazz
Copy link
Collaborator

mathjazz commented May 3, 2022

Let's use this issue to fix sync task concurrency.

Slow performance of sync tasks with complex TOML files is unrelated to that and should be addressed separately.

@mathjazz mathjazz added P3 Default, possibly shipping in the following two quarters and removed P2 We want to ship it soon, possibly in the current quarter labels May 3, 2022
@mathjazz mathjazz moved this from Done to Error Recovery in Pontoon Sync reliability Apr 4, 2024
@mathjazz mathjazz added P2 We want to ship it soon, possibly in the current quarter and removed P3 Default, possibly shipping in the following two quarters labels Dec 20, 2024
@mathjazz
Copy link
Collaborator

Bumping to P2 mostly to put it on our radar. Now that #3312 landed, we might be able to replace Performance-M worker with multiple Standard workers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug P2 We want to ship it soon, possibly in the current quarter sync
Projects
Status: Error Recovery
Development

No branches or pull requests

2 participants