You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have searched in the issues and found no similar issues.
Describe the feature
Spark Job configures its estimate disk space in its Spark configurations. Uniffle pass the estimate disk space to the coordinator. If the disk space exceeds the limitation of disk space, coordinator will reject the Spark Job.
More code you can see AbstractAccessChecker to add a new access checker in the coordinator code.
For Spark client, you can see DelegationRssShuffleManager.
Motivation
Avoid large jobs concurrently running.
Describe the solution
Add a new access checker class.
Additional context
No response
Are you willing to submit PR?
Yes I am willing to submit a PR!
The text was updated successfully, but these errors were encountered:
Code of Conduct
Search before asking
Describe the feature
Spark Job configures its estimate disk space in its Spark configurations. Uniffle pass the estimate disk space to the coordinator. If the disk space exceeds the limitation of disk space, coordinator will reject the Spark Job.
More code you can see
AbstractAccessChecker
to add a new access checker in the coordinator code.For Spark client, you can see
DelegationRssShuffleManager
.Motivation
Avoid large jobs concurrently running.
Describe the solution
Add a new access checker class.
Additional context
No response
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: