Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why is the job script length a parameter of the slurm_jobscripts? And why 100000 characters as a default? #23

Open
cmd-ntrf opened this issue Aug 21, 2023 · 0 comments

Comments

@cmd-ntrf
Copy link
Contributor

Here is what I found thus far:

  • The job script is saved in the database as a TextField, which has no maximum length based on Django documentation - so the limits is not related to Django.
  • Slurm has its own script size limit, that can be set with SchedulerParameters as max_script_size and this value by default is 4MB. This limit is kept as is on all Alliance clusters.
  • It could be a database/storage optimization, in which case, this parameter should be set on Django side of userportal, not the exporter.

Anything I am missing? Otherwise, I would suggest we remove the parameter and have slurm_jobscripts daemon export the entire scripts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant