Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure memory can be set for requested jobs #620

Merged

Conversation

robertbartel
Copy link
Contributor

Updating request objects and CLI to make sure that memory can be explicitly provided when requesting a job.

Also updating related tests.
Ensure that SchedulerRequestMessage uses (if available) the memory value
of its provided model_request property if an explicit memory param is
not given; also, update related tests for this and previous change to
put "memory" in model requests.
To ensure updated DmodJobRequest with "memory" attribute is used.
@robertbartel robertbartel added bug Something isn't working maas MaaS Workstream labels May 16, 2024
Copy link
Contributor

@christophertubbs christophertubbs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. The only thing that concerns me is asserting equal to strings in the to_json tests. You might be better off by taking those strings, converting them to dicts via json.loads and comparing the results. This will ensure that the json does what you want it to, that it serializes and deserializes correctly, and order of keys never becomes an issue.

@christophertubbs christophertubbs merged commit d7d71bf into NOAA-OWP:master May 16, 2024
8 checks passed
@aaraney
Copy link
Member

aaraney commented May 16, 2024

In taking a quick look at this, I know the 500Kb default memory limit originates elsewhere, but we should really raise that default value. I suggest something like 128, 256, or 512MiB instead or even higher.

@robertbartel
Copy link
Contributor Author

@aaraney, that's a bit of a can of worms. I've opened #621 for us to think about that and track potential changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working maas MaaS Workstream
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants