🚀 Feature Request

I would like to be able to launch a sweep on SLURM with the submitit plugin in such a way that several jobs share the same GPU.

Motivation

Sometimes jobs do not fully use GPUs fully, and in such a situation one may save resources by being able to share the same GPU across multiple jobs.

Pitch

Describe the solution you'd like

A simple setting in the submitit plugin to enable this feature.

Describe alternatives you've considered

Implementing some custom sweep logic within my script, combined with tasks_per_node > 1 => this is cumbersome to implement and requires changing the sweep syntax.

Are you willing to open a pull request? (See CONTRIBUTING)

Yes