In Google Batch, install GPU drivers for GPU VMs

[siddharthab]

Also clean up some old logic for container options when using GPUs.
These are now automatically handled by Google Cloud.

Fixes #5372.

Signed-off-by: Siddhartha Bagaria [email protected]

[netlify]

✅ Deploy Preview for nextflow-docs-staging canceled.

Name	Link
🔨 Latest commit	9c13f7a
🔍 Latest deploy log	https://app.netlify.com/sites/nextflow-docs-staging/deploys/6745d4b54c78640008f592db

[bentsherman]

@siddharthab overall the changes make sense. I think we'll need to do some testing on our end to make sure the machine type selection still works with Fusion + SSD

Can you confirm that it works for you with some GPU-enabled tasks?

[siddharthab]

Yes, I confirm that I tested the following configurations:

GPU Directive	bootDiskImage	Fusion	Result
machineType	batch-cos	No	PASS
accelerator	batch-cos	No	PASS
machineType	batch-cos	Yes	PASS†
accelerator	batch-cos	Yes	PASS
machineType	batch-debian	No	FAIL‡
accelerator	batch-debian	Yes	FAIL‡

† Needed new logic in findValidLocalSSDSize for the larger machine types, now pushed as an update to this PR.

‡ It looks like installGpuDrivers works properly only when bootDiskImage is batch-cos (the default). With batch-debian, the installer aborted with the following in journalctl. This is independent of any changes made in this PR (mentioning here because it came up in my testing).

google_metadata_script_runner[846]: startup-script-url: [2024-10-09 19:40:44] Executing: lspci -n
google_metadata_script_runner[846]: startup-script-url:
google_metadata_script_runner[846]: startup-script-url: 00:00.0 0600: 8086:1237 (rev 02)
google_metadata_script_runner[846]: startup-script-url: 00:01.0 0601: 8086:7110 (rev 03)
google_metadata_script_runner[846]: startup-script-url: 00:01.3 0680: 8086:7113 (rev 03)
google_metadata_script_runner[846]: startup-script-url: 00:03.0 0000: 1af4:1004
google_metadata_script_runner[846]: startup-script-url: 00:04.0 0200: 1af4:1000
google_metadata_script_runner[846]: startup-script-url: 00:05.0 00ff: 1af4:1005
google_metadata_script_runner[846]: startup-script-url:
google_metadata_script_runner[846]: startup-script-url: There doesn't seem to be a GPU unit connected to your system. Aborting drivers installation.

[siddharthab]

@bentsherman The test failures seem unrelated to this change. Please let me know if you would like to see anything more in this PR.

[siddharthab]

@bentsherman Any thoughts?