"Error executing process > 'NANOPOLISH_VER:getVersion' " when running MOP_TAIL module

[rober136]

Hi devs,

I'm running MOP2 on a SLURM cluster and am running into an issue with the MOP_TAIL module; it fails to pull the image for NanoPolish. As an example, I have run the example yeast data through mop_preprocess and mop_tail with all default settings.

Everything runs fine up until it tries to pull the image for NanoPolish, and gives the following error:

Error executing process > 'NANOPOLISH_VER:getVersion'
Caused by:
  Failed to pull singularity image
  command: singularity pull  --name biocorecrg-mopnanopolish-0.2.img.pulling.1651764466493 docker://biocorecrg/mopnanopolish:0.2 > /dev/null
  status : 255
  message:
    INFO:    Converting OCI blobs to SIF format
    INFO:    Starting build...
    Getting image source signatures
    Copying blob sha256:1e74cf3ea8b17b29912c91cc0ea80b5d3aed0ffe25aa2c8d3d4b24c1454f7052
    ... 
    Copying config sha256:ec012d2e1e8779518bc0840db99d65a9b8ba084662ccbb9f457c09dbb6de27b2
    Writing manifest to image destination
    Storing signatures
    FATAL:   While making image from oci registry: error fetching image to cache: while building SIF from layers: conveyor failed to get: no descriptor found for reference "440b2c8927bbe2d4e64f19fdf5c304bad7fd7f9c70802cb25b07ec77d9243cf0"

I'm guessing it's because it's trying to save the image to /dev/null, which doesn't exist? Not sure if this is a singularity issue or how to go about fixing this...

Attached below are the job output and nextflow logs.

Test_nextflow.log
TailTest-32837074.txt

Edit: I should also mention, it still happens even if I disable NanoPolish in params.config (nano polish : NO).

Thanks,
Sean Robertson

[lucacozzuto]

Hi, this is quite weird. Which version of singularity and nextflow are you using? I see that from time to time this error pops up...
nextflow-io/nextflow#1210

[rober136]

I'm using Nextflow version 21.04.3 and Singularity version 3.8.

[lucacozzuto]

I fear this can be some weird Nextflow or singularity bug. I would try with a different version of singularity (3.6 ?) or I would download that image manually and place it in the cachedir. We might want to open an issue in nextflow github.

[lucacozzuto]

We are experiencing the same problems with singularity. We are investigating the use of wave for improving this.

https://www.nextflow.io/docs/latest/wave.html