You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The following jobs use the WORKING_STORAGE_FAST exclusively if available:
jp2_conversion_wrapper (grok)
lurawave_wrapper
create_thumbs
create_jpeg
jpegConversionEditorial_s3
iadownload
jpylyzer
altoconvert
only use WORKING_STORAGE:
jpegConversionEditorialUpdate_s3
embedEditorialMeta_s3
layoutwizzard-cli
All these use exactly one storage area and make no decision based on size (as bagit does), so we only need one kind of storage. As WORKING_STORAGE_FAST is set to ephemeral storage, this means that nearly all jobs already use that and nearly none use the EFS.
If no jobs have had any trouble with the ephemeral storage, we should check the remaining job types and could get rid of one storage type (probably EFS).
After switching bagit creation to EC2/EBS we should check the storage usage of the fargate based worker nodes:
Also we should check if we can simplify the workernode scripts if we don't need to decide which storage area to use anymore.
The text was updated successfully, but these errors were encountered: