0.8.0

• Users:
  • Adds support for running and validating Snakemake workflows.
  • Adds support for outputs.directories in reana.yaml allowing to easily download output directories.
  • Adds new command quota-show to retrieve information about total CPU and Disk usage and quota limits.
  • Adds new command info that retrieves general information about the cluster, such as available workspace path settings.
  • Changes validate command to add the possibility to check the workflow against server capabilities such as desired workspace path via --server-capabilities option.
  • Changes list command to add the possibility to filter by workflow status and search by workflow name via --filter option.
  • Changes list command to add the possibility to filter and display all the runs of a given workflow via -w option.
  • Changes list command to stop including workflow progress and workspace size by default. Please use new options --include-progress and --include-workspace-size to show this information.
  • Changes list --sessions command to display the status of interactive sessions.
  • Changes logs command to display also the start and finish times of individual jobs.
  • Changes ls command to add the possibility to filter by file name, size and last-modified values via --filter option.
  • Changes du command to add the possibility filter by file name and size via --filter option.
  • Changes delete command to prevent hard-deletion of workflows.
  • Changes Yadage workflow specification loading to be done in reana-commons.
  • Changes CWL workflow engine to cwltool version 3.1.20210628163208.
  • Removes support for Python 2.7. Please use Python 3.6 or higher from now on.
• Administrators:
  • Adds new configuration options node_label_runtimebatch, node_label_runtimejobs, node_label_runtimesessions allowing to set cluster node labels for splitting runtime workload into dedicated workflow batch nodes, workflow job nodes and interactive session nodes.
  • Adds new configuration option workspaces.paths allowing to set a dictionary of available workspace paths to pairs of cluster_node_path:cluster_pod_mountpath for mounting directories from cluster nodes.
  • Adds new configuration option quota.enabled to enable or disable CPU and Disk quota accounting for users.
  • Adds new configuration option quota.termination_update_policy to select the quota resources such as CPU and Disk for which the quota usage will be calculated immediately at the workflow termination time.
  • Adds new periodic cron job to update Disk quotas nightly. Useful if the quota.termination_update_policy does not include Disk quota resource.
  • Adds configuration environment variable reana_server.environment.REANA_WORKFLOW_SCHEDULING_POLICY allowing to set workflow scheduling policy (first-in first-out, user-balanced and workflow-complexity balanced).
  • Adds configuration environment variables reana_server.environment.REANA_RATELIMIT_GUEST_USER, reana_server.environment.REANA_RATELIMIT_AUTHENTICATED_USER allowing to set REST API rate limit values.
  • Adds configuration environment variable reana_server.environment.REANA_SCHEDULER_REQUEUE_SLEEP to set a time to wait between processing queued workflows.
  • Adds configuration environment variable reana_workflow_controller.environment.REANA_JOB_STATUS_CONSUMER_PREFETCH_COUNT allowing to set a prefetch count for the job status consumer.
  • Adds support for Kubernetes 1.21 version clusters.
  • Adds default kubernetes_memory_limit value (4 GiB) that will be used for all user jobs unless they specify otherwise.
  • Changes Helm template to use PostgreSQL 12.8 version.
  • Changes Helm template for reana-db component to allow 300 maximum number of database connections by default.
  • Fixes email validation procedure during create-admin-user command to recognize more permissive email address formats.
• Developers:
  • Changes git-* commands to add the possibility of excluding certain components via the --exclude-components option.
  • Changes git-create-release-commit command to bump all version files in a component.
  • Changes git-log command to show diff patch or to pass any wanted argument.
  • Changes helm-upgrade-components command to also upgrade the image tags in prefetch-images.sh script.

0.8.0-alpha.5

REANA reproducible research data analysis platform

0.8.0-alpha.4

REANA reproducible research data analysis platform

0.8.0-alpha.3

REANA reproducible research data analysis platform

0.7.4

• Users:
  • Adds support for file listing wildcard matching patterns to ls command.
  • Adds support for directory download and wildcard matching patterns to download command.
  • Adds support for specifying kubernetes_memory_limit for Kubernetes compute backend jobs for CWL, Serial and Yadage workflows.
  • Changes list command to include deleted workflows by default.
  • Changes validate command to warn about incorrectly used workflow parameters for each step.
  • Changes validate command to display more granular workflow validation output.
  • Fixes workflow step job command formatting bug for CWL workflows on HTCondor compute backend.
  • Fixes validate command output for verifying environment image UID values.
  • Fixes upload_to_server() Python API function to silently skip uploading in case of none-like inputs.
  • Fixes validate command for environment image validation to not test repetitively the same image found in different steps.
• Administrators:
  • Adds support for Kubernetes 1.21.
  • Adds configuration environment variable to set default job memory limits for the Kubernetes compute backend (REANA_KUBERNETES_JOBS_MEMORY_LIMIT).
  • Adds configuration environment variable to set maximum custom memory limits that users can assign to their jobs for the Kubernetes compute backend (REANA_KUBERNETES_JOBS_MAX_USER_MEMORY_LIMIT).
  • Changes HTCondor compute backend to 8.9.11 and myschedd package and configuration to latest versions.
  • Fixes Kubernetes job log capture to include information about failures caused by external factors such as out-of-memory situations (OOMKilled).
• Developers:
  • Adds new functions to serialise/deserialise job commands between REANA components.
  • Changes client dependencies to unpin six so that client may be installed in more contexts.
  • Changes cluster dependencies to remove click and pins several dependencies.
  • Changes reana_ready() function location to REANA-Server.

0.8.0-alpha.2

REANA reproducible research data analysis platform

0.7.4-alpha.2

REANA reproducible research data analysis platform

0.7.4-alpha.1

REANA reproducible research data analysis platform

0.7.3

• Users:
  • Adds reana-client validate options to detect possible issues with workflow input parameters and environment images.
  • Fixes problem with failed jobs being reported as still running in case of network problems.
  • Fixes job command encoding issues when dispatching jobs to HTCondor and Slurm backends.
• Administrators:
  • Adds new configuration to toggle Kubernetes user jobs clean up.
    (REANA_RUNTIME_KUBERNETES_KEEP_ALIVE_JOBS_WITH_STATUSES in components.reana_workflow_controller.environment)
  • Improves platform resilience.
• Developers:
  • Adds new command-line options to reana-dev run-example command allowing full parallel asynchronous execution of demo examples.
  • Adds default configuration for developer deployment mode to keep failed workflow and job pods for easier debugging.
  • Changes job status consumer communications to improve overall platform resilience.

0.7.2

• Administrators:
  • Adds support for deployments on Kubernetes 1.20 clusters.
  • Adds deployment option to disable user email confirmation step after sign-up.
    (REANA_USER_EMAIL_CONFIRMATION in components.reana_server.environment)
  • Adds deployment option to disable user sign-up feature completely.
    (components.reana_ui.hide_signup)
  • Adds deployment option to display CERN Privacy Notice for CERN deployments.
    (components.reana_ui.cern_ropo)
• Developers:
  • Adds support for Python 3.9.
  • Fixes minor code warnings.
  • Changes CI system to include Python flake8 and Dockerfile hadolint checkers.