Build on compute or login nodes from one build script.

.github/copilot-instructions.md

@@ -15,15 +15,14 @@ This document provides comprehensive guidance for AI agents working on the NOAA
 ### Build System Commands
 ```bash
 # Build all components (from sorc/)
-./build_all.sh                    # Default build
-./build_all.sh -d                 # Debug mode
-./build_all.sh -f                 # Fast build with -DFASTER=ON
-./build_all.sh -v                 # Verbose output
-./build_all.sh -k                 # Kill all builds if any fails
+./build_all.sh                     # Default build on current login node
+./build_all.sh -d                  # Debug mode
+./build_all.sh -v                  # Verbose output
+./build_all.sh -c -A <HPC_ACCOUNT> # Compute node build with HPC account
 
 # Build specific systems
 ./build_all.sh gfs               # GFS forecast system
-./build_all.sh gefs              # GEFS ensemble system  
+./build_all.sh gefs              # GEFS ensemble system
 ./build_all.sh sfs               # Seasonal forecast system
 ./build_all.sh gcafs             # Climate analysis system
 ./build_all.sh gsi               # GSI data assimilation
@@ -55,7 +54,7 @@ python setup_xml.py /path/to/experiment
 ```bash
 # Supported platforms (use detect_machine.sh)
 WCOSS2    # Tier 1 - Full operational support
-Hercules  # Tier 1 - MSU, no TC Tracker  
+Hercules  # Tier 1 - MSU, no TC Tracker
 Hera      # Tier 2 - NOAA RDHPCS
 Orion     # Tier 2 - MSU, GSI runs slowly
 Gaea      # Cloud platforms via EPIC
@@ -74,7 +73,7 @@ Gaea      # Cloud platforms via EPIC
 ```
 jobs/                         # Production Job Control Language (JCL) scripts (89 files)
 ├── JGDAS_*                   # GDAS (Global Data Assimilation System) jobs
-├── JGFS_*                    # GFS (Global Forecast System) jobs  
+├── JGFS_*                    # GFS (Global Forecast System) jobs
 ├── JGLOBAL_*                 # Cross-system global jobs
 ├── Analysis Jobs (41)        # Data assimilation and analysis
 ├── Forecast Jobs (13)        # Model forecast execution
@@ -158,7 +157,7 @@ dev/workflow/rocoto/       # Rocoto-specific implementations
 ├── tasks.py               # Base Tasks class with common task functionality
 ├── workflow_tasks.py      # Task orchestration and dependency management
 ├── gfs_*.py               # GFS-specific implementations
-├── gefs_*.py              # GEFS-specific implementations  
+├── gefs_*.py              # GEFS-specific implementations
 ├── sfs_*.py               # SFS-specific implementations
 └── gcafs_*.py             # GCAFS-specific implementations
 
@@ -426,7 +425,7 @@ def test_task_creation():
 
 ### New Hosts
 1. Add machine detection in `detect_machine.sh`
-2. Create host configuration in `hosts/` directory  
+2. Create host configuration in `hosts/` directory
 3. Create modulefiles for environment setup
 4. Update environment configurations in `env/` directory
 
@@ -476,7 +475,7 @@ This repository includes a specialized Model Context Protocol (MCP) server with
 When using MCP tools, acknowledge their usage to demonstrate intelligent tool selection:
 
 ```markdown
-**Research Approach:** Using `mcp_globalworkflo_search_documentation` to find relevant 
+**Research Approach:** Using `mcp_globalworkflo_search_documentation` to find relevant
 examples and `mcp_globalworkflo_get_operational_guidance` for HPC-specific procedures.
 ```
 
@@ -494,7 +493,7 @@ These tools are actively being developed and refined on the `MCP_node.js-RAG_dev
 
 **MCP Server Location**: All MCP tools are implemented in `dev/ci/scripts/utils/Copilot/mcp_server_node/`:
 - `mcp-server-rag.js` - Main RAG-enhanced server with 9 workflow tools
-- `mcp-server-github-rag.js` - GitHub ecosystem integration with 14 total tools  
+- `mcp-server-github-rag.js` - GitHub ecosystem integration with 14 total tools
 - `start-mcp-server-node.sh` - Primary startup script
 - Configuration files: `mcp-config.env`, `package.json`, `package-rag.json`
 

dev/ci/scripts/utils/ci_utils.sh

@@ -244,7 +244,7 @@ function build() {
         echo "Creating logs folder"
         mkdir -p "${logs_dir}" || exit 1
     fi
-    "${HOMEgfs_}/sorc/build_compute.sh" -A "${HPC_ACCOUNT}" all
+    "${HOMEgfs_}/sorc/build_all.sh" -c -A "${HPC_ACCOUNT}" all
 
 }
 

dev/workflow/generate_workflows.sh

@@ -17,7 +17,10 @@ function _usage() {
        directory up from this script's residing directory.
 
     -b Run build_all.sh with default flags
-       (build the UFS, UPP, UFS_Utils, and GFS-utils only)
+       (build the UFS, UPP, UFS_Utils, and GFS-utils only on login nodes)
+
+    -B Run build_all.sh -c with default flags [-c triggers build on compute nodes]
+       (build the UFS, UPP, UFS_Utils, and GFS-utils only on compute nodes)
 
     -u Update submodules before building and/or generating experiments.
 
@@ -84,6 +87,7 @@ set -eu
 HOMEgfs=""
 _specified_home=false
 _build=false
+_compute_build=false
 _build_flags=""
 _update_submods=false
 declare -a _yaml_list=("C48_ATM")
@@ -110,7 +114,7 @@ _auto_del=false
 _nonflag_option_count=0
 
 while [[ $# -gt 0 && "$1" != "--" ]]; do
-    while getopts ":H:bDuy:Y:GESCA:ce:t:vVdh" option; do
+    while getopts ":H:bBDuy:Y:GESCA:ce:t:vVdh" option; do
         case "${option}" in
             H)
                 HOMEgfs="${OPTARG}"
@@ -121,6 +125,7 @@ while [[ $# -gt 0 && "$1" != "--" ]]; do
                 fi
                 ;;
             b) _build=true ;;
+            B) _build=true && _compute_build=true ;;
             D) _auto_del=true ;;
             u) _update_submods=true ;;
             y) # Start over with an empty _yaml_list
@@ -442,8 +447,11 @@ fi
 if [[ "${_build}" == "true" ]]; then
     printf "Building via build_all.sh %s\n\n" "${_build_flags}"
     # Let the output of build_all.sh go to stdout regardless of verbose options
+    if [[ "${_compute_build}" == true ]]; then
+        _compute_build_flag="-c -A ${HPC_ACCOUNT}"
+    fi
     #shellcheck disable=SC2086,SC2248
-    ${HOMEgfs}/sorc/build_all.sh ${_verbose_flag} ${_build_flags}
+    ${HOMEgfs}/sorc/build_all.sh ${_compute_build_flag:-} ${_verbose_flag} ${_build_flags}
 fi
 
 # Link the workflow silently unless there's an error

dev/workflow/build_compute.py → dev/workflow/setup_buildxml.py

@@ -1,7 +1,7 @@
 #!/usr/bin/env python3
 
 """
-Entry point for setting up a compute-node build
+Entry point for setting up a builds of global-workflow programs
 """
 
 import os
@@ -20,11 +20,11 @@
 
 def input_args(*argv):
     """
-    Method to collect user arguments for `compute_build.py`
+    Method to collect user arguments for `setup_buildxml.py`
     """
 
     description = """
-        Setup files and directories to start a compute build.
+        Setup buildXML to compile global-workflow programs.
     """
 
     parser = ArgumentParser(description=description,

docs/source/clone.rst

@@ -20,7 +20,15 @@ Clone the `global-workflow` and `cd` into the `sorc` directory:
 
 .. _build_examples:
 
-The build_all.sh script can be used to build all required components of the global workflow.  The accepted arguments is a list of systems to be built.  This includes builds for GFS, GEFS, and SFS forecast-only experiments, GSI and GDASApp-based DA for cycled GFS experiments.  See `feature availability <hpc.html#feature-availability-by-hpc>`__ to see which system(s) are available on each supported system.
+The `build_all.sh` script can be used to build all required components of the global workflow.
+`build_all.sh` allows for optional flags to modify the build behavior:
+
+   - ``-c``: Build on compute nodes.  The default behaviour is to build on the head node.
+   - ``-A HPC_ACCOUNT``: Specify the HPC account to be used when building on compute nodes.
+   - ``-v``: Execute all build scripts with -v option to turn on verbose where supported
+   - ``-h``: Print help message and exit
+
+The accepted arguments is a list of systems to be built.  This includes builds for GFS, GEFS, and SFS forecast-only experiments, GSI and GDASApp-based DA for cycled GFS experiments.  See `feature availability <hpc.html#feature-availability-by-hpc>`__ to see which system(s) are available on each supported system.
 
 ::
 
@@ -125,17 +133,19 @@ Under the ``/sorc`` folder is a script to build all components called ``build_al
 
 ::
 
-   ./build_all.sh [-a UFS_app][-k][-h][-v] [list of system(s) to build]
-  -a UFS_app:
-    Build a specific UFS app instead of the default
-  -k:
-    Kill all builds immediately if one fails
+  ./build_all.sh [-c][-A HPC_ACCOUNT][-h][-v] [list of system(s) to build]
+  -c:
+    Build on compute nodes.  The default behaviour is to build on the head node.
+  -A HPC_ACCOUNT:
+    Specify the HPC account to be used when building on compute nodes.
   -h:
     Print this help message and exit
   -v:
     Execute all build scripts with -v option to turn on verbose where supported
 
-  Lastly, pass to build_all.sh a list of systems to build.  This includes `gfs`, `gefs`, `sfs`, `gcafs`, `gsi`, `gdas`, and `all`.
+Lastly, pass to `build_all.sh` a list of systems to build.  This includes `gfs`, `gefs`, `sfs`, `gcafs`, `gsi`, `gdas`, and `all`.
+
+To configure the build with specific flags or options for the various components, you can update the respective build command in the `build_opts.yaml` file.
 
 For examples of how to use this script, see :ref:`build examples <build_examples>`.
 

docs/source/development.rst

@@ -88,7 +88,7 @@ The commonly run tests are written in YAML format and can be found in the ``dev/
 where:
 
     * ``-A`` is used to specify the HPC (slurm or PBS) account to use
-    * ``-b`` indicates that the workflow should be built fresh
+    * ``-b|B`` indicates that the workflow should be built fresh (`-B` uses compute nodes for the build)
     * ``-GESC`` specifies that all of the GFS, GEFS, SFS, GCAFS cases should be run (this also influences the build flags to use)
     * ``-c`` tells the tool to append the rocotorun commands for each experiment to your crontab